-- Logs begin at Tue 2022-10-18 23:51:18 UTC, end at Wed 2022-10-19 02:38:21 UTC. -- Oct 19 00:32:48.032260 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 00:32:48.043445 n-d-master-1 devstack@n-api.service[115590]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:32:48 2022] *** Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: nodename: n-d-master-1 Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: machine: x86_64 Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: clock source: unix Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: pcre jit disabled Oct 19 00:32:48.045864 n-d-master-1 devstack@n-api.service[115590]: detected number of CPU cores: 4 Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: current working directory: / Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: your processes number limit is 47680 Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: your memory page size is 4096 bytes Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: detected max file descriptor number: 2048 Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: lock engine: pthread robust mutexes Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: thunder lock: enabled Oct 19 00:32:48.046455 n-d-master-1 devstack@n-api.service[115590]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 00:32:48.046884 n-d-master-1 devstack@n-api.service[115590]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:32:48.088013 n-d-master-1 devstack@n-api.service[115590]: Python main interpreter initialized at 0x55bcd40da9c0 Oct 19 00:32:48.088013 n-d-master-1 devstack@n-api.service[115590]: python threads support enabled Oct 19 00:32:48.088013 n-d-master-1 devstack@n-api.service[115590]: your server socket listen backlog is limited to 100 connections Oct 19 00:32:48.088013 n-d-master-1 devstack@n-api.service[115590]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:32:48.088444 n-d-master-1 devstack@n-api.service[115590]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:32:48.088444 n-d-master-1 devstack@n-api.service[115590]: *** Operational MODE: preforking *** Oct 19 00:32:48.088741 n-d-master-1 devstack@n-api.service[115590]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:32:48.088741 n-d-master-1 devstack@n-api.service[115590]: spawned uWSGI master process (pid: 115590) Oct 19 00:32:48.088955 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 00:32:48.090470 n-d-master-1 devstack@n-api.service[115590]: spawned uWSGI worker 1 (pid: 115591, cores: 1) Oct 19 00:32:48.090470 n-d-master-1 devstack@n-api.service[115590]: spawned uWSGI worker 2 (pid: 115592, cores: 1) Oct 19 00:32:48.090470 n-d-master-1 devstack@n-api.service[115590]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:32:48.767039 n-d-master-1 devstack@n-api.service[115592]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:32:48.770784 n-d-master-1 devstack@n-api.service[115591]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:32:49.862096 n-d-master-1 devstack@n-api.service[115592]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:32:49.862096 n-d-master-1 devstack@n-api.service[115592]: from cryptography.utils import int_from_bytes Oct 19 00:32:49.862737 n-d-master-1 devstack@n-api.service[115592]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:32:49.862737 n-d-master-1 devstack@n-api.service[115592]: from cryptography.utils import int_from_bytes Oct 19 00:32:49.863098 n-d-master-1 devstack@n-api.service[115591]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:32:49.863098 n-d-master-1 devstack@n-api.service[115591]: from cryptography.utils import int_from_bytes Oct 19 00:32:49.863528 n-d-master-1 devstack@n-api.service[115591]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:32:49.863528 n-d-master-1 devstack@n-api.service[115591]: from cryptography.utils import int_from_bytes Oct 19 00:32:52.422062 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:32:52.422726 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:32:52.422870 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:32:52.422962 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:32:52.423321 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:32:52.423406 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:32:52.423496 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:32:52.423683 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:32:52.423779 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.424040 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:32:52.424148 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.424299 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:32:52.424421 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.424726 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.424824 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425053 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425196 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425367 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425465 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425680 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425785 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.425999 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426144 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426304 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426397 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426559 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426681 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426864 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.426962 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427182 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427336 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427535 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427626 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427840 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.427922 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428174 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428288 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428482 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428573 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428819 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.428951 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429132 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429336 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429455 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429551 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429763 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.429949 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.430111 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.430391 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.430519 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.430694 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.430922 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431036 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431211 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431339 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431522 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431727 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431818 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.431930 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432148 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432341 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432463 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432706 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432795 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.432883 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433101 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433217 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433403 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433531 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433726 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.433849 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434034 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434158 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434433 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434552 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434750 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.434852 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435062 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435164 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435378 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435495 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435748 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.435853 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436066 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436165 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436370 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436464 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436709 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.436816 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437025 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437112 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437340 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437449 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437654 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437755 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.437952 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438049 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438260 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438379 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438562 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438664 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.438887 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439021 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439170 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439258 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439473 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439566 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439720 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.439815 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440027 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440158 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440341 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440446 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440635 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440798 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.440940 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441095 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441261 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441384 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441476 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441560 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441766 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.441900 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442078 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442179 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442353 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442490 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442660 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.442797 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443018 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443176 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443334 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443558 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443756 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.443942 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444057 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444141 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444307 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444455 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444608 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444804 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.444952 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445117 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445265 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445427 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445575 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445741 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.445920 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446063 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446182 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446379 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446563 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446704 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.446795 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447011 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447149 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447333 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447492 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447737 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447832 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.447989 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.448078 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.448296 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.448401 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.448692 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.448832 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449046 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449196 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449353 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449463 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449654 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449751 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.449970 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450071 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450304 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450440 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450602 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450690 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450848 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.450945 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451144 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451231 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451454 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451558 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451758 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.451869 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452060 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452151 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452363 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452469 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452676 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452821 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.452981 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453124 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453265 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453422 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453582 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453682 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453853 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.453941 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454152 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454239 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454454 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454548 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454749 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.454836 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455048 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455133 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455343 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455430 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455647 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455766 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.455939 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456026 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456240 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456334 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456547 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456789 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456892 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.456991 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.457201 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.457351 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.457625 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.457769 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.457911 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.458095 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.458234 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.458372 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459053 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459222 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459381 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459480 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459559 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459709 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.459799 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.460038 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.460222 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.460373 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.460566 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.460808 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461011 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461011 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461366 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461366 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461643 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461643 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.461912 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462053 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462211 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462362 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462450 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462532 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462612 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462698 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.462788 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463004 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463100 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463305 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463477 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463621 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463720 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.463882 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464020 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464178 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464317 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464482 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464686 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464824 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.464972 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465128 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465224 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465408 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465551 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465713 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.465803 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466013 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466147 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466311 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466457 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466625 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466778 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.466943 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.467075 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.467255 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.467402 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.467560 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.467705 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.467855 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.467989 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.468168 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:32:52.468302 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.468510 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.468674 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.468846 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.468984 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469156 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469248 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469468 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469557 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469782 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.469872 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470088 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470230 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470394 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470531 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470698 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.470846 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471012 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471157 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471325 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471458 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471648 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471792 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.471949 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472103 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472256 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472383 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472565 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472688 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472896 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.472986 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473219 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473356 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473567 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473671 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473831 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.473979 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.474957 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475295 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475295 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475521 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475618 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475751 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.475751 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476009 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476162 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476327 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476460 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476559 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476672 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476775 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.476912 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477050 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477167 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477367 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477508 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477696 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.477804 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478021 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478111 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478338 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478439 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478650 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478755 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.478962 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479052 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479313 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479449 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479625 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479837 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.479932 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480026 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480228 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480330 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480537 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480657 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480889 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.480978 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481206 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481296 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481521 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481612 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481833 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.481928 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482142 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482229 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482458 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482628 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482770 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.482920 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483056 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483160 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483358 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483447 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483661 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483748 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.483962 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484057 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484265 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484354 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484572 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484706 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.484906 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485073 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485210 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485301 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485545 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485728 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.485890 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486054 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486226 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486364 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486500 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486638 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486777 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.486953 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487088 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487228 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487364 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487500 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487656 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487802 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.487948 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488091 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488227 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488362 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488506 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488663 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488800 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.488890 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489106 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489216 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489408 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489508 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489803 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.489927 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490055 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490141 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490341 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490456 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490804 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.490973 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491118 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491275 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491381 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491467 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491548 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491671 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491839 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.491979 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492159 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492288 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492467 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492610 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492797 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.492932 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493130 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493247 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493464 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493600 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493765 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.493905 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494089 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494189 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494404 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494493 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494718 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.494817 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495021 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495175 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495326 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495418 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495626 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495723 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.495924 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496014 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496232 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496345 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496528 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496639 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496851 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.496954 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497151 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497261 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497450 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497549 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497753 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.497899 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498041 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498197 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498362 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498510 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498637 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498729 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.498934 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499033 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499233 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499323 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499530 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499629 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.499861 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500042 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500134 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500224 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500448 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500545 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500776 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.500888 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501080 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501173 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501382 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501482 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501719 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.501823 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502019 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502108 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502322 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502410 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502630 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502764 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.502931 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503021 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503234 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503322 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503547 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503696 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503852 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.503993 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504162 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504254 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504469 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504638 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504811 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.504900 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505114 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505261 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505473 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505567 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505778 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.505878 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506087 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506177 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506400 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506505 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506719 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.506809 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507030 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507130 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507350 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507448 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507658 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507748 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.507975 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508149 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508295 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508418 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508598 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508709 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.508925 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.509031 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.509233 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.509331 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.509546 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510458 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510555 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510651 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510751 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510833 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.510924 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511007 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511103 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511187 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511267 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511355 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511436 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511515 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511632 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511777 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.511940 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512031 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512246 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512333 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512570 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512675 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512899 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.512985 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513206 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513306 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513524 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513618 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513831 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.513929 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514137 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514236 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514442 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514520 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514755 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.514888 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515051 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515178 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515363 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515501 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515672 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515763 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.515979 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516091 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516281 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516371 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516582 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516752 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.516913 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517017 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517214 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517301 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517512 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517601 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517811 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.517901 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518114 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518203 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518417 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518493 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518724 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.518813 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519032 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519133 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519337 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519426 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519638 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519737 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.519938 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520065 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520253 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520353 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520595 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520746 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.520884 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.521593 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.521865 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522018 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522168 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522302 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522444 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522579 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522723 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.522868 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523006 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523151 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523290 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523410 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523538 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.523859 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524031 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524175 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524322 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524460 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524664 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524780 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.524976 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525099 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525293 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525411 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525618 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525783 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.525945 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526096 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526259 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526357 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526580 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526715 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526887 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.526976 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527198 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527288 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527504 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527594 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527818 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.527955 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528122 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528256 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528449 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528563 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528758 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.528880 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529072 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529207 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529386 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529662 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529806 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.529996 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530132 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530311 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530441 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530600 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530724 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.530914 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531025 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531230 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531352 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531549 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531649 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.531914 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532129 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532278 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532466 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532610 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532818 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.532966 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533124 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533262 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533414 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533585 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533740 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.533888 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534028 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534166 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534306 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534459 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534600 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534749 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.534893 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.535035 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.535178 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.535327 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.535477 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.535613 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.536018 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.536193 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.536333 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.536493 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.537295 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.537443 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.537574 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.537720 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.537882 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538039 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538185 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538328 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538474 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538616 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538775 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.538927 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539075 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539219 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539357 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539487 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539637 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539773 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.539928 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540064 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540205 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540336 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540490 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540685 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.540880 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541027 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541228 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541407 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541560 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541698 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541838 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.541977 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542170 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542334 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542478 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542620 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542762 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.542903 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543044 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543205 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543361 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543513 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543723 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.543881 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544039 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544180 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544322 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544466 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544644 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544811 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.544968 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545118 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545259 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545401 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545539 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545682 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.545837 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546006 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546213 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546363 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546514 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546659 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.546817 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547052 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547201 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547357 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547515 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547669 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547829 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.547973 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548115 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548256 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548403 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548561 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548763 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.548763 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549043 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549188 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549344 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549497 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549644 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549785 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.549930 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550072 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550216 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550368 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550510 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550651 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.550805 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551005 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551156 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551379 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551532 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551702 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551848 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.551991 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552146 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552346 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552491 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552671 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552817 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.552963 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553121 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553267 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553412 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553556 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553680 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553680 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553831 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553831 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.553989 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554069 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554148 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554236 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554333 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554416 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554496 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554678 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554795 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.554982 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555129 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555286 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555458 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555585 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555797 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.555955 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556145 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556300 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556455 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556549 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556778 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.556884 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557097 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557207 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557399 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557501 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557701 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.557809 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558002 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558217 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558304 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558384 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558600 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558687 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.558903 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559010 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559207 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559325 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559512 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559605 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559817 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.559904 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560141 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560229 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560446 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560558 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560807 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.560894 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561069 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561151 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561366 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561455 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561676 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561764 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.561980 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562077 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562287 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562424 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562590 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562689 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.562883 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563027 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563197 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563289 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563517 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563649 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563806 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.563908 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564122 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564210 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564424 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564511 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564771 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.564890 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565065 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565157 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565372 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565472 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565673 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565761 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.565999 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566111 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566288 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566447 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566586 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566677 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566889 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.566978 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.567196 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.567324 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.567506 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.567644 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.567810 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568252 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568252 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568493 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568493 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568880 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.568880 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569202 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569324 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569436 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569436 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569584 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569651 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569715 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.569963 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570068 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570261 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570350 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570566 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570683 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570865 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.570969 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571173 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571308 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571475 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571610 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571782 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.571895 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572090 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572183 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572471 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572593 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572732 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.572807 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573042 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573131 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573349 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573440 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573659 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573750 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.573966 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.574063 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.574264 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.574355 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.574567 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.574657 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575021 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575125 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575271 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575374 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575576 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575667 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575878 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.575966 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576177 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576276 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576488 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576752 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576852 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.576935 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577114 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577240 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577415 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577504 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577714 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.577830 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578036 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578146 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578331 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578420 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578646 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.578741 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579024 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579122 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579328 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579415 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579636 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579733 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.579959 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580053 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580265 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580353 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580570 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580730 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580900 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.580990 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581227 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581391 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581527 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581672 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581844 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.581932 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582153 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582262 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582456 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582546 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582777 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.582879 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.583092 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.583243 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.583403 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584090 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584309 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584459 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584654 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584796 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.584955 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585105 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585291 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585450 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585588 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585664 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585823 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.585952 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586233 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586373 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586554 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586747 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586843 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.586926 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587166 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587266 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587477 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587572 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587776 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.587863 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588078 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588174 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588386 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588475 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588711 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.588847 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589009 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589155 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589329 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589465 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589627 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589762 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.589933 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590070 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590238 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590392 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590543 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590720 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.590845 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591026 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591143 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591331 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591460 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591641 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591759 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.591945 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592073 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592249 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592382 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592575 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592724 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.592919 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593112 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593268 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593419 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593583 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593727 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593823 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.593993 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594114 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594202 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594402 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594501 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594726 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.594825 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595031 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595124 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595352 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595443 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595674 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595763 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.595997 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596096 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596321 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596411 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596652 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596742 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.596977 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597091 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597286 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597383 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597591 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597680 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597895 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.597992 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598196 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598283 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598514 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598611 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598815 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.598919 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.599175 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.599269 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.599542 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.599701 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.599864 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600031 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600182 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600329 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600489 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600675 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.600936 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601090 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601237 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601391 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601554 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601648 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601728 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.601986 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602092 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602221 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602367 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602512 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602668 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602842 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.602985 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603115 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603257 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603400 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603543 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603689 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603820 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.603950 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604081 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604225 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604359 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604524 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604681 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604811 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.604942 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605094 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605227 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605358 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605510 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605658 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605818 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.605977 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606126 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606275 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606426 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606574 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606735 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.606892 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607040 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607187 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607336 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607495 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607664 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607809 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.607962 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608109 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608257 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608404 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608574 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608747 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.608909 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609056 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609203 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609357 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609526 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609669 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609828 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.609976 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610123 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610286 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610435 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610584 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610730 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.610878 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611023 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611184 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611330 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611480 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611630 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611779 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.611956 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.612145 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.612304 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.612450 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.612610 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.612866 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613034 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613185 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613335 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613482 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613631 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613779 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.613940 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.614091 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.614241 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.614341 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.614424 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.614558 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.615226 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.615414 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.615632 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.615787 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616040 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616207 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616356 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616503 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616702 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.616854 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617000 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617153 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617333 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617483 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617645 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617795 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.617942 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618107 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618254 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618399 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618546 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618694 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.618865 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619014 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619184 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619333 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619481 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619630 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619789 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.619938 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620084 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620233 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620378 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620536 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620733 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.620882 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621033 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621181 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621332 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621502 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621652 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621798 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.621959 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622120 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622267 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622428 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622588 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622736 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.622947 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623111 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623273 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623428 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623589 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623736 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.623880 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624058 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624222 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624371 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624521 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624687 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624765 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.624850 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625056 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625210 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625360 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625511 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625678 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.625839 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626001 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626150 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626299 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626444 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626586 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626737 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.626879 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627025 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627287 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627443 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627593 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627752 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.627900 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628054 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628198 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628347 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628496 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628792 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.628943 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629108 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629257 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629404 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629552 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629809 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.629964 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.630110 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.630267 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.630960 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.631128 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.631288 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.631446 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.631683 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.631960 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632108 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632271 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632418 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632582 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632784 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632879 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.632949 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633048 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633199 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633405 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633557 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633704 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.633852 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634014 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634163 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634311 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634471 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634631 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634791 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.634938 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635095 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635253 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635410 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635560 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635719 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.635866 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636024 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636171 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636321 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636483 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636667 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636814 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.636814 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637084 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637230 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637379 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637546 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637707 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.637865 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638013 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638013 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638316 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638476 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638624 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638771 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.638920 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639067 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639227 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639376 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639522 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639667 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639815 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.639962 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640127 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640273 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640378 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640464 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640533 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640599 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640706 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640817 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.640968 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.641113 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.641260 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.641469 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.641623 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.641769 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642009 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642182 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642382 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642544 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642690 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642839 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.642987 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643196 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643354 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643513 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643660 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643812 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.643963 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644111 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644277 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644440 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644589 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644836 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.644981 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645122 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645281 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645426 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645426 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645709 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.645864 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.646486 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.646666 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.646816 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.646967 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647117 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647277 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647277 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647627 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647775 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.647920 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648067 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648216 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648383 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648546 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648723 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.648872 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649020 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649169 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649338 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649485 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649640 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649786 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.649926 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650072 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650231 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650380 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650524 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650670 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650825 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.650982 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651130 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651287 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651434 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651580 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651726 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.651896 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652046 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652192 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652337 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652483 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652670 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652839 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.652988 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653137 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653268 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653426 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653656 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653807 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653807 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.653807 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654216 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654377 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654538 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654701 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654849 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.654997 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655143 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655290 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655448 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655599 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655746 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.655889 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656047 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656195 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656354 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656501 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656684 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656834 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.656980 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657161 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657312 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657312 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657312 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657672 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657819 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.657978 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658125 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658273 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658421 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658567 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658721 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.658981 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659130 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659262 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659420 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659568 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659730 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.659881 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660027 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660174 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660322 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660479 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660663 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660813 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.660959 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.661106 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.661253 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.661400 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.661565 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.662245 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.662396 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.662543 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.662748 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.662748 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663053 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663205 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663411 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663561 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663789 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.663957 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.664107 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.664256 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.664403 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.664552 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.664902 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665124 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665273 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665418 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665561 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665707 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.665856 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666019 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666257 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666422 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666572 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666722 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.666882 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667065 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667215 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667397 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667547 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667728 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.667919 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668111 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668261 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668419 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668566 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668738 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.668914 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669061 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669213 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669361 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669510 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669659 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669827 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.669974 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670125 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670275 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670431 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670431 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670714 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.670861 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671009 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671009 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671290 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671452 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671600 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671761 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.671907 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.672055 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.672269 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.672450 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.672611 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.672910 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673078 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673230 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673379 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673540 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673704 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.673932 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674081 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674229 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674393 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674541 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674688 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.674837 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675068 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675220 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675383 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675533 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675689 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.675842 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676001 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676148 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676312 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676450 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676592 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676760 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.676906 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677079 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677279 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677428 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677579 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677730 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.677876 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678040 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678189 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678338 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678497 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678642 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678790 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678952 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.678952 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679229 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679379 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679538 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679538 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679834 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.679978 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680122 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680270 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680419 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680579 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680750 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.680897 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681045 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681193 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681343 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681517 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681667 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681812 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.681962 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682123 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682285 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682437 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682577 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115592) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:32:52.682722 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682722 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682722 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682722 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.682722 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.683364 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.683364 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.683717 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.683869 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.684084 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.684403 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.684741 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.685054 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:32:52.685299 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115591) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:32:52.837331 n-d-master-1 devstack@n-api.service[115592]: INFO dbcounter [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Registered counter for database nova_api Oct 19 00:32:52.842571 n-d-master-1 devstack@n-api.service[115591]: INFO dbcounter [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Registered counter for database nova_api Oct 19 00:32:52.859363 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_db.sqlalchemy.engines [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.863311 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_db.sqlalchemy.engines [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.866717 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writer thread running {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:52.870569 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writer thread running {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:52.926271 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.context [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=115592) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:32:52.930520 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:32:52.930996 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:32:52.932219 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.context [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=115591) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:32:52.932596 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:32:52.933365 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:32:52.933805 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:32:52.935773 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_concurrency.lockutils [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115592) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:32:52.936112 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:32:52.936585 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:32:52.937809 n-d-master-1 devstack@n-api.service[115592]: INFO dbcounter [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Registered counter for database nova_cell0 Oct 19 00:32:52.938169 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:32:52.938899 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:32:52.939340 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:32:52.941337 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:32:52.941983 n-d-master-1 devstack@n-api.service[115592]: INFO dbcounter [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Registered counter for database nova_cell1 Oct 19 00:32:52.943911 n-d-master-1 devstack@n-api.service[115591]: INFO dbcounter [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Registered counter for database nova_cell0 Oct 19 00:32:52.948071 n-d-master-1 devstack@n-api.service[115591]: INFO dbcounter [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Registered counter for database nova_cell1 Oct 19 00:32:52.951136 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_db.sqlalchemy.engines [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.953288 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_db.sqlalchemy.engines [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.955898 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_db.sqlalchemy.engines [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.959445 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_db.sqlalchemy.engines [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:52.961538 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writer thread running {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:52.963027 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writer thread running {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:52.963930 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writer thread running {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:53.106661 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writer thread running {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:53.110556 n-d-master-1 devstack@n-api.service[115592]: INFO dbcounter [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Registered counter for database nova_cell0 Oct 19 00:32:53.117419 n-d-master-1 devstack@n-api.service[115591]: INFO dbcounter [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Registered counter for database nova_cell0 Oct 19 00:32:53.120358 n-d-master-1 devstack@n-api.service[115592]: DEBUG oslo_db.sqlalchemy.engines [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115592) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:53.125520 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writer thread running {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:53.126567 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_db.sqlalchemy.engines [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115591) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:32:53.131502 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writer thread running {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:32:53.472932 n-d-master-1 devstack@n-api.service[115591]: WARNING keystonemiddleware.auth_token [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:32:53.480276 n-d-master-1 devstack@n-api.service[115591]: WARNING keystonemiddleware.auth_token [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:32:53.482986 n-d-master-1 devstack@n-api.service[115592]: WARNING keystonemiddleware.auth_token [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:32:53.491149 n-d-master-1 devstack@n-api.service[115592]: WARNING keystonemiddleware.auth_token [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:32:53.822841 n-d-master-1 devstack@n-api.service[115591]: WARNING keystonemiddleware.auth_token [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:32:53.828838 n-d-master-1 devstack@n-api.service[115591]: WARNING keystonemiddleware.auth_token [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:32:53.834807 n-d-master-1 devstack@n-api.service[115591]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bcd40da9c0 pid: 115591 (default app) Oct 19 00:32:53.835204 n-d-master-1 devstack@n-api.service[115592]: WARNING keystonemiddleware.auth_token [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:32:53.837024 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:32:53.838245 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001871 Oct 19 00:32:53.838665 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Wed Oct 19 00:32:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:32:53.841614 n-d-master-1 devstack@n-api.service[115592]: WARNING keystonemiddleware.auth_token [None req-de5572db-1767-48dc-addd-e1d2b3eb810f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:32:53.847292 n-d-master-1 devstack@n-api.service[115592]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bcd40da9c0 pid: 115592 (default app) Oct 19 00:34:23.401506 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:23.402508 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 19 00:34:23.402897 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:23.420742 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_api:SELECT=3 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.422010 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_cell0:SELECT=3 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.423249 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_cell1:SELECT=3 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:23.424123 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:24.380578 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-63588dcd-9671-4b75-9c2a-57380ea10a5f admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:24.414300 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-63588dcd-9671-4b75-9c2a-57380ea10a5f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.003639 Oct 19 00:34:24.416654 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:34:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:27.125897 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:27.127587 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f85488d5-b36e-4015-b593-b110a5777b0e None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Oct 19 00:34:27.128316 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:27.639936 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-733baa73-eaf6-4abd-9881-dc1284c67dfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "disk": 1}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:27.689572 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-733baa73-eaf6-4abd-9881-dc1284c67dfb admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.554647 Oct 19 00:34:27.690137 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:27.705040 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_api:SELECT=3 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.707421 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_cell0:SELECT=3 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.708372 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_cell1:SELECT=3 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.709445 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:27.919049 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-a5efc865-ca89-40ca-8b8a-5ccfa86cd8f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:27.989573 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-a5efc865-ca89-40ca-8b8a-5ccfa86cd8f3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290353 Oct 19 00:34:27.990085 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Oct 19 00:34:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:30.747206 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-733baa73-eaf6-4abd-9881-dc1284c67dfb admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:30.748353 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-733baa73-eaf6-4abd-9881-dc1284c67dfb admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Oct 19 00:34:30.749109 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:31.773192 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-3ff2fd14-9349-49c6-98ed-86c20354e306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:31.854279 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-3ff2fd14-9349-49c6-98ed-86c20354e306 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.094744 Oct 19 00:34:31.855105 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:31.875669 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-d62578cf-a27e-4940-8f2c-d522a0a5059f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:31.923025 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-d62578cf-a27e-4940-8f2c-d522a0a5059f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052594 Oct 19 00:34:31.933478 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Oct 19 00:34:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:34.988256 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-3ff2fd14-9349-49c6-98ed-86c20354e306 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:34.989312 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-3ff2fd14-9349-49c6-98ed-86c20354e306 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 19 00:34:34.989713 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:35.462402 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-1139ce82-38b2-4c30-a03a-c52ea56c027a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:35.490068 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-1139ce82-38b2-4c30-a03a-c52ea56c027a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493792 Oct 19 00:34:35.490816 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:35.504092 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-5fca7e0c-9597-49e0-82dc-a052f5a1c1d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:35.535487 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-5fca7e0c-9597-49e0-82dc-a052f5a1c1d7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036101 Oct 19 00:34:35.539869 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Oct 19 00:34:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:38.229363 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-1139ce82-38b2-4c30-a03a-c52ea56c027a admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:38.231115 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-1139ce82-38b2-4c30-a03a-c52ea56c027a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Oct 19 00:34:38.231533 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:38.744775 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-2583b559-d623-49a3-a583-1b87df7d0a30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:38.769008 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-2583b559-d623-49a3-a583-1b87df7d0a30 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529367 Oct 19 00:34:38.769747 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:38.783655 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-ef6a851c-8fd1-4c4d-beca-07433b8d9765 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:38.817987 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-ef6a851c-8fd1-4c4d-beca-07433b8d9765 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039488 Oct 19 00:34:38.818650 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Oct 19 00:34:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:41.645335 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-2583b559-d623-49a3-a583-1b87df7d0a30 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:41.646986 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-2583b559-d623-49a3-a583-1b87df7d0a30 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Oct 19 00:34:41.658511 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:41 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:42.186480 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:42.213664 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.559663 Oct 19 00:34:42.214550 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:42.227146 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-bc528275-e8ca-438f-86cd-71cfa66ea20c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:42.257426 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-bc528275-e8ca-438f-86cd-71cfa66ea20c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033917 Oct 19 00:34:42.272920 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Wed Oct 19 00:34:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:44.995511 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:44.996441 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 19 00:34:44.996896 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:45.443622 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f4395102-5f15-4ee8-af5c-bfafdfc07e72 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:45.468764 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f4395102-5f15-4ee8-af5c-bfafdfc07e72 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.464893 Oct 19 00:34:45.469541 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:34:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:34:48.795752 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:48.797382 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-e2407b6b-0601-4fb9-adf7-4d65b667f0bf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Oct 19 00:34:48.797719 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:49.262666 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-aab473fe-4302-4586-a281-2520dc61c550 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:49.289749 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-aab473fe-4302-4586-a281-2520dc61c550 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485373 Oct 19 00:34:49.290560 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:49.305460 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-a7d57069-6ff7-455a-9b3a-f3fff5cd11df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:49.334199 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-a7d57069-6ff7-455a-9b3a-f3fff5cd11df admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032487 Oct 19 00:34:49.334774 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Oct 19 00:34:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:52.001590 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-aab473fe-4302-4586-a281-2520dc61c550 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:52.002606 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-aab473fe-4302-4586-a281-2520dc61c550 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 19 00:34:52.003011 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:52.453867 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-db1a89cd-4856-476f-a6ed-345d2b9d1418 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:52.473733 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-db1a89cd-4856-476f-a6ed-345d2b9d1418 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463681 Oct 19 00:34:52.474290 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:52.487557 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-1044c21d-b53b-4fdb-8a53-d391e97d4cd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:52.514073 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-1044c21d-b53b-4fdb-8a53-d391e97d4cd6 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030791 Oct 19 00:34:52.514708 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Oct 19 00:34:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:55.147005 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-db1a89cd-4856-476f-a6ed-345d2b9d1418 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:55.148041 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-db1a89cd-4856-476f-a6ed-345d2b9d1418 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 19 00:34:55.148438 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:55.639377 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f2e54069-5330-488c-9a10-d31bd14dbdf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "vcpus": 2, "id": "3", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:55.662319 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f2e54069-5330-488c-9a10-d31bd14dbdf1 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.507462 Oct 19 00:34:55.662873 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:55.675562 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-bbac3410-9df1-46c8-b11d-b1564c1dc017 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:55.680998 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:55.715771 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-bbac3410-9df1-46c8-b11d-b1564c1dc017 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043223 Oct 19 00:34:55.717199 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Oct 19 00:34:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:34:58.395604 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-f2e54069-5330-488c-9a10-d31bd14dbdf1 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:34:58.397311 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-f2e54069-5330-488c-9a10-d31bd14dbdf1 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002145 Oct 19 00:34:58.397715 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:34:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:34:58.867161 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-4e2138b1-85ec-42fa-a4e7-f8a37d45635e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:58.890782 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-4e2138b1-85ec-42fa-a4e7-f8a37d45635e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.486429 Oct 19 00:34:58.891367 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:34:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:34:58.903711 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-2048d6f8-76f2-4e89-8384-c745e23e3d29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:34:58.908959 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:34:58.932272 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-2048d6f8-76f2-4e89-8384-c745e23e3d29 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032162 Oct 19 00:34:58.940800 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Oct 19 00:34:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:35:01.632746 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-4e2138b1-85ec-42fa-a4e7-f8a37d45635e admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:01.634434 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-4e2138b1-85ec-42fa-a4e7-f8a37d45635e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Oct 19 00:35:01.634843 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:02.113714 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge", "vcpus": 8}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:02.137911 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496127 Oct 19 00:35:02.138472 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Wed Oct 19 00:35:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:35:02.150915 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-77554096-a509-4c72-bf68-375b9e5cc801 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:02.182185 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-77554096-a509-4c72-bf68-375b9e5cc801 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034878 Oct 19 00:35:02.184769 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Wed Oct 19 00:35:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:35:22.314494 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:22.315497 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 19 00:35:22.315905 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:35:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:22.327134 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:22.742652 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-d6a81a53-b2a7-4562-b7d8-d85582e83a63 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:22.761400 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-d6a81a53-b2a7-4562-b7d8-d85582e83a63 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.439152 Oct 19 00:35:22.761970 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:35:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:24.119834 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:24.120894 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-8adc24f9-a3b7-49ec-8255-791a95217dff admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 19 00:35:24.121291 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:24.690058 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-5f6c0a40-3411-4aa7-9d71-2b46943ecd56 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:24.695289 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.wsgi [None req-5f6c0a40-3411-4aa7-9d71-2b46943ecd56 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-5f6c0a40-3411-4aa7-9d71-2b46943ecd56 admin admin] Request method failure captured: Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Accept: application/json Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Accept-Encoding: gzip, deflate Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Connection: keep-alive Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Content-Length: 0 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Host: 10.222.0.27 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: Openstack-System-Scope: None Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: User-Agent: python-novaclient Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Auth-Token: gAAAAABjT0ZMegUmbxuM3PQUYrevygBbZVwm1cDIx6BLHG_bKiA6LEJFB_vLw6WT29GUy_6EygKb9SKpT9ZOFG17GWkoSmhuBKSaFlhTGrKdB5oLKQnOODwSpcdYjCUEu5Ojz9yPQKb_ppTvs0q-wD8ScHhSvFM09-Kz694lJInah8Lkx4kXnsQ Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Id: None Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Name: None Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Identity-Status: Confirmed Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Is-Admin-Project: True Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Id: default Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Name: Default Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Project-Name: admin Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Role: member,admin,reader Oct 19 00:35:24.698508 n-d-master-1 devstack@n-api.service[115592]: X-Roles: member,admin,reader Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-Tenant: admin Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Name: admin Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-User: admin Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Id: default Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Name: Default Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: X-User-Name: admin Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: method: > Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: exception: Flavor 42 could not be found. Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: action_args: {'id': '42'} Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:24.700218 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:24.701358 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.702995 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-5f6c0a40-3411-4aa7-9d71-2b46943ecd56 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:24.704260 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-5f6c0a40-3411-4aa7-9d71-2b46943ecd56 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.430882 Oct 19 00:35:24.704260 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Oct 19 00:35:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 432 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:24.710140 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-8d99beed-e5e8-407b-917e-b3a29d158429 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:24.715195 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:35:24.735332 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-8d99beed-e5e8-407b-917e-b3a29d158429 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028926 Oct 19 00:35:24.735906 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:24.746710 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-0ef1e253-d229-4c6c-8e6f-e1a9a4a0eac7 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:24.770425 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-0ef1e253-d229-4c6c-8e6f-e1a9a4a0eac7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028250 Oct 19 00:35:24.771022 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:24.781417 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-48b0ffc8-2c98-4480-9b88-6215f968c0a4 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:24.787202 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.wsgi [None req-48b0ffc8-2c98-4480-9b88-6215f968c0a4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-48b0ffc8-2c98-4480-9b88-6215f968c0a4 admin admin] Request method failure captured: Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Accept: application/json Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Accept-Encoding: gzip, deflate Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Connection: keep-alive Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Content-Length: 0 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Host: 10.222.0.27 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: Openstack-System-Scope: None Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: User-Agent: python-novaclient Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Auth-Token: gAAAAABjT0ZMegUmbxuM3PQUYrevygBbZVwm1cDIx6BLHG_bKiA6LEJFB_vLw6WT29GUy_6EygKb9SKpT9ZOFG17GWkoSmhuBKSaFlhTGrKdB5oLKQnOODwSpcdYjCUEu5Ojz9yPQKb_ppTvs0q-wD8ScHhSvFM09-Kz694lJInah8Lkx4kXnsQ Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Id: None Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Name: None Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Identity-Status: Confirmed Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Is-Admin-Project: True Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Id: default Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Name: Default Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Project-Name: admin Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Role: member,admin,reader Oct 19 00:35:24.790575 n-d-master-1 devstack@n-api.service[115591]: X-Roles: member,admin,reader Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-Tenant: admin Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Name: admin Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-User: admin Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Id: default Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Name: Default Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: X-User-Name: admin Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: method: > Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: exception: Flavor 42 could not be found. Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: action_args: {'id': '42'} Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:24.792484 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:24.793603 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:24.794972 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-48b0ffc8-2c98-4480-9b88-6215f968c0a4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:24.796931 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-48b0ffc8-2c98-4480-9b88-6215f968c0a4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014735 Oct 19 00:35:24.796931 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Oct 19 00:35:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:26.041943 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-0ef1e253-d229-4c6c-8e6f-e1a9a4a0eac7 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:26.043377 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-0ef1e253-d229-4c6c-8e6f-e1a9a4a0eac7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001873 Oct 19 00:35:26.043928 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:26.591164 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-9ba4e4da-4cb9-463c-a65a-b21a9da9b6de admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:26.596546 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.wsgi [None req-9ba4e4da-4cb9-463c-a65a-b21a9da9b6de admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-9ba4e4da-4cb9-463c-a65a-b21a9da9b6de admin admin] Request method failure captured: Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Accept: application/json Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Accept-Encoding: gzip, deflate Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Connection: keep-alive Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Content-Length: 0 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Host: 10.222.0.27 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: Openstack-System-Scope: None Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: User-Agent: python-novaclient Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Auth-Token: gAAAAABjT0ZN32DwPp0DfLEpsN3JlMJyc1DYPcmo77oeayHnyj-fPLNYFGl-FWfUhsT5IgPQqr-iUptwazXT4nNBOeZ2FFHo0295AQ5QZeZdodrHobfLf2_MF1-WM2eaH5pQXrL9A4IsoptNNt8NdcyJt6guJCblWUHnAuPUbSfq_EfEwCkKXY4 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Id: None Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Name: None Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Identity-Status: Confirmed Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Is-Admin-Project: True Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Id: default Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Name: Default Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Project-Name: admin Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Role: member,admin,reader Oct 19 00:35:26.598127 n-d-master-1 devstack@n-api.service[115591]: X-Roles: member,admin,reader Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-Tenant: admin Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Name: admin Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-User: admin Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Id: default Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Name: Default Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: X-User-Name: admin Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: method: > Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: exception: Flavor 84 could not be found. Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: action_args: {'id': '84'} Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:26.599884 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:26.601310 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.602763 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-9ba4e4da-4cb9-463c-a65a-b21a9da9b6de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:26.604161 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-9ba4e4da-4cb9-463c-a65a-b21a9da9b6de admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.410655 Oct 19 00:35:26.604161 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Oct 19 00:35:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 19 00:35:26.609744 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-bc7f1bbb-4e8f-492e-9307-d800f88b5358 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:26.625351 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-bc7f1bbb-4e8f-492e-9307-d800f88b5358 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019361 Oct 19 00:35:26.625914 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:26.635678 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-a1274753-3684-4320-b661-9d94d9cf625e admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:26.652241 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-a1274753-3684-4320-b661-9d94d9cf625e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020153 Oct 19 00:35:26.652830 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:26.662603 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-f0e17e80-5e25-4384-8c97-3cc82f2ede56 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:26.667943 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.wsgi [None req-f0e17e80-5e25-4384-8c97-3cc82f2ede56 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-f0e17e80-5e25-4384-8c97-3cc82f2ede56 admin admin] Request method failure captured: Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Accept: application/json Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Accept-Encoding: gzip, deflate Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Connection: keep-alive Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Content-Length: 0 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Host: 10.222.0.27 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: Openstack-System-Scope: None Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: User-Agent: python-novaclient Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Auth-Token: gAAAAABjT0ZN32DwPp0DfLEpsN3JlMJyc1DYPcmo77oeayHnyj-fPLNYFGl-FWfUhsT5IgPQqr-iUptwazXT4nNBOeZ2FFHo0295AQ5QZeZdodrHobfLf2_MF1-WM2eaH5pQXrL9A4IsoptNNt8NdcyJt6guJCblWUHnAuPUbSfq_EfEwCkKXY4 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Id: None Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Name: None Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Identity-Status: Confirmed Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Is-Admin-Project: True Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Id: default Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Name: Default Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Project-Name: admin Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Role: member,admin,reader Oct 19 00:35:26.669478 n-d-master-1 devstack@n-api.service[115592]: X-Roles: member,admin,reader Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-Tenant: admin Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Name: admin Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-User: admin Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Id: default Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Name: Default Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: X-User-Name: admin Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: method: > Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: exception: Flavor 84 could not be found. Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: action_args: {'id': '84'} Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:26.671667 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:26.672661 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:26.674203 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-f0e17e80-5e25-4384-8c97-3cc82f2ede56 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:26.675543 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-f0e17e80-5e25-4384-8c97-3cc82f2ede56 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011851 Oct 19 00:35:26.675543 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Oct 19 00:35:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:27.953661 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-a1274753-3684-4320-b661-9d94d9cf625e admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:27.954705 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-a1274753-3684-4320-b661-9d94d9cf625e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 19 00:35:27.955131 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:28.506833 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-c7155cf9-06c8-45e5-8e03-10ea9dbe6173 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:28.512959 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.wsgi [None req-c7155cf9-06c8-45e5-8e03-10ea9dbe6173 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-c7155cf9-06c8-45e5-8e03-10ea9dbe6173 admin admin] Request method failure captured: Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Accept: application/json Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Accept-Encoding: gzip, deflate Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Connection: keep-alive Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Content-Length: 0 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Host: 10.222.0.27 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: Openstack-System-Scope: None Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: User-Agent: python-novaclient Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Auth-Token: gAAAAABjT0ZP762GBTQyDXG8kjJUT8kXx9A3RUmfKH9Ypk6_ZdaDRKunwWpOz6E34d24TUSyOKeASXQMB2WynxjWfyP3HsGmYxaTsGq6xRpt7ektRO4gLC0XehWi6CcBzoBuHOiSNPfqWBcobovkqSUfSJZh33Kckqrec_oddmadjoGUABLwfCk Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Id: None Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Domain-Name: None Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Identity-Status: Confirmed Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Is-Admin-Project: True Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Id: default Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Project-Domain-Name: Default Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Project-Name: admin Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Role: member,admin,reader Oct 19 00:35:28.515012 n-d-master-1 devstack@n-api.service[115592]: X-Roles: member,admin,reader Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-Tenant: admin Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-Tenant-Name: admin Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-User: admin Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Id: default Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-User-Domain-Name: Default Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: X-User-Name: admin Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: method: > Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: exception: Flavor 451 could not be found. Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: action_args: {'id': '451'} Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:28.516723 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:28.518845 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.520153 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-c7155cf9-06c8-45e5-8e03-10ea9dbe6173 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115592) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:28.521486 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-c7155cf9-06c8-45e5-8e03-10ea9dbe6173 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.415730 Oct 19 00:35:28.521486 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:35:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:28.526177 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-4b3a32eb-9efb-4d16-80b1-a1df6b5347bf admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:28.541824 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-4b3a32eb-9efb-4d16-80b1-a1df6b5347bf admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019105 Oct 19 00:35:28.542388 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:28.552258 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:28.567138 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018323 Oct 19 00:35:28.567687 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Wed Oct 19 00:35:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:35:28.577653 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-aafa066d-b3be-484e-8dab-62250e1b5341 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:28.582884 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.wsgi [None req-aafa066d-b3be-484e-8dab-62250e1b5341 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-aafa066d-b3be-484e-8dab-62250e1b5341 admin admin] Request method failure captured: Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Accept: application/json Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Accept-Encoding: gzip, deflate Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Connection: keep-alive Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Content-Length: 0 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Host: 10.222.0.27 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Openstack-Api-Version: compute 2.92 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: Openstack-System-Scope: None Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: User-Agent: python-novaclient Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Auth-Token: gAAAAABjT0ZP762GBTQyDXG8kjJUT8kXx9A3RUmfKH9Ypk6_ZdaDRKunwWpOz6E34d24TUSyOKeASXQMB2WynxjWfyP3HsGmYxaTsGq6xRpt7ektRO4gLC0XehWi6CcBzoBuHOiSNPfqWBcobovkqSUfSJZh33Kckqrec_oddmadjoGUABLwfCk Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Id: None Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Domain-Name: None Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Identity-Status: Confirmed Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Is-Admin-Project: True Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Openstack-Nova-Api-Version: 2.92 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Id: default Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Project-Domain-Name: Default Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Project-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Project-Name: admin Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Role: member,admin,reader Oct 19 00:35:28.584384 n-d-master-1 devstack@n-api.service[115591]: X-Roles: member,admin,reader Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac0b2bfbc95a4438a5a4c53c6936c9e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac0b2bfbc95a4438a5a4c53c6936c9e7"}]}] Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-Tenant: admin Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Id: ac0b2bfbc95a4438a5a4c53c6936c9e7 Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-Tenant-Name: admin Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-User: admin Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Id: default Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-User-Domain-Name: Default Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-User-Id: 0eea56facd274e79a70b3efac3a71b92 Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: X-User-Name: admin Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: method: > Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: exception: Flavor 451 could not be found. Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: action_args: {'id': '451'} Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:35:28.585991 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:28.587019 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: ERROR nova.api.openstack.wsgi Oct 19 00:35:28.588427 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-aafa066d-b3be-484e-8dab-62250e1b5341 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115591) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:35:28.589752 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-aafa066d-b3be-484e-8dab-62250e1b5341 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012216 Oct 19 00:35:28.589752 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:35:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:35:29.851386 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:29.852483 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 19 00:35:29.852983 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:30.405131 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-c530a2df-5f0f-4eef-8caa-44c07b26ead3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:30.426140 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-c530a2df-5f0f-4eef-8caa-44c07b26ead3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.435207 Oct 19 00:35:30.426693 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Oct 19 00:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:35:31.666118 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:31.667121 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 19 00:35:31.667515 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:32.203849 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-c7079ccc-ebbf-447b-a20a-a83c5d3f42b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:32.223419 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-c7079ccc-ebbf-447b-a20a-a83c5d3f42b4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.417657 Oct 19 00:35:32.223966 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Oct 19 00:35:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:35:33.482695 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:33.483878 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 19 00:35:33.484303 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:34.056933 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-2474816d-79b2-46ea-8b6f-a59e5634d6b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:34.075901 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-2474816d-79b2-46ea-8b6f-a59e5634d6b9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.447300 Oct 19 00:35:34.076458 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Oct 19 00:35:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:35:35.332965 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:35.333981 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 19 00:35:35.334411 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:35:35.866035 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-523bd426-fb92-43b7-b86f-f277ea8f707c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:35:35.887227 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-523bd426-fb92-43b7-b86f-f277ea8f707c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.417014 Oct 19 00:35:35.887693 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Wed Oct 19 00:35:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:35:37.159561 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:37.160607 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Oct 19 00:35:37.161034 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:35:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:35:37.750865 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-1f3f9278-7789-4845-bf49-4267d7f922f7 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:35:37.772868 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-1f3f9278-7789-4845-bf49-4267d7f922f7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.466672 Oct 19 00:35:37.773449 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Oct 19 00:35:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:36:36.410061 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.411056 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-65cb5fd8-c1fa-4537-8932-425abedb6eea admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 19 00:36:36.411459 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:36:36.422719 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:36.847461 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-80f8001a-f6dc-465e-858f-724b7257ad59 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.869227 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-80f8001a-f6dc-465e-858f-724b7257ad59 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.451393 Oct 19 00:36:36.869695 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:36:36.893373 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_api:SELECT=14 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:36:36.897397 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-7deaa73b-d8d5-4c2c-9b11-4aa1ae68182d admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.905626 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-7deaa73b-d8d5-4c2c-9b11-4aa1ae68182d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013666 Oct 19 00:36:36.906173 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:36:36.918531 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-733724fc-a747-4ad0-91a2-ebcb0824f77a admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.926501 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-733724fc-a747-4ad0-91a2-ebcb0824f77a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011629 Oct 19 00:36:36.927065 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:36:36.939749 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.947382 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011195 Oct 19 00:36:36.947927 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:36:36.961219 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-34c9c8d6-0ecf-4ff0-a5e0-ce4f7b9280c7 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:36:36.968973 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-34c9c8d6-0ecf-4ff0-a5e0-ce4f7b9280c7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011925 Oct 19 00:36:36.969516 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Wed Oct 19 00:36:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:41:59.524958 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:59.525984 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 19 00:41:59.526376 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:41:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:41:59.668964 n-d-master-1 devstack@n-api.service[115591]: DEBUG dbcounter [-] [115591] Writing DB stats nova_api:SELECT=6 {{(pid=115591) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:41:59.825977 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:41:59.832479 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.832973 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.833406 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.834119 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:41:59.834574 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:41:59.834992 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:41:59.875981 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-3ea1036b-630f-4e63-a960-b53ef313cd61 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.208176 Oct 19 00:41:59.876685 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:41:59 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:42:01.017611 n-d-master-1 devstack@n-api.service[115592]: DEBUG nova.api.openstack.wsgi [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] Calling method '>' {{(pid=115592) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:01.018625 n-d-master-1 devstack@n-api.service[115592]: INFO nova.api.openstack.requestlog [None req-056be0bb-177e-42c7-a597-9538916b4c62 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 19 00:42:01.019022 n-d-master-1 devstack@n-api.service[115592]: [pid: 115592|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Wed Oct 19 00:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:42:01.227018 n-d-master-1 devstack@n-api.service[115591]: DEBUG nova.api.openstack.wsgi [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Calling method '>' {{(pid=115591) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:42:01.230700 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:01.231184 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:01.231640 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:01.232334 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:01.232817 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:01.233234 n-d-master-1 devstack@n-api.service[115591]: DEBUG oslo_concurrency.lockutils [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115591) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:01.258329 n-d-master-1 devstack@n-api.service[115591]: INFO nova.api.openstack.requestlog [None req-10455d44-1c54-42fb-975a-745af348aa89 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.092487 Oct 19 00:42:01.258930 n-d-master-1 devstack@n-api.service[115591]: [pid: 115591|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:42:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:42:48.961968 n-d-master-1 devstack@n-api.service[115590]: Wed Oct 19 00:42:48 2022 - graceful shutdown triggered... Oct 19 00:42:48.962792 n-d-master-1 devstack@n-api.service[115592]: Gracefully killing worker 2 (pid: 115592)... Oct 19 00:42:48.962270 n-d-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 19 00:42:48.964889 n-d-master-1 devstack@n-api.service[115591]: Gracefully killing worker 1 (pid: 115591)... Oct 19 00:42:49.130164 n-d-master-1 devstack@n-api.service[115592]: DEBUG dbcounter [-] [115592] Writing DB stats nova_api:SELECT=4 {{(pid=115592) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:42:49.963022 n-d-master-1 devstack@n-api.service[115590]: worker 1 buried after 1 seconds Oct 19 00:42:49.963022 n-d-master-1 devstack@n-api.service[115590]: worker 2 buried after 1 seconds Oct 19 00:42:49.963022 n-d-master-1 devstack@n-api.service[115590]: goodbye to uWSGI. Oct 19 00:42:49.964950 n-d-master-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 19 00:42:49.965522 n-d-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 19 00:42:49.968591 n-d-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 19 00:42:49.989719 n-d-master-1 devstack@n-api.service[131437]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 19 00:42:49 2022] *** Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: nodename: n-d-master-1 Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: machine: x86_64 Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: clock source: unix Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: pcre jit disabled Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: detected number of CPU cores: 4 Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: current working directory: / Oct 19 00:42:49.992277 n-d-master-1 devstack@n-api.service[131437]: detected binary path: /usr/bin/uwsgi-core Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: your processes number limit is 47680 Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: your memory page size is 4096 bytes Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: detected max file descriptor number: 2048 Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: lock engine: pthread robust mutexes Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: thunder lock: enabled Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 19 00:42:49.993715 n-d-master-1 devstack@n-api.service[131437]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 19 00:42:50.043292 n-d-master-1 devstack@n-api.service[131437]: Python main interpreter initialized at 0x55ae7e6af9c0 Oct 19 00:42:50.043292 n-d-master-1 devstack@n-api.service[131437]: python threads support enabled Oct 19 00:42:50.043292 n-d-master-1 devstack@n-api.service[131437]: your server socket listen backlog is limited to 100 connections Oct 19 00:42:50.043292 n-d-master-1 devstack@n-api.service[131437]: your mercy for graceful operations on workers is 90 seconds Oct 19 00:42:50.043824 n-d-master-1 devstack@n-api.service[131437]: mapped 403077 bytes (393 KB) for 2 cores Oct 19 00:42:50.043824 n-d-master-1 devstack@n-api.service[131437]: *** Operational MODE: preforking *** Oct 19 00:42:50.044178 n-d-master-1 devstack@n-api.service[131437]: *** uWSGI is running in multiple interpreter mode *** Oct 19 00:42:50.044178 n-d-master-1 devstack@n-api.service[131437]: spawned uWSGI master process (pid: 131437) Oct 19 00:42:50.044464 n-d-master-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 19 00:42:50.045391 n-d-master-1 devstack@n-api.service[131437]: spawned uWSGI worker 1 (pid: 131449, cores: 1) Oct 19 00:42:50.045938 n-d-master-1 devstack@n-api.service[131437]: spawned uWSGI worker 2 (pid: 131450, cores: 1) Oct 19 00:42:50.046854 n-d-master-1 devstack@n-api.service[131437]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 19 00:42:50.769920 n-d-master-1 devstack@n-api.service[131449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:42:51.259274 n-d-master-1 devstack@n-api.service[131450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 19 00:42:52.161137 n-d-master-1 devstack@n-api.service[131449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:42:52.161137 n-d-master-1 devstack@n-api.service[131449]: from cryptography.utils import int_from_bytes Oct 19 00:42:52.161862 n-d-master-1 devstack@n-api.service[131449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:42:52.161862 n-d-master-1 devstack@n-api.service[131449]: from cryptography.utils import int_from_bytes Oct 19 00:42:52.382570 n-d-master-1 devstack@n-api.service[131450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:42:52.382570 n-d-master-1 devstack@n-api.service[131450]: from cryptography.utils import int_from_bytes Oct 19 00:42:52.383264 n-d-master-1 devstack@n-api.service[131450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 19 00:42:52.383264 n-d-master-1 devstack@n-api.service[131450]: from cryptography.utils import int_from_bytes Oct 19 00:42:54.847087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:42:54.848205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:42:54.848205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:42:54.848521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:42:54.848521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:42:54.848988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.849257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.849598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.849929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.850274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.850601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.850936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.851268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.851610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.851883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.852209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.852543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.852908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.853230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.853552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.853881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.854196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.854527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.854843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.855365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.855834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.856151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.856474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.856860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.857191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.857513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.857848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.858169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.859055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.859436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.860003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.860447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.860704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.861015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.861462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.861790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.862115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.862441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.862802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.863108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.863452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.863785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.864115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.864445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.864791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.865120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.865470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.865780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.866089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.866393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.866700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.866962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.867316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.867612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.867949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.868212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.868475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.868850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.869183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.869505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.869823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.870151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.870475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.870874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.871195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.871513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.871831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.872170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.872517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.872961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.873221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.873550 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.873970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.874314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.874608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.874943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.875281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.875598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.875928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.876261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.876580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.876933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.877248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.877585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.877941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.878258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.878508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.878797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.879119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.879518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.879785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.880056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.880433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.880935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.881156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.881529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.881766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.882025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.882340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.882655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.882989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.883380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.883593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.883895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.884237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.884567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.884917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.885236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.885558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.885878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.886219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.886539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.886857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.887194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.887514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.887833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.888166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.888888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.888888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.889361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.890963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.890963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.890963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.890963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.892312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.892312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.892312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.892312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.893523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.893523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.893523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.893998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.894122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.894407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.894679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.895037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.895328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.895635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:54.896311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.896521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.896725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.897133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.897483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.897970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.898233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.898472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.898805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.899145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.899470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.899853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.900097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.900434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.900800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.901166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.901461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.901789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.902121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.902445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.902776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.903120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.903455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.903778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.904133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.904492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.904849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.905185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.905775 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.906109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.906434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.906759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.907119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.907444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.907767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.908094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.908418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.908786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.909113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.909434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.909755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.910132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.910385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.910753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.911108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.911433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.911749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.912073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.912400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.912828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.913153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.913476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.913793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.914108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.914427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.914751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.915065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.915401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.915749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.916069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.916421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.916770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.917094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.917419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.917742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.918059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.918385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.918709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.919050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.919377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.919697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.920015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.920354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.920705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.921161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.921682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.922014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.922345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.922670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.922993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.923335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.923663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.923986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.924336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.924722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.925047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.925387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.925724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.926068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.926373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.926697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.927014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.927330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.927653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.927965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.928699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.928699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.929080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.929323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.929512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.929883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.930175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.930539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.930803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.931409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.931579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.931772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.932127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.932477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.932845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.933182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.933503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.933836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.934159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.934482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.934806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.935127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.935520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.935802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.936157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.937072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.937453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.937767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.938267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.938802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.939042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.939525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.939758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.940089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.940464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.940940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.941169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.941458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.941999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.942252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.942617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.942954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.943280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.943616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.943942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.944423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.944775 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.945004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.945256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.946557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.947019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.947387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.947738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.948076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.948435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.948794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.949124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.949457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.949790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.950100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.950428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.950767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.951092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.951420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.951739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.952077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.952691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.953086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.953493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.953828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.954178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.954505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.954842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.955176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.955496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.956064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.956406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.956762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.957082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.957398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.957712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.958075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.958400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.958716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.959046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.959562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.959728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.960052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.960355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.960708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.961058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.961382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.961782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.962037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.962501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.962835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.963257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.963689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.964026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.964353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.964819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.965149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.965477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.965811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.966423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.966775 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.967104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.967500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.968680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.969169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.969564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.969946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.970298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.970709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.971038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.971385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.971706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.972035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.972358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.972884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.973053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.973583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.973856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.974030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.974396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.974717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.975157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.975501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.975792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.976103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.976447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.977093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.977478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.977897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.978315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.978697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.979016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.979524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.979764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.980214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.980651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.980976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.981354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.981804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.982156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.982476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.982803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.983130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.983575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.984053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.984339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.984787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.985218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.985487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.985764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.986176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.986520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.986948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.987271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.987590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.987947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.988348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.988795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.989125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.989445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.989779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.990092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.990416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.990804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.991066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.991370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.991716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.992032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.992358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.992715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.993035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.993356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.993669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.993988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.994310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.994646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.995055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.995323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.995647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.995927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.996377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.996750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.997158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.997482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.997802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.998121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.998441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.998760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.999636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:54.999963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.000282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.000603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.000926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.001307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.001623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.002001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.002319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.002648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.002980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.003307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.003632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.003960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.004280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.004665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.004957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.005307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.005742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.006065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.006428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.006750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.007065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.007398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.007862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.008052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.008380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.008845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.009202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.009541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.009964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.010286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.010610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.010940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.011322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.011905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.012089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.012281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.012605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.012983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.013308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.013703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.014001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.014316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.014671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.015880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.016227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.016558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.017059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.017387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.017777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.018090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.018418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.018741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.019076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.019408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.019725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.020212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.020544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.020941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.021232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.021553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.021863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.022189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.022533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.022924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.023341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.023670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.024053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.024319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.024663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.025148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.025475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.025791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.026406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.026830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.027157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.027539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.027977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.028324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.028958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.029221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.029472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.029727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 19 00:42:55.031130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.031355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 19 00:42:55.031532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.031532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.031838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 19 00:42:55.031994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.031994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.032375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 19 00:42:55.032540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.032742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 19 00:42:55.032904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.032904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.033240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.033397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.033580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.033846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.034022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.034228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.034397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.034577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.034891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.035140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.035408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.035650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.035943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.036184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.036343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.036512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.036512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.036920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.037103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.037269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.037459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.037627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.037830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.037982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.038132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.038552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.038713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.038713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.039023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.039205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.039405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.040110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-master-1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.040267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.040413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.040549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.040549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.040877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.041027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.041027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.041361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.041535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.041710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.041874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.042020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.042178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.048853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.048853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.049364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.049530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.049530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.050466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.050632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.050632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.050970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.051160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.051160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.051466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.051633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.051633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.051955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.052124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.052302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.052472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.052472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.052472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.052472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.053056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.053202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.053202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.053495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.053662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.053829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.053994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.053994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.054291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.054456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.054623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.054799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.054799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.055111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.055264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.055264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.055562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.055716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.055716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.056023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-master-1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.056190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.056190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.056469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.056692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.056692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.057000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.057167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.057167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.057467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.057621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.057621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.057621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.058047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.058200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.058200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.058573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.058741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.058741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.059047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.060225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.060805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.060969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.060969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.061308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.061476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.061476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.062463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.062633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.062633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.062932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.063086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.063250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.063398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.063398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.063698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.063852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.064005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.064153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.064153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.064446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.064658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.064864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.065002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.065002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.065459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.065635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.065635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.065916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.066081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.066234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.066400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.066400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.066400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.066400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.066400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.067167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.067337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.067337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.067620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.067769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.067925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.068078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.068078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.068387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.068539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.068539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.068883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.069041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.069041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.069291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.069456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.069616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.069788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.070102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.070259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.070259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.070525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.070704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.070704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.071371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.071526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.071681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.071821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.071821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.072098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.072237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.072237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.072517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.072685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.072846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.072846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.073105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.073105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.073105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.073105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.073764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.073764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.074116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.074116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.074516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.074842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.075159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.075368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.075565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.075833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.076028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.076287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.076713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.076979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.077372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.077712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.078033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.078263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.078626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.078846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.079054 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.079299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.079514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.079749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.079970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.080177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.080383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.080579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.081157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.081757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.082349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.082571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.082829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.083045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.083234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.083423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.083640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.083985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.084219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.084498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.085089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.085317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.085532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.085532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.086217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.086425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.086642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.086835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.086835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.087212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.087416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.087416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.088093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.088757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.088757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.089143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.089376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.089376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.089775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.089977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.090183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.090450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.090450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.090821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.091224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.091224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.091846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.092084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.092540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.093394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.093394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.093848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.094081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.094688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.094896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.094896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.095613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.095905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.095905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.096353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.096755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.096980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.097593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.097593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.098077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.098418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.098418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.099159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.099417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.099417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.099870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.100150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.100407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.100715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.101010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.101248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.101248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.101705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.102680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.102680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.103186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.103429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.104959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.105607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.105607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.106175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.106412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.106412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.106874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.107128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.107386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.107697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.107697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.108509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.108938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.109194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.109656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.109656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.110171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.110407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.110407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.110874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.111129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.111129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.111129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.111819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.112100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.112490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.112758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.113197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.113440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.113673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.113925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.113925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.115202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.115471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.115833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.116067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.116067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.116516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.117173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.117173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.117716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.117980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.118248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.118435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.118435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.120404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.120859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.120859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.121335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.121335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.122483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.122483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.123029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.123380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.123380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.124639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.124839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.124839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.125157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.125446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.126603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.126603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.126900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.128396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.129944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.130913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.130913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.131322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.131774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.132202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.132660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.134659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.134659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.134659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.135480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.135480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.136003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.136247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.136677 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.136977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.138808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.139119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.139368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.139368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.139912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.140183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.140425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.140691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.140951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.141197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.141435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.141691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.141943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.142193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.142459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.142697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.143024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.143272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.143599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.144131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.144306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.144749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.145036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.145365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.145526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.145900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.146160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.146586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.146960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.147209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.147583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.147862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.148313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.148571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.148921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.149169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.149548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.149969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.150232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.150592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.150864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.151152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.151412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.151751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.152074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.152338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.152724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.152976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.153365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.153630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.153933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.154392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.154668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.155032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.155847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.156091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.156507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.156836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.157092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.157438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.157692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.157991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.158258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.158670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.158908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.159381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.159635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.159873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.160406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.160693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.160934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.161170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.161407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.161641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.162012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.162259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.162565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.162851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.163120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.163465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.163722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.164138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.164586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.164928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.165167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.165419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.165654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.165890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.166270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.166548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.167097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.167398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.167669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.168050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.168307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.168843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.169094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.169389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.169835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.170098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.170506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.170774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.171140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.171405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.171705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.172002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.172255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.172744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.173014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.173352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.173595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.173908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.174312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.174581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.175021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.175287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.175592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.175836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.176152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.176392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.176931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.177386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.177626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.177867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.178121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.178375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.178623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.179042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.179303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.179552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.179836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.180275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.180535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.180979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.181217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.181465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.181724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.181965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.182291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.182537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.182950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.183224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.183504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.183746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.184207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.184465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.184776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.185216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.185476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.185724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.185959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.186301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.187098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.187712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.187968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.188205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.188456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.188858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.189165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.189547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.189786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:42:55.190035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.190605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.191273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.191810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.192228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.192810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.193492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.193850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.194389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.194875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.195411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.195885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.196352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.196872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.197512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.198107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.198610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.199093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.199678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.200302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.200916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.201516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.202012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.202925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.203422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.203991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.204683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.205023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.205602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.206312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.206821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.207318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.207903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.208681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.209063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.209614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.210271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.210790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.211652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.212083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.212956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.213335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.213646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.214199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.214792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.215278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.215851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.216369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.217024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.217528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.218725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.219144 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.219635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.220177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.220691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.221169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.221820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.222256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.222749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.223372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.223764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.224241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.224743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.225313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.225947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.226305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.226780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.227243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.227773 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.228245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.228953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.229363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.229845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.230372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.230862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.231328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.232000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.232415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.232992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.233629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.234433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.234696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.235528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.235796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.236274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.236804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.237296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.237770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.238230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.238836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.239405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.240096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.240686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.241141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.241622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.242307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.242745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.243243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.243802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.244278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.244802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.245397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.245839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.246476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.246854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.247347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.247814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.248286 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.248794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.250019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.250397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.250917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.251383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.251882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.252569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.252990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.253485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.256671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.256671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.256671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.256671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.256671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.257983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.257983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.257983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.258721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.259677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.259996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.260271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.260890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.261815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.262366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.262895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.263454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.263922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.264377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.265102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.265569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.266129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.266561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.267051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.267487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.267905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.268331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.269569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.269569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.270193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.270462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.271005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.271567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.272074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.272542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.273052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.273515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.274043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.274508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.275041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.275604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.276155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.276774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.277328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.277823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.278290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.278925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.279308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.279788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.280315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.280969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.281510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.282041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.282583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.283060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.283526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.284006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.284532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.285024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.285493 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.286020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.286509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.287066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.287652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.288124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.288593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.289104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.289597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.290207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.290673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.291193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.291742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.292297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.292872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.293457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.294003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.294525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.295039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.295563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.296867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.297270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.298035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.298537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.299078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.299594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.300108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.300669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.301211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.301760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.302265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.302823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.303328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.303872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.304397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.304929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.305436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.305936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.306457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.306954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.307942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.308109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.309056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.309056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.309607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.310133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.310648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.311131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.311698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.312230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.312818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.313341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.314049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.314561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.315107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.315641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.316147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.316675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.317169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.317763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.318912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.319110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.319437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.319937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.320464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.320964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.321448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.321952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.322478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.322968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.323451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.323943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.324479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.325016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.325538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.326237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.326745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.328052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.328587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.329189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.329690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.330210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.330732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.331504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.332002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.332517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.333779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.333779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.334083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.334565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.335072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.335564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.336083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.336600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.337167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.337678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.338432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.338939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.339432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.339949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.340457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.340978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.341476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.342000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.342528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.343118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.343683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.344386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.344925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.345415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.345907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.346430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.347450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.347450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.348037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.348467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.349006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.349504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.350003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.350502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.351020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.351544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.352060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.352547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.353076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.354467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.354467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.354809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.355126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.355638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.356122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.356678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.357199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.357710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.358215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.359265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.359954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.361332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.361332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.361757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.363170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.363750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.364254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.365316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.365316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.366016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.366280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.366767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.367271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.367790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.368293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.368830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.369323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.369824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.370393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.370893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.371421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.371926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.372455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.373000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.373509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.374052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.374631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.375279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.375644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.376150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.376686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.377208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.377713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.378219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.379095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.379615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.380110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.380597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.381116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.381595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.382078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.382566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.383042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.383526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.384013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.384523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.385053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.385549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.386096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.386554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.387035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.387563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.388088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.388709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.389223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.390310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.391440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.391952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.392447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.393063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.393551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.394042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.394521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.395068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.395577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.396030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.401838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.403244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.404108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.404348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.404991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.405686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.406240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.406610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.407107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.407593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.408063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.408561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.409070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.409965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.410501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.410982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.411476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.411967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.412447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.412939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.413427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.413894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.414354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.414829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.415295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.415761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.416220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.416726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.417192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.417662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.418123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.418577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.419072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.419527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.419987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.420439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.421488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.422013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.422475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.422932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.423390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.423861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.424319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.424816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.425269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.425735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.426284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.426750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.427209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.427716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.428229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.428779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.429334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.429864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.430415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.430954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.431491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.432093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.432659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.433655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.434246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.434801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.435378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.435952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.436452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.437281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.437819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.438379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.438920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.439445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.439991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.440542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.441125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.441690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.442239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.442785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.443330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.443869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.444419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.445001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.445570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.446096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.446647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.447242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.447807 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.448364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.448959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.449495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.450036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.450583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.451128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.451662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.453080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.453833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.454381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.454918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.455673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.456479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.457082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.457640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.458192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.458757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.459317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.459856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.460407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.460973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.461545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.462137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.462696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.463254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.463778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.464304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.464848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.465382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.465917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.466445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.466968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.467503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.468163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.468765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.469306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.469839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.470378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.470925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.471470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.472012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.472552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.473116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.473644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.474175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.474720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.475257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.475793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.476329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.476905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.477438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.478033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.479297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.479297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.479731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.480290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.480888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.481433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.481925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.482426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.482946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.483972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.484490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.485202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.485734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.486263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.486789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.486963 n-d-master-1 devstack@n-api.service[131450]: INFO dbcounter [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Registered counter for database nova_api Oct 19 00:42:55.487315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.487850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.488419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.489139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.489682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.490264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.490809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.491342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.491855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.492401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.493011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.493537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.494085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.494640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.495208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.495755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.496279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.496888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.497425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.497978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.498531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.499315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.499862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.500392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.500974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.501528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.502117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.502648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.503241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.503789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.504313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.504861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.505369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 19 00:42:55.505769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 19 00:42:55.529661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_db.sqlalchemy.engines [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.542494 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writer thread running {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.575959 n-d-master-1 devstack@n-api.service[131449]: INFO dbcounter [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Registered counter for database nova_api Oct 19 00:42:55.599105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_db.sqlalchemy.engines [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.606878 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writer thread running {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.657439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.context [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131450) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:42:55.664783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.665535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.668213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.context [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131449) load_cells /opt/stack/nova/nova/context.py:464}} Oct 19 00:42:55.668933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.670462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.671259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.672646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.673131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.674849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.675169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.675629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:42:55.676102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:42:55.678288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:42:55.679012 n-d-master-1 devstack@n-api.service[131450]: INFO dbcounter [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Registered counter for database nova_cell0 Oct 19 00:42:55.680370 n-d-master-1 devstack@n-api.service[131449]: INFO dbcounter [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Registered counter for database nova_cell0 Oct 19 00:42:55.685134 n-d-master-1 devstack@n-api.service[131449]: INFO dbcounter [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Registered counter for database nova_cell1 Oct 19 00:42:55.687429 n-d-master-1 devstack@n-api.service[131450]: INFO dbcounter [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Registered counter for database nova_cell1 Oct 19 00:42:55.700885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_db.sqlalchemy.engines [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.705021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_db.sqlalchemy.engines [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.706621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_db.sqlalchemy.engines [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.709002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_db.sqlalchemy.engines [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.719094 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writer thread running {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.719998 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writer thread running {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.723050 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writer thread running {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.723443 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writer thread running {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.901141 n-d-master-1 devstack@n-api.service[131449]: INFO dbcounter [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Registered counter for database nova_cell0 Oct 19 00:42:55.909692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_db.sqlalchemy.engines [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.913894 n-d-master-1 devstack@n-api.service[131450]: INFO dbcounter [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Registered counter for database nova_cell0 Oct 19 00:42:55.916029 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writer thread running {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:55.923648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_db.sqlalchemy.engines [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 19 00:42:55.928704 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writer thread running {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 19 00:42:56.256202 n-d-master-1 devstack@n-api.service[131449]: WARNING keystonemiddleware.auth_token [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:42:56.263948 n-d-master-1 devstack@n-api.service[131449]: WARNING keystonemiddleware.auth_token [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:42:56.273672 n-d-master-1 devstack@n-api.service[131450]: WARNING keystonemiddleware.auth_token [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:42:56.281988 n-d-master-1 devstack@n-api.service[131450]: WARNING keystonemiddleware.auth_token [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:42:56.641772 n-d-master-1 devstack@n-api.service[131449]: WARNING keystonemiddleware.auth_token [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:42:56.649725 n-d-master-1 devstack@n-api.service[131449]: WARNING keystonemiddleware.auth_token [None req-d4061659-2a1a-49cc-9bf4-131e48ff91e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:42:56.656516 n-d-master-1 devstack@n-api.service[131449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae7e6af9c0 pid: 131449 (default app) Oct 19 00:42:56.659152 n-d-master-1 devstack@n-api.service[131450]: WARNING keystonemiddleware.auth_token [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 19 00:42:56.665851 n-d-master-1 devstack@n-api.service[131450]: WARNING keystonemiddleware.auth_token [None req-eca0c424-1dff-4319-baf6-e0605827b314 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 19 00:42:56.672023 n-d-master-1 devstack@n-api.service[131450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae7e6af9c0 pid: 131450 (default app) Oct 19 00:43:41.557204 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.558959 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.561119 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:41.562620 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.767185 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.774862 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.782364 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.784196 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:43.969973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '.version_select at 0x7f2af6c6cc10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:43.982526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131449) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 00:43:43.984176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:43.984972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:43.985562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.036299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.037395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.038145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.079264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.080070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.081221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:44.102404 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe58072f-caab-4fc0-9f6a-8c6f5c30fbde tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 2.571276 Oct 19 00:43:44.104307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 00:43:41 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 2577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:44.130804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79f8256f-310e-4ab9-87e5-3505f0fb5ee7 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1581072960", "name": "tempest-test_aggregate-815197369"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:44.218749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-79f8256f-310e-4ab9-87e5-3505f0fb5ee7 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid cf9f012d-8030-429a-a3de-25bfce8b3a5d for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:43:44.374724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79f8256f-310e-4ab9-87e5-3505f0fb5ee7 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.250899 Oct 19 00:43:44.375648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1165 bytes} [Wed Oct 19 00:43:44 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:44.388230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21a3ae22-10c8-43a2-af94-26989680119e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:44.413706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21a3ae22-10c8-43a2-af94-26989680119e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.030005 Oct 19 00:43:44.416740 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3/3] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:43:44 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:44.428351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0ac9b5d-ae00-4a1c-9512-2e68fc8e1b8f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:44.458957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ac9b5d-ae00-4a1c-9512-2e68fc8e1b8f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:44.459752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ac9b5d-ae00-4a1c-9512-2e68fc8e1b8f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:44.460201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ac9b5d-ae00-4a1c-9512-2e68fc8e1b8f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.648120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:45.653490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.653998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.654444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.655215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:45.655673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:45.656102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:45.719436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e8db529-f681-4146-a188-7940cedf8cd4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 1.990661 Oct 19 00:43:45.729677 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1/4] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:43:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:46.376066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e52fab73-6daa-436e-b977-d45b88f96319 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-451483923", "id": 382897461, "os-flavor-access:is_public": "False"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:46.487761 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e52fab73-6daa-436e-b977-d45b88f96319 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.623211 Oct 19 00:43:46.501722 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2/5] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:45 2022] POST /compute/v2.1/flavors => generated 427 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:46.588967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c0ac9b5d-ae00-4a1c-9512-2e68fc8e1b8f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 314 microversion: 2.1 time: 2.163708 Oct 19 00:43:46.591433 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 4/6] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:43:44 2022] POST /compute/v2.1/os-aggregates/1/action => generated 314 bytes in 2168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:46.628571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b68b5a74-3c4f-4001-a98f-0f9dcb833d07 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "55009aa838d444e1a971a90513161a2c"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:46.993196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af6ac8e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.009917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131450) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 19 00:43:47.010694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.011191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.011644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.080957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.083865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.084430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.118998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.119799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.120317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.136101 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee3b6197-06a9-4b03-a295-766585c01908 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.632814 Oct 19 00:43:47.137215 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:47.341266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.343397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.344120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.344751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.345723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.348378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b68b5a74-3c4f-4001-a98f-0f9dcb833d07 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/382897461/action" status: 200 len: 96 microversion: 2.1 time: 0.754539 Oct 19 00:43:47.349337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.349924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.355248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 5/8] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:43:46 2022] POST /compute/v2.1/flavors/382897461/action => generated 96 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:43:47.384415 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11395a68-c7ed-459f-b08b-d0fc67758e8b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.244990 Oct 19 00:43:47.385481 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 4/9] 10.222.0.27 () {58 vars in 1164 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:47.475611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Calling method '.version_select at 0x7f2af6aac4c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.482430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.485628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3ed59f2-3fcc-4c6f-818d-14f1eafe6b8c tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-344330621", "id": 20013008, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:47.494231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.494914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.533704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3ed59f2-3fcc-4c6f-818d-14f1eafe6b8c tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.146442 Oct 19 00:43:47.535711 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 5/10] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:47 2022] POST /compute/v2.1/flavors => generated 423 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:47.557317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.558010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.558690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.616740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.617685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.618358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.642063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f43d3ea3-3b78-49da-a2d3-ce6b91ab3ca4 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.290090 Oct 19 00:43:47.669231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 6/11] 10.222.0.27 () {60 vars in 1208 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:43:47.673646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1393612291", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "availability_zone": "tempest-test_az-1581072960"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:47.685149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af623adc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:47.699884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.701188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.702211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.748778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.749027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.749713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.750177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.750746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.751350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.751925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.752439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.754016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.808709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:47.809732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:47.810508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:47.838448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fde15ca0-b205-4cc9-a2d4-91ee484ac9af tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.160267 Oct 19 00:43:47.842674 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:48.160075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bacdd994-c6c5-4524-aa9f-d7b24948b9c5 tempest-FlavorsAccessTestJSON-1891713799 tempest-FlavorsAccessTestJSON-1891713799-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.203315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:43:48.274442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bacdd994-c6c5-4524-aa9f-d7b24948b9c5 tempest-FlavorsAccessTestJSON-1891713799 tempest-FlavorsAccessTestJSON-1891713799-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5821 microversion: 2.1 time: 0.414010 Oct 19 00:43:48.303107 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:47 2022] GET /compute/v2.1/flavors/detail => generated 5821 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:48.318996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.347562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.348482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.349349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.350767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.351621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.352411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.473570 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6572643c-85c1-4b2b-abd6-4b55e46d2e4b tempest-AZAdminV2TestJSON-96139799 tempest-AZAdminV2TestJSON-96139799-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.165567 Oct 19 00:43:48.476987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 9/14] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:43:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:48.492762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-380c5681-04c4-4b43-85f8-79b396915d83 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.654918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-380c5681-04c4-4b43-85f8-79b396915d83 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/20013008" status: 202 len: 0 microversion: 2.1 time: 0.175135 Oct 19 00:43:48.660534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 10/15] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:43:48 2022] DELETE /compute/v2.1/flavors/20013008 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:48.683227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af623ae50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:48.692379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.698635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.700671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.766486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.767845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.768887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.820067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:48.824102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:48.826208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:48.862092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e2723ef-8622-45ff-8311-134965ef37c6 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.197482 Oct 19 00:43:48.864076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 11/16] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:48.880546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7bb63449-b94a-4fda-abbe-3aebd27140cb tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "55009aa838d444e1a971a90513161a2c"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:49.214886 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7bb63449-b94a-4fda-abbe-3aebd27140cb tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/382897461/action" status: 200 len: 21 microversion: 2.1 time: 0.348112 Oct 19 00:43:49.228608 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 12/17] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:43:48 2022] POST /compute/v2.1/flavors/382897461/action => generated 21 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:43:49.248201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb8ab3ad-38cb-4571-a207-557d28e98858 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.256773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:43:49.258907 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:43:49.260345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:43:49.263121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:43:49.264497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:43:49.294186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.295733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.297032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.298928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.301346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.302431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.319968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb8ab3ad-38cb-4571-a207-557d28e98858 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083651 Oct 19 00:43:49.321233 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 13/18] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:49.331712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af61ec790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.335691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.336915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.337771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.380827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.385175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.386149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.399588 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5cf02e14-d5e0-43e6-aac2-9f6c98fbb135 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.076052 Oct 19 00:43:49.400982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 14/19] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:49.410753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd0d6c81-281b-4ce8-9403-b0f562ae714d tempest-FlavorsAccessTestJSON-1891713799 tempest-FlavorsAccessTestJSON-1891713799-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.415633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Getting quotas for project c64d39f0a00b4dab9da6f0ffd2832210. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:43:49.433687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Getting quotas for user be64be1ba172441eb0ee9a03fabb0bda and project c64d39f0a00b4dab9da6f0ffd2832210. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:43:49.462575 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd0d6c81-281b-4ce8-9403-b0f562ae714d tempest-FlavorsAccessTestJSON-1891713799 tempest-FlavorsAccessTestJSON-1891713799-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058828 Oct 19 00:43:49.464066 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 15/20] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:49.473213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fed3c203-3b15-44bc-934a-ffc03c6b3de7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1446117838", "id": 677389468, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:49.491433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:43:49.501838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:43:49.518266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fed3c203-3b15-44bc-934a-ffc03c6b3de7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.048270 Oct 19 00:43:49.525201 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 16/21] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:49 2022] POST /compute/v2.1/flavors => generated 414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:49.538681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc7a0c34-2442-4c2d-bfe7-8d6f59ec78de tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af61ec8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.548352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7a0c34-2442-4c2d-bfe7-8d6f59ec78de tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.549353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7a0c34-2442-4c2d-bfe7-8d6f59ec78de tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.550093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7a0c34-2442-4c2d-bfe7-8d6f59ec78de tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.623523 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc7a0c34-2442-4c2d-bfe7-8d6f59ec78de tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.094683 Oct 19 00:43:49.624843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 17/22] 10.222.0.27 () {58 vars in 1179 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:49.649745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b97059f1-4add-4354-a9dc-8d4b5c0adf36 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.712245 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-072ea53a-f332-40fb-9b09-292337f02794 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.173160 Oct 19 00:43:49.716015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 6/23] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:43:49.733792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49910acd-2ea9-48a0-8b14-fac409ce4f8b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.738575 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b97059f1-4add-4354-a9dc-8d4b5c0adf36 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/382897461" status: 202 len: 0 microversion: 2.1 time: 0.096367 Oct 19 00:43:49.745535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 18/24] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:43:49 2022] DELETE /compute/v2.1/flavors/382897461 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:49.760801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af61c7040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.768401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.771657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.772475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.803048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49910acd-2ea9-48a0-8b14-fac409ce4f8b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.083115 Oct 19 00:43:49.804438 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 7/25] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:49.811446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ece36504-5f1d-4308-9ebb-60096776ceb7 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.812762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ece36504-5f1d-4308-9ebb-60096776ceb7 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:49.831368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.832172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.832919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.894779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:49.895281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:49.895724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:49.941436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4df7733e-4d73-435e-99a9-5e9eba6db2dd tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.188282 Oct 19 00:43:49.947804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 19/26] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:49.949737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ba15cde1-7862-4e6f-bc07-e0daf08b2ab0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:49.979231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ece36504-5f1d-4308-9ebb-60096776ceb7 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:50.006456 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ba15cde1-7862-4e6f-bc07-e0daf08b2ab0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.062565 Oct 19 00:43:50.011058 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 20/27] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.024265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa7c7f67-fb69-461e-9ef9-e0c0ea766aea tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.074166 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ece36504-5f1d-4308-9ebb-60096776ceb7 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1243 microversion: 2.1 time: 0.263427 Oct 19 00:43:50.077568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 8/28] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:49 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1243 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.101430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa7c7f67-fb69-461e-9ef9-e0c0ea766aea tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/677389468" status: 202 len: 0 microversion: 2.1 time: 0.082553 Oct 19 00:43:50.102464 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 21/29] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:43:50 2022] DELETE /compute/v2.1/flavors/677389468 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:50.103291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af6159550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.108895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.110686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.111653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3be5dcc2-fa4d-4788-a414-17890cab7a77 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1624212112", "id": 352603241, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:50.112229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.153163 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3be5dcc2-fa4d-4788-a414-17890cab7a77 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.049321 Oct 19 00:43:50.153799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 22/30] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.175084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc534a16-d095-45b3-819b-1b6b0e4efec3 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.200167 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:DELETE=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:50.209582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.210996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.214911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.235633 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc534a16-d095-45b3-819b-1b6b0e4efec3 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080471 Oct 19 00:43:50.245436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19cd379a-7a54-4253-8988-d67b2a964cfa tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.165291 Oct 19 00:43:50.268940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 23/31] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.269068 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 9/32] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.269731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c97c54f9-7177-48bb-a2f6-2ef3898c4cfd tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.283706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b359c4ff-8046-4d3a-bf46-591235c9075a tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-216322757", "id": 1564839283, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:50.323959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b359c4ff-8046-4d3a-bf46-591235c9075a tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.050104 Oct 19 00:43:50.327052 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 10/33] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:50 2022] POST /compute/v2.1/flavors => generated 428 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.334921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af616bb80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.339692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.340197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.340741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.347928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c97c54f9-7177-48bb-a2f6-2ef3898c4cfd tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/352603241/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.092331 Oct 19 00:43:50.354087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 24/34] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/flavors/352603241/os-flavor-access => generated 21 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:43:50.363014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e09a4439-051a-4fd5-a437-4fefeb4ca76b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.382218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.382719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.383156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.401488 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c239c7d-3150-468d-8cf9-e260a40f75a5 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.072458 Oct 19 00:43:50.414714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e09a4439-051a-4fd5-a437-4fefeb4ca76b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1564839283" status: 202 len: 0 microversion: 2.1 time: 0.059299 Oct 19 00:43:50.415768 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 11/35] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.421047 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 25/36] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:43:50 2022] DELETE /compute/v2.1/flavors/1564839283 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:50.423671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53ba5361-fc3a-404f-82ed-851f1fea6193 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.429871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Calling method '.version_select at 0x7f2af61c7d30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.436399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.436871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.437265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.471364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.471736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.475847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.487247 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53ba5361-fc3a-404f-82ed-851f1fea6193 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/352603241" status: 202 len: 0 microversion: 2.1 time: 0.069751 Oct 19 00:43:50.488438 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 12/37] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:43:50 2022] DELETE /compute/v2.1/flavors/352603241 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:50.505156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d41c7aa-aa12-414a-bc63-70f14a71dd29 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.510563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.511065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.511509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.526726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:43:50.527133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18639764-ea7b-484a-ae00-a125094bf387 tempest-HypervisorAdminTestJSON-679345133 tempest-HypervisorAdminTestJSON-679345133-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:43:50.531074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.531567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.532008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.532802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:50.538689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:50.539141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:50.554051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d41c7aa-aa12-414a-bc63-70f14a71dd29 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058479 Oct 19 00:43:50.561592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 13/38] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.564295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7971ee85-61dd-48af-8ceb-7733232623f0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.570402 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.rpcapi [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 00:43:50.571329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] Releasing lock "compute-rpcapi-router" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:43:50.611112 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7971ee85-61dd-48af-8ceb-7733232623f0 tempest-FlavorsAccessTestJSON-1025597243 tempest-FlavorsAccessTestJSON-1025597243-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051955 Oct 19 00:43:50.625381 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 14/39] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.636536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a0ad33d-c3d2-4255-a892-cb1c29dabad8 None None] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.214088 Oct 19 00:43:50.644657 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 26/40] 10.222.0.27 () {58 vars in 1173 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.647609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-879a5efa-e3a0-4414-8733-0c69a478d95e tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1732211818", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:50.678945 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-879a5efa-e3a0-4414-8733-0c69a478d95e tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.051476 Oct 19 00:43:50.679996 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 15/41] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:50 2022] POST /compute/v2.1/flavors => generated 507 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.698884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21f2a498-3284-48a3-bd89-726a91e46564 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.734212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21f2a498-3284-48a3-bd89-726a91e46564 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/905e94b8-51bc-48a4-bc7d-2cfe8226aa0a" status: 202 len: 0 microversion: 2.1 time: 0.043968 Oct 19 00:43:50.737639 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 27/42] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:43:50 2022] DELETE /compute/v2.1/flavors/905e94b8-51bc-48a4-bc7d-2cfe8226aa0a => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:50.759066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ded8f87f-c1c4-47f0-ad19-8d6e7a364e97 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:50.865702 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ded8f87f-c1c4-47f0-ad19-8d6e7a364e97 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124652 Oct 19 00:43:50.867211 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 16/43] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:50.891085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29d90ad9-709c-4a77-9cbe-928b4301b14b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1212528817", "id": "ad7b0834-69e3-47d5-bf76-9f2be3dd98fd", "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:50.961570 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29d90ad9-709c-4a77-9cbe-928b4301b14b tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.069890 Oct 19 00:43:50.968182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 28/44] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:50 2022] POST /compute/v2.1/flavors => generated 507 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:50.995911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0491a334-f795-402b-b461-4f93a580bb9f tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:51.058102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0491a334-f795-402b-b461-4f93a580bb9f tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/ad7b0834-69e3-47d5-bf76-9f2be3dd98fd" status: 202 len: 0 microversion: 2.1 time: 0.075959 Oct 19 00:43:51.062172 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 17/45] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:43:50 2022] DELETE /compute/v2.1/flavors/ad7b0834-69e3-47d5-bf76-9f2be3dd98fd => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:51.071549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd391966-a41b-44d1-82ed-dd9a2ca0e727 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:51.117631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa4c2004-168c-4184-b6ac-f9deeb024a9b tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:51.119148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa4c2004-168c-4184-b6ac-f9deeb024a9b tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:51.177436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd391966-a41b-44d1-82ed-dd9a2ca0e727 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.112008 Oct 19 00:43:51.178608 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 29/46] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:51.230694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9cc101ee-d571-47a3-933c-3842f4d6695d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-627214266", "id": 233636231, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:51.289796 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9cc101ee-d571-47a3-933c-3842f4d6695d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.073062 Oct 19 00:43:51.305396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 30/47] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:51 2022] POST /compute/v2.1/flavors => generated 410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:51.314303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef76877f-53ee-439f-bd63-3c1c31e314a1 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:51.334548 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef76877f-53ee-439f-bd63-3c1c31e314a1 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/233636231" status: 200 len: 410 microversion: 2.1 time: 0.026378 Oct 19 00:43:51.349770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa4c2004-168c-4184-b6ac-f9deeb024a9b tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:51.352110 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 31/48] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:43:51 2022] GET /compute/v2.1/flavors/233636231 => generated 410 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:43:51.404901 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa4c2004-168c-4184-b6ac-f9deeb024a9b tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1243 microversion: 2.1 time: 0.301643 Oct 19 00:43:51.407037 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 18/49] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:51 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1243 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:52.053156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c589e61-207f-4dc1-9b29-35734b6c8566 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.100990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c589e61-207f-4dc1-9b29-35734b6c8566 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.746180 Oct 19 00:43:52.113470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 32/50] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:51 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:52.126033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6e83ba7-9883-4bd6-9f6f-b1bdbb5140f1 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.172289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6e83ba7-9883-4bd6-9f6f-b1bdbb5140f1 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/233636231" status: 202 len: 0 microversion: 2.1 time: 0.051284 Oct 19 00:43:52.185939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42ba9ca0-9ace-48dd-99c3-a0557a0b36b0 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.190198 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 19/51] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:43:52 2022] DELETE /compute/v2.1/flavors/233636231 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:52.272345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42ba9ca0-9ace-48dd-99c3-a0557a0b36b0 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093858 Oct 19 00:43:52.291694 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 33/52] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:52.302491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83c0737a-b5be-4275-9717-ae15722615b3 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1922730455", "id": 1428088405, "os-flavor-access:is_public": "False"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:52.342190 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83c0737a-b5be-4275-9717-ae15722615b3 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.042547 Oct 19 00:43:52.346795 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 20/53] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:52 2022] POST /compute/v2.1/flavors => generated 430 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:52.380593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ca96cf1-29d9-4c2d-8d9b-90a4d5c35a93 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "1428088405"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:52.438928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.439782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:52.460427 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7ca96cf1-29d9-4c2d-8d9b-90a4d5c35a93 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] HTTP exception thrown: Flavor 1428088405 could not be found. Oct 19 00:43:52.468555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.471045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.471819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.472802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:52.473396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:52.473846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ca96cf1-29d9-4c2d-8d9b-90a4d5c35a93 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Request method failure captured: Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 107 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g-GV1wcl2bekeuazB9FW7szDVDdRjSBgB0zYupEIdzj-0cvBi-jlZuynngkToCEvGHXFKEE1loycHb-np2v_i0u8a9V5nLvCEuQFU2IrGRda6r6utD1nhCwdME8s46SOibylokVjnSjAwxtfrLLDvhPs0Xr0hsDta0DJVFLJa7l9M Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 0f53450c0ede48c3bb7ff6c52697c593 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsAdminTestJSON-1129093605 Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:43:52.476911 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0f53450c0ede48c3bb7ff6c52697c593", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f53450c0ede48c3bb7ff6c52697c593"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0f53450c0ede48c3bb7ff6c52697c593"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0f53450c0ede48c3bb7ff6c52697c593"}]}] Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsAdminTestJSON-1129093605 Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 0f53450c0ede48c3bb7ff6c52697c593 Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1129093605 Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsAdminTestJSON-1129093605-project Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 0e8e8ac53a4e405fa6723cac11b3b5fd Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsAdminTestJSON-1129093605-project Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "test", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "1428088405"}} Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:43:52.478019 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor 1428088405 could not be found. Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '1428088405'}}} Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1428088405 could not be found. Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:43:52.478668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1428088405 could not be found. Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:43:52.479577 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1428088405 could not be found. Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:43:52.480584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ca96cf1-29d9-4c2d-8d9b-90a4d5c35a93 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Returning 400 to user: Flavor 1428088405 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:43:52.501397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ca96cf1-29d9-4c2d-8d9b-90a4d5c35a93 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.136107 Oct 19 00:43:52.504356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 34/54] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:52 2022] POST /compute/v2.1/servers => generated 81 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:43:52.517190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0286d159-ba3f-45a4-9b4e-e936defe3a74 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.597909 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0286d159-ba3f-45a4-9b4e-e936defe3a74 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1428088405" status: 202 len: 0 microversion: 2.1 time: 0.086234 Oct 19 00:43:52.601390 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 35/55] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:43:52 2022] DELETE /compute/v2.1/flavors/1428088405 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:52.617726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1763b23-92a2-4dc5-9866-0a76bfe08518 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.698144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1763b23-92a2-4dc5-9866-0a76bfe08518 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.093570 Oct 19 00:43:52.717341 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 36/56] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:52.730466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7191b5e7-e43f-45ed-baa5-66de9f46846a tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-304343002", "id": 2003179424, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:52.791059 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7191b5e7-e43f-45ed-baa5-66de9f46846a tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.051844 Oct 19 00:43:52.791059 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 37/57] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:52.805437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa29d296-7775-4fcf-a4c5-dfe5954eed49 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-802163548", "id": 93436421, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:52.848707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa29d296-7775-4fcf-a4c5-dfe5954eed49 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.1 time: 0.051073 Oct 19 00:43:52.851442 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 38/58] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:52.866600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc6c52cc-c9ee-467c-a4d2-83b811f0763d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.943210 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc6c52cc-c9ee-467c-a4d2-83b811f0763d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.083085 Oct 19 00:43:52.948146 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 39/59] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:52.962106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d78a64ef-3ffb-4d21-98bc-896462f3a1c5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:52.989719 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d78a64ef-3ffb-4d21-98bc-896462f3a1c5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.030731 Oct 19 00:43:52.993751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 40/60] 10.222.0.27 () {58 vars in 1177 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:53.009243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-979d4a70-538c-4fc5-866f-450f5c328823 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.034681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-979d4a70-538c-4fc5-866f-450f5c328823 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.027414 Oct 19 00:43:53.040434 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 41/61] 10.222.0.27 () {58 vars in 1171 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:53.052248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-692cee71-20ad-44e3-9b9f-04bc99d2ab71 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.073331 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-692cee71-20ad-44e3-9b9f-04bc99d2ab71 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.026884 Oct 19 00:43:53.077576 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 42/62] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:53.091539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a9fd9248-f199-40ba-bc63-63734bca6634 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.143776 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a9fd9248-f199-40ba-bc63-63734bca6634 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5388 microversion: 2.1 time: 0.057173 Oct 19 00:43:53.159728 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 43/63] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5388 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.166106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36e7135a-b43c-42bf-8c1b-539878ff0d89 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.194427 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36e7135a-b43c-42bf-8c1b-539878ff0d89 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5388 microversion: 2.1 time: 0.032144 Oct 19 00:43:53.211988 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 44/64] 10.222.0.27 () {58 vars in 1175 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5388 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:53.219157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27f18f7b-b8f2-48fc-8b07-20adeb5a0a6f tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.247875 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27f18f7b-b8f2-48fc-8b07-20adeb5a0a6f tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5388 microversion: 2.1 time: 0.033802 Oct 19 00:43:53.260681 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 45/65] 10.222.0.27 () {58 vars in 1173 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5388 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.268420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce080765-1f42-4d0e-ae57-071a9926ac72 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.294385 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce080765-1f42-4d0e-ae57-071a9926ac72 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5388 microversion: 2.1 time: 0.029232 Oct 19 00:43:53.309750 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 46/66] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5388 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:53.318972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37035b87-3d3f-4b94-8ef0-3de21ef9dade tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.335749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:53.344416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37035b87-3d3f-4b94-8ef0-3de21ef9dade tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/93436421" status: 202 len: 0 microversion: 2.1 time: 0.031698 Oct 19 00:43:53.348865 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 47/67] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:43:53 2022] DELETE /compute/v2.1/flavors/93436421 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:43:53.358064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ea6151d-b301-4c41-830f-9d1617509dcb tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.382474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ea6151d-b301-4c41-830f-9d1617509dcb tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031862 Oct 19 00:43:53.383165 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 48/68] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.402451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9920ab3-1591-4b07-aaed-3b4868a659a7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.423486 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32959dfd-635e-422f-8af6-b32b3805e2ba tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1243 microversion: 2.1 time: 0.995758 Oct 19 00:43:53.425561 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 21/69] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:52 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1243 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:53.428992 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9920ab3-1591-4b07-aaed-3b4868a659a7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2003179424" status: 202 len: 0 microversion: 2.1 time: 0.028601 Oct 19 00:43:53.433189 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 49/70] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:43:53 2022] DELETE /compute/v2.1/flavors/2003179424 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:43:53.441355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0802492-959b-466e-a333-04f5112c6162 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.501167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0802492-959b-466e-a333-04f5112c6162 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065632 Oct 19 00:43:53.523702 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 22/71] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.533427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc360cc2-ced6-47f3-80b9-864371a3cd9d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1610649545", "id": 123704241, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:53.654109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc360cc2-ced6-47f3-80b9-864371a3cd9d tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.126892 Oct 19 00:43:53.656485 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 50/72] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:53 2022] POST /compute/v2.1/flavors => generated 412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:53.672077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81c5de1d-f0e2-4949-8fdc-55737ec1eba7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.717053 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:53.760339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81c5de1d-f0e2-4949-8fdc-55737ec1eba7 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095034 Oct 19 00:43:53.776929 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 23/73] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.790344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b11fc07-603a-4740-9e11-7d36b2944fb7 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.869996 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b11fc07-603a-4740-9e11-7d36b2944fb7 tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085743 Oct 19 00:43:53.889582 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 51/74] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:53.896601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6b10e40-af6d-4120-951c-ebbaaec5fba5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:53.965617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a6b10e40-af6d-4120-951c-ebbaaec5fba5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/123704241" status: 202 len: 0 microversion: 2.1 time: 0.065620 Oct 19 00:43:53.971512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 24/75] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:43:53 2022] DELETE /compute/v2.1/flavors/123704241 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:53.976761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf4cbbd9-89f9-4afb-9e89-90e3da6b05b2 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.015283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf4cbbd9-89f9-4afb-9e89-90e3da6b05b2 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042857 Oct 19 00:43:54.031156 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 52/76] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:43:54.040461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b53f0da-0681-4563-bc14-47e94bf9c124 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-898823800", "id": 1040718678, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:43:54.074058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b53f0da-0681-4563-bc14-47e94bf9c124 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.038861 Oct 19 00:43:54.076349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 25/77] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:43:54 2022] POST /compute/v2.1/flavors => generated 413 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:43:54.089545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0941b4d1-b850-4efb-8a87-ba3aa1f9298b tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.144174 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0941b4d1-b850-4efb-8a87-ba3aa1f9298b tempest-FlavorsAdminTestJSON-1129093605 tempest-FlavorsAdminTestJSON-1129093605-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.058196 Oct 19 00:43:54.148359 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 53/78] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:54 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:54.169896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99b4bcc7-9e02-4eac-aaca-57186a354432 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.203118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99b4bcc7-9e02-4eac-aaca-57186a354432 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1040718678" status: 202 len: 0 microversion: 2.1 time: 0.038056 Oct 19 00:43:54.203881 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 26/79] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:43:54 2022] DELETE /compute/v2.1/flavors/1040718678 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:43:54.212548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4c84a1a-a756-40cb-a779-8331704557c5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.219813 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=15,nova_api:INSERT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:54.273092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4c84a1a-a756-40cb-a779-8331704557c5 tempest-FlavorsAdminTestJSON-1695556222 tempest-FlavorsAdminTestJSON-1695556222-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060462 Oct 19 00:43:54.273802 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 54/80] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:43:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:54.452152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:54.454096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:54.463006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.463788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.464592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.466385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:54.467703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:54.468165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:54.556115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:54.566410 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6cf6d21f-1af2-4577-96f2-e3a88c89d53a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1297 microversion: 2.1 time: 0.118728 Oct 19 00:43:54.582968 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 27/81] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:54 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:55.595407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:55.596787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:55.640194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.641051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.641493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:55.642218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:55.642823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:55.643240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:57.969327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:58.024852 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2027941f-aac0-4f4c-bdf1-8e577f987eea tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 2.429550 Oct 19 00:43:58.028480 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 55/82] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:55 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:43:59.077586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:43:59.078505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:43:59.110490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.111721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.113714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.114903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:43:59.117526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:43:59.118810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:43:59.363703 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:43:59.781377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:43:59.798876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e530b959-fc04-48df-9820-b392805a8063 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.728275 Oct 19 00:43:59.802877 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 28/83] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:43:59 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:00.839288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:00.841602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:00.873986 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:00.882859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:00.884798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:00.890015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:00.891748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:00.892715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:00.896275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:01.288868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:01.301237 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c79a3ba8-4a90-4378-945b-f77b61f2834e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.473280 Oct 19 00:44:01.302701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 56/84] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:00 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:02.346136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:02.347788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:02.366703 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:02.370467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.371160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.387237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:02.395741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:02.398290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:02.401305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:03.089722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:03.120645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-146f423f-c072-427b-93cc-9ada4f6fc80e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.781250 Oct 19 00:44:03.125445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 29/85] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:02 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:04.153897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:04.154962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:04.174182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.174687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.175279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.176137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.176613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.177070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.652847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0614923-ce8b-4a4d-8291-1454c0b6af8c", "tag": "88847f45-85db-4721-9652-511d810752de"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:04.738381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:04.741092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:04.743104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:04.764995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:04.814492 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bdf85977-3c1e-43bf-aa83-c4554ec60c10 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.666388 Oct 19 00:44:04.816132 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 30/86] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:04 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:04.882566 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] Creating event network-changed:88847f45-85db-4721-9652-511d810752de for instance e0614923-ce8b-4a4d-8291-1454c0b6af8c on n-h2-master-1 Oct 19 00:44:04.903227 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9d5b3eb6-6d99-4aea-9e1c-555441a4e0f8 req-0f03a5d8-d4eb-4911-98b0-10fb55568da6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.024020 Oct 19 00:44:04.913312 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 57/87] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:05.785000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0d62b62-c8c0-4862-b083-df253dd3fb71 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Calling method '.version_select at 0x7f2af60afe50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:05.793635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c0d62b62-c8c0-4862-b083-df253dd3fb71 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b983be8651fb47c8b400ce00cff7596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f092e266f25545dea290f34ea233a412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0d62b62-c8c0-4862-b083-df253dd3fb71 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Request method failure captured: Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hPbeszF2jtQK0KOvFMGdoDm4M3UstsQP82UUQqpebGMqL151Q1LkSfVrSYrnpsyQwHVB707taIcYqyStu-WgLVDDrxtypkwgVCdesYM1FcM_o8Ku_04LttldauqnKRP7EGF6plfnVOHbKwDVqmxdF9JLsSzGrJOhYkoJb1MH3qnhY Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:05.807186 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f092e266f25545dea290f34ea233a412", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}] Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b983be8651fb47c8b400ce00cff7596a Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:44:05.809837 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:05.811411 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 19 00:44:05.813643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.818815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0d62b62-c8c0-4862-b083-df253dd3fb71 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:05.822341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0d62b62-c8c0-4862-b083-df253dd3fb71 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.002080 Oct 19 00:44:05.830212 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 31/88] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 00:44:04 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1013 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:05.842441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0a7cb7e-48f9-4d49-9aca-59b6ad921f5f tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Calling method '.version_select at 0x7f2af5fc63a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:05.848967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0a7cb7e-48f9-4d49-9aca-59b6ad921f5f tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b983be8651fb47c8b400ce00cff7596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f092e266f25545dea290f34ea233a412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0a7cb7e-48f9-4d49-9aca-59b6ad921f5f tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Request method failure captured: Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hPbeszF2jtQK0KOvFMGdoDm4M3UstsQP82UUQqpebGMqL151Q1LkSfVrSYrnpsyQwHVB707taIcYqyStu-WgLVDDrxtypkwgVCdesYM1FcM_o8Ku_04LttldauqnKRP7EGF6plfnVOHbKwDVqmxdF9JLsSzGrJOhYkoJb1MH3qnhY Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:05.854259 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f092e266f25545dea290f34ea233a412", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}] Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b983be8651fb47c8b400ce00cff7596a Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:44:05.855618 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:05.858277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 19 00:44:05.859330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:05.861240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0a7cb7e-48f9-4d49-9aca-59b6ad921f5f tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:05.864861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0a7cb7e-48f9-4d49-9aca-59b6ad921f5f tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027259 Oct 19 00:44:05.867098 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 32/89] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:05 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:44:05.880894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:05.884290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:05.907480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:05.918394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:05.919829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:05.929089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:05.930488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:05.933645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.003713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Calling method '.version_select at 0x7f2af5fceee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.005782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.006282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.006727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.038537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.039033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.041291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.067066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.073463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.074600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.091933 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ecd5c5b2-e63d-4ab2-a47b-2a59c9abc5b1 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.960784 Oct 19 00:44:06.099796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 58/90] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:06.108168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5c9ba39-ad3a-45f7-be1a-3ee759eb39b6 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Calling method '.version_select at 0x7f2af604e940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.114566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5c9ba39-ad3a-45f7-be1a-3ee759eb39b6 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b983be8651fb47c8b400ce00cff7596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f092e266f25545dea290f34ea233a412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5c9ba39-ad3a-45f7-be1a-3ee759eb39b6 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Request method failure captured: Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hPbeszF2jtQK0KOvFMGdoDm4M3UstsQP82UUQqpebGMqL151Q1LkSfVrSYrnpsyQwHVB707taIcYqyStu-WgLVDDrxtypkwgVCdesYM1FcM_o8Ku_04LttldauqnKRP7EGF6plfnVOHbKwDVqmxdF9JLsSzGrJOhYkoJb1MH3qnhY Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:06.122564 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f092e266f25545dea290f34ea233a412", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}] Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b983be8651fb47c8b400ce00cff7596a Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: action_args: {} Oct 19 00:44:06.124076 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:06.124949 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 19 00:44:06.126116 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:06.131123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5c9ba39-ad3a-45f7-be1a-3ee759eb39b6 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:06.135709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5c9ba39-ad3a-45f7-be1a-3ee759eb39b6 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.034305 Oct 19 00:44:06.137498 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 59/91] 10.222.0.27 () {58 vars in 1179 bytes} [Wed Oct 19 00:44:06 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:06.150854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Calling method '.version_select at 0x7f2af5f42dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.158565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.159127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.159652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.209222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.212380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.216240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.295722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.296604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.298104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.312443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d654ce7d-0540-44f0-afe5-637fef1bdc68 tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.173505 Oct 19 00:44:06.315557 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 60/92] 10.222.0.27 () {58 vars in 1212 bytes} [Wed Oct 19 00:44:06 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/servers => generated 196 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:06.349211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:06.368110 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4dc1a6e-1590-4179-a8de-2c45be88f789 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.499527 Oct 19 00:44:06.389511 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 33/93] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:05 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:06.886402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Calling method '.version_select at 0x7f2af5edf1f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:06.903815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.904788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.905739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.948164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.953900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.955547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:06.991776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:06.993352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:06.995005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.025927 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-adff7c1c-3990-4f0b-947b-cfde80ad8545 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.703007 Oct 19 00:44:07.031998 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 61/94] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:07.050117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Calling method '.version_select at 0x7f2af61c78b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.056333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.058353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.059189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.098036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.101511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.102550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.114151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26ba08dd-953f-4b90-a6ba-0d3b3042eb1c tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2100724800", "id": 256168791, "os-flavor-access:is_public": "False"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:07.127442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.129419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.130358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.157392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d26bd501-e57f-4f22-b807-890d1985277b tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123692 Oct 19 00:44:07.161704 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 62/95] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:07.167654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26ba08dd-953f-4b90-a6ba-0d3b3042eb1c tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.776608 Oct 19 00:44:07.170005 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 34/96] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:06 2022] POST /compute/v2.1/flavors => generated 436 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:07.182484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3d3c4bc-2065-427d-ab94-4fc9b47b93d3 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Calling method '.version_select at 0x7f2af5fce040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.185289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Calling method '.version_select at 0x7f2af6053820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.187554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.190785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.191469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.194684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3d3c4bc-2065-427d-ab94-4fc9b47b93d3 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b983be8651fb47c8b400ce00cff7596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f092e266f25545dea290f34ea233a412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3d3c4bc-2065-427d-ab94-4fc9b47b93d3 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Request method failure captured: Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hPbeszF2jtQK0KOvFMGdoDm4M3UstsQP82UUQqpebGMqL151Q1LkSfVrSYrnpsyQwHVB707taIcYqyStu-WgLVDDrxtypkwgVCdesYM1FcM_o8Ku_04LttldauqnKRP7EGF6plfnVOHbKwDVqmxdF9JLsSzGrJOhYkoJb1MH3qnhY Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:07.200205 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f092e266f25545dea290f34ea233a412", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}] Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b983be8651fb47c8b400ce00cff7596a Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1'} Oct 19 00:44:07.201573 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:07.202357 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 19 00:44:07.203543 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.206625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3d3c4bc-2065-427d-ab94-4fc9b47b93d3 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:07.210832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3d3c4bc-2065-427d-ab94-4fc9b47b93d3 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.045744 Oct 19 00:44:07.217239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 63/97] 10.222.0.27 () {58 vars in 1173 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:07.231587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf05be3e-624b-46c6-a16f-2cf58aa55a82 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:07.271227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.273717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.274519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.292540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2de7dd6c-af66-4422-be7b-a92d80f998da tempest-HypervisorAdminUnderV252Test-2080004203 tempest-HypervisorAdminUnderV252Test-2080004203-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.116293 Oct 19 00:44:07.300069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 35/98] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 104 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:07.311530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df5dd5b9-5235-4ef5-881e-e765c227358c tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Calling method '.version_select at 0x7f2af616b8b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.323067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-df5dd5b9-5235-4ef5-881e-e765c227358c tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] HTTP exception thrown: Hypervisor with ID '83f23999-1f2e-4d12-803a-774976b9e0a3' could not be found. Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df5dd5b9-5235-4ef5-881e-e765c227358c tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Request method failure captured: Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hypervisors/83f23999-1f2e-4d12-803a-774976b9e0a3/uptime HTTP/1.1 Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hUlm5-4pVXrZcNW3-H5f7n3HcWa0AjAiqWD7DkIM0IXqJ4IDS9qacKe1PTbl0Dij34g_L4A2v_UqtGbyrIFcFjXHf_VsQV1utexkYUe_aqxuygNQMjLlR99EMwcjzD1QcGkgmemBdO9aJUnXSVqf1L6ULOY7G6CpzFQIRHqiqVkjI Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7d08aea89a6f46a2a89d93c91c5f874d Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:07.336799 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d08aea89a6f46a2a89d93c91c5f874d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d08aea89a6f46a2a89d93c91c5f874d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d08aea89a6f46a2a89d93c91c5f874d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d08aea89a6f46a2a89d93c91c5f874d"}]}] Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7d08aea89a6f46a2a89d93c91c5f874d Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 8533645267d345a2a5d8e961e92858e8 Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: exception: Hypervisor with ID '83f23999-1f2e-4d12-803a-774976b9e0a3' could not be found. Oct 19 00:44:07.337978 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '83f23999-1f2e-4d12-803a-774976b9e0a3'} Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '83f23999-1f2e-4d12-803a-774976b9e0a3' Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 00:44:07.338659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '83f23999-1f2e-4d12-803a-774976b9e0a3' could not be found. Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.339939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '83f23999-1f2e-4d12-803a-774976b9e0a3' could not be found. Oct 19 00:44:07.342419 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.343755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df5dd5b9-5235-4ef5-881e-e765c227358c tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Returning 404 to user: Hypervisor with ID '83f23999-1f2e-4d12-803a-774976b9e0a3' could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:07.344826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df5dd5b9-5235-4ef5-881e-e765c227358c tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/83f23999-1f2e-4d12-803a-774976b9e0a3/uptime" status: 404 len: 123 microversion: 2.1 time: 0.038913 Oct 19 00:44:07.345395 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 36/99] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors/83f23999-1f2e-4d12-803a-774976b9e0a3/uptime => generated 123 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:07.358041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Calling method '.version_select at 0x7f2af5ff4160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.361716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.366375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.368429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.406165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.407001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.407626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.423594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.424440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.425106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.436588 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c58d1c6d-a0cc-401d-a5b2-f4e719c6aecd tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085215 Oct 19 00:44:07.438463 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 37/100] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:07.444714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.446631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:07.470541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.471386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.472044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.473017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:07.473673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:07.475056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:07.779949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf05be3e-624b-46c6-a16f-2cf58aa55a82 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/256168791/action" status: 200 len: 96 microversion: 2.1 time: 0.560281 Oct 19 00:44:07.781235 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 64/101] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:07 2022] POST /compute/v2.1/flavors/256168791/action => generated 96 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:07.805864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-039e9143-fd03-4bd5-bbb2-ea739f046177 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Calling method '.version_select at 0x7f2af5f42b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:07.817911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-039e9143-fd03-4bd5-bbb2-ea739f046177 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b983be8651fb47c8b400ce00cff7596a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f092e266f25545dea290f34ea233a412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-039e9143-fd03-4bd5-bbb2-ea739f046177 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Request method failure captured: Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hPbeszF2jtQK0KOvFMGdoDm4M3UstsQP82UUQqpebGMqL151Q1LkSfVrSYrnpsyQwHVB707taIcYqyStu-WgLVDDrxtypkwgVCdesYM1FcM_o8Ku_04LttldauqnKRP7EGF6plfnVOHbKwDVqmxdF9JLsSzGrJOhYkoJb1MH3qnhY Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:07.820958 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f092e266f25545dea290f34ea233a412", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f092e266f25545dea290f34ea233a412"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f092e266f25545dea290f34ea233a412"}]}] Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f092e266f25545dea290f34ea233a412 Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327 Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b983be8651fb47c8b400ce00cff7596a Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1119923327-project Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1'} Oct 19 00:44:07.822123 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:07.822898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 19 00:44:07.824518 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:07.825495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-039e9143-fd03-4bd5-bbb2-ea739f046177 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:07.825495 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-039e9143-fd03-4bd5-bbb2-ea739f046177 tempest-HypervisorAdminNegativeTestJSON-1119923327 tempest-HypervisorAdminNegativeTestJSON-1119923327-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.040708 Oct 19 00:44:07.837033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 65/102] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:07.869834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11ed3c1-d765-4816-8b4a-c4c51db992cc tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:08.057681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:08.073004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f10ea7a3-30cb-40e9-aff2-fd9c62475788 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.632840 Oct 19 00:44:08.086478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 38/103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:07 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:08.104566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d764a2c-2e94-4a2f-9908-1da34ed784a1 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Calling method '.version_select at 0x7f2af5ff4310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:08.109202 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0d764a2c-2e94-4a2f-9908-1da34ed784a1 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] HTTP exception thrown: Hypervisor with ID '87b2c604-cb9f-4548-92de-e65ffeb9c19e' could not be found. Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d764a2c-2e94-4a2f-9908-1da34ed784a1 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Request method failure captured: Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hypervisors/87b2c604-cb9f-4548-92de-e65ffeb9c19e HTTP/1.1 Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hUlm5-4pVXrZcNW3-H5f7n3HcWa0AjAiqWD7DkIM0IXqJ4IDS9qacKe1PTbl0Dij34g_L4A2v_UqtGbyrIFcFjXHf_VsQV1utexkYUe_aqxuygNQMjLlR99EMwcjzD1QcGkgmemBdO9aJUnXSVqf1L6ULOY7G6CpzFQIRHqiqVkjI Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7d08aea89a6f46a2a89d93c91c5f874d Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:08.111608 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d08aea89a6f46a2a89d93c91c5f874d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d08aea89a6f46a2a89d93c91c5f874d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d08aea89a6f46a2a89d93c91c5f874d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d08aea89a6f46a2a89d93c91c5f874d"}]}] Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7d08aea89a6f46a2a89d93c91c5f874d Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-944982134 Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 8533645267d345a2a5d8e961e92858e8 Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: exception: Hypervisor with ID '87b2c604-cb9f-4548-92de-e65ffeb9c19e' could not be found. Oct 19 00:44:08.113497 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '87b2c604-cb9f-4548-92de-e65ffeb9c19e'} Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '87b2c604-cb9f-4548-92de-e65ffeb9c19e' Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 19 00:44:08.114147 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:08.116024 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '87b2c604-cb9f-4548-92de-e65ffeb9c19e' could not be found. Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '87b2c604-cb9f-4548-92de-e65ffeb9c19e' could not be found. Oct 19 00:44:08.117747 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.123431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d764a2c-2e94-4a2f-9908-1da34ed784a1 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] Returning 404 to user: Hypervisor with ID '87b2c604-cb9f-4548-92de-e65ffeb9c19e' could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:08.125065 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d764a2c-2e94-4a2f-9908-1da34ed784a1 tempest-HypervisorAdminNegativeTestJSON-944982134 tempest-HypervisorAdminNegativeTestJSON-944982134-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/87b2c604-cb9f-4548-92de-e65ffeb9c19e" status: 404 len: 123 microversion: 2.1 time: 0.036680 Oct 19 00:44:08.126427 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 39/104] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 00:44:08 2022] GET /compute/v2.1/os-hypervisors/87b2c604-cb9f-4548-92de-e65ffeb9c19e => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:08.777876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e11ed3c1-d765-4816-8b4a-c4c51db992cc tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] HTTP exception thrown: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11ed3c1-d765-4816-8b4a-c4c51db992cc tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Request method failure captured: Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/flavors/256168791/action HTTP/1.1 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 67 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hSU_nJ4IXLIMaPY2aE-gG6DMvXO0nfBcdVvs2Pcz4MhbM5dSRijQbOCi_YAik9xD0jn0VEpBjJgZwbsI47ZV4CVmWVbfXy6LPeF3joLDQ038lHTiPqukOs7xWDR6eXDj6JiMVwdSGlOgKSWtCymPn_QSvrrxuD2uE9t-HjALiLQRY Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:08.840110 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40bfaccf90554a5a8083798d95072c10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}] Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 819cc35a92c94712b15c305cf0790b62 Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} Oct 19 00:44:08.842493 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '256168791', 'body': {'addTenantAccess': {'tenant': '2753fc50fce34c949198d78ead289f24'}}} Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result.read() Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:44:08.843802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '28-2753fc50fce34c949198d78ead289f24' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:44:08.845879 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:44:08.847926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:44:08.856316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result.read() Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '28-2753fc50fce34c949198d78ead289f24' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 0, 44, 8, 769358), 'updated_at': None, 'flavor_id': 28, 'project_id': '2753fc50fce34c949198d78ead289f24'}] Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.860079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.863785 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:08.867930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:08.872404 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. Oct 19 00:44:08.872404 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:08.872404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11ed3c1-d765-4816-8b4a-c4c51db992cc tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Returning 409 to user: Flavor access already exists for flavor 28 and project 2753fc50fce34c949198d78ead289f24 combination. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:08.872404 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e11ed3c1-d765-4816-8b4a-c4c51db992cc tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/256168791/action" status: 409 len: 152 microversion: 2.1 time: 1.005589 Oct 19 00:44:08.872404 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 66/105] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:07 2022] POST /compute/v2.1/flavors/256168791/action => generated 152 bytes in 1008 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:08.873584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fa6ff33-560e-48bd-b3af-44d3db82c20a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:09.115258 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:09.117222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:09.145215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.147441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.148845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.150829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:09.152144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:09.154219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:09.668979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:09.679056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-216b9fd6-94a5-4feb-be43-97cc0892e187 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.575292 Oct 19 00:44:09.680487 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 67/106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:09 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:09.743176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fa6ff33-560e-48bd-b3af-44d3db82c20a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/256168791/action" status: 200 len: 21 microversion: 2.1 time: 0.890233 Oct 19 00:44:09.744873 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 40/107] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:08 2022] POST /compute/v2.1/flavors/256168791/action => generated 21 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:09.768564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc13d3af-85ec-426c-a9e4-45aed341207e tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:09.801729 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc13d3af-85ec-426c-a9e4-45aed341207e tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/256168791" status: 202 len: 0 microversion: 2.1 time: 0.044284 Oct 19 00:44:09.805211 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 41/108] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:44:09 2022] DELETE /compute/v2.1/flavors/256168791 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:09.815098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ccab1fcb-df9d-44b3-8158-8e9559d492d5 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:09.868198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ccab1fcb-df9d-44b3-8158-8e9559d492d5 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057503 Oct 19 00:44:09.870543 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 42/109] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:09.904745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08a54f38-e75d-4606-83b1-5145be615d59 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1993316589", "id": 658142407, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:09.959840 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08a54f38-e75d-4606-83b1-5145be615d59 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.066466 Oct 19 00:44:09.962044 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 43/110] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:09 2022] POST /compute/v2.1/flavors => generated 435 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:09.985640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de809154-86ce-4708-a0cf-02268c2c242b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.013833 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-de809154-86ce-4708-a0cf-02268c2c242b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de809154-86ce-4708-a0cf-02268c2c242b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Request method failure captured: Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/flavors/658142407/os-flavor-access HTTP/1.1 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hSU_nJ4IXLIMaPY2aE-gG6DMvXO0nfBcdVvs2Pcz4MhbM5dSRijQbOCi_YAik9xD0jn0VEpBjJgZwbsI47ZV4CVmWVbfXy6LPeF3joLDQ038lHTiPqukOs7xWDR6eXDj6JiMVwdSGlOgKSWtCymPn_QSvrrxuD2uE9t-HjALiLQRY Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:10.017856 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40bfaccf90554a5a8083798d95072c10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}] Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 819cc35a92c94712b15c305cf0790b62 Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: exception: Access list not available for public flavors. Oct 19 00:44:10.020487 n-d-master-1 devstack@n-api.service[131450]: action_args: {'flavor_id': '658142407'} Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 19 00:44:10.021908 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:10.024719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de809154-86ce-4708-a0cf-02268c2c242b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:10.045774 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de809154-86ce-4708-a0cf-02268c2c242b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/658142407/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.066740 Oct 19 00:44:10.052799 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 44/111] 10.222.0.27 () {58 vars in 1206 bytes} [Wed Oct 19 00:44:09 2022] GET /compute/v2.1/flavors/658142407/os-flavor-access => generated 91 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:10.060259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c564baf-0676-4544-a85b-021f7f57e640 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.135477 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c564baf-0676-4544-a85b-021f7f57e640 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/658142407" status: 202 len: 0 microversion: 2.1 time: 0.080964 Oct 19 00:44:10.137619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 45/112] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:44:10 2022] DELETE /compute/v2.1/flavors/658142407 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:10.169135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb814006-f18e-40f7-9f7d-4e0a5fdf801f tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.223777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a7957a13-3525-452e-a9b5-86f3e814f983 tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1268838261", "id": 2117904458, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:10.317766 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb814006-f18e-40f7-9f7d-4e0a5fdf801f tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.174523 Oct 19 00:44:10.333503 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a7957a13-3525-452e-a9b5-86f3e814f983 tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.601769 Oct 19 00:44:10.335344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 68/113] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:44:09 2022] POST /compute/v2.1/flavors => generated 471 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:10.342177 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 46/114] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:10.349909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30d56340-f971-469a-bcb7-9f59e7c84a1a tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:10.367096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2619d3de-9174-4e67-9021-e3403ab8f24b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1615499921", "id": 1263430811, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:10.420266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2619d3de-9174-4e67-9021-e3403ab8f24b tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.075944 Oct 19 00:44:10.436833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 69/115] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:10.650596 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30d56340-f971-469a-bcb7-9f59e7c84a1a tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2117904458/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.304536 Oct 19 00:44:10.656232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 47/116] 10.222.0.27 () {62 vars in 1265 bytes} [Wed Oct 19 00:44:10 2022] POST /compute/v2.1/flavors/2117904458/os-extra_specs => generated 62 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:10.670328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a94dc26-4ebf-44a3-b4f5-8bddd499742e tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.712060 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a94dc26-4ebf-44a3-b4f5-8bddd499742e tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2117904458" status: 202 len: 0 microversion: 2.86 time: 0.049808 Oct 19 00:44:10.715352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 48/117] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Oct 19 00:44:10 2022] DELETE /compute/v2.1/flavors/2117904458 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:10.725442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:10.728004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:10.744249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:10.746897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:10.749676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:10.753397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:10.754213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:10.754678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:11.297600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-388a9a7f-05db-486d-b402-3add518f0826 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:11.303728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-388a9a7f-05db-486d-b402-3add518f0826 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '29847de2c3704348a07b66256a607223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2753fc50fce34c949198d78ead289f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-388a9a7f-05db-486d-b402-3add518f0826 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Request method failure captured: Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/flavors/1263430811/action HTTP/1.1 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 67 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hNkQVwfuYcNv4-QS4dFRKqUpzNxwSLCiCGf6jFV7ZztE2-VBNvCaKGKpEcqYM79NAlSlT1AJFG2Dt6ZGl8blUFTrNvM0CB0KkqMSAR6e1Y-Ns5cbalShB0MhPCxUbLooWWBFBfVm-nxTZtdxCv-dI4ZKtaOAMvrUNItDdO47mcCYo Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 2753fc50fce34c949198d78ead289f24 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:11.310308 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2753fc50fce34c949198d78ead289f24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2753fc50fce34c949198d78ead289f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2753fc50fce34c949198d78ead289f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2753fc50fce34c949198d78ead289f24"}]}] Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 2753fc50fce34c949198d78ead289f24 Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsAccessNegativeTestJSON-1550967443-project Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 29847de2c3704348a07b66256a607223 Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443-project Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} Oct 19 00:44:11.313017 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1263430811', 'body': {'addTenantAccess': {'tenant': '2753fc50fce34c949198d78ead289f24'}}} Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:11.314488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 19 00:44:11.317322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:11.319661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-388a9a7f-05db-486d-b402-3add518f0826 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:11.319661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-388a9a7f-05db-486d-b402-3add518f0826 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] 10.222.0.27 "POST /compute/v2.1/flavors/1263430811/action" status: 403 len: 130 microversion: 2.1 time: 0.873215 Oct 19 00:44:11.319661 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 70/118] 10.222.0.27 () {60 vars in 1200 bytes} [Wed Oct 19 00:44:10 2022] POST /compute/v2.1/flavors/1263430811/action => generated 130 bytes in 878 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:11.332568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-860ff60e-2ace-412c-a755-c72944d88617 tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:11.394180 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-860ff60e-2ace-412c-a755-c72944d88617 tempest-FlavorMetadataValidation-1334136028 tempest-FlavorMetadataValidation-1334136028-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.074063 Oct 19 00:44:11.396148 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 71/119] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:44:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:44:11.419653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-30c7b1c4-d6c1-4d45-8b62-d27579987184 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:11.471162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-30c7b1c4-d6c1-4d45-8b62-d27579987184 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1263430811" status: 202 len: 0 microversion: 2.1 time: 0.072571 Oct 19 00:44:11.473472 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 72/120] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:44:11 2022] DELETE /compute/v2.1/flavors/1263430811 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:11.490061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bb164f8-482b-45d7-b939-78ba19f63e6a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:11.544194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:11.555019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bb164f8-482b-45d7-b939-78ba19f63e6a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075772 Oct 19 00:44:11.559879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c6496c4-1dc4-4dd4-b0bb-ce69ecdfad98 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.843409 Oct 19 00:44:11.564466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 73/121] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:11.587245 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 49/122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:10 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:11.592982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-139764ca-9303-44fc-984e-92cafcf28dc3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-109509090", "id": 231169383, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:11.626174 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-139764ca-9303-44fc-984e-92cafcf28dc3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.041487 Oct 19 00:44:11.628288 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 74/123] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:11 2022] POST /compute/v2.1/flavors => generated 435 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:11.641406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-798a49b4-24dc-4673-b775-8afda0dc6a43 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:12.331452 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-798a49b4-24dc-4673-b775-8afda0dc6a43 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/231169383/action" status: 200 len: 96 microversion: 2.1 time: 0.695511 Oct 19 00:44:12.340875 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 50/124] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:11 2022] POST /compute/v2.1/flavors/231169383/action => generated 96 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:44:12.350512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ffb288c-7dd5-4109-bb77-5096cf599684 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:12.355934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ffb288c-7dd5-4109-bb77-5096cf599684 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '29847de2c3704348a07b66256a607223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2753fc50fce34c949198d78ead289f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ffb288c-7dd5-4109-bb77-5096cf599684 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Request method failure captured: Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/flavors/231169383/action HTTP/1.1 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 70 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hNkQVwfuYcNv4-QS4dFRKqUpzNxwSLCiCGf6jFV7ZztE2-VBNvCaKGKpEcqYM79NAlSlT1AJFG2Dt6ZGl8blUFTrNvM0CB0KkqMSAR6e1Y-Ns5cbalShB0MhPCxUbLooWWBFBfVm-nxTZtdxCv-dI4ZKtaOAMvrUNItDdO47mcCYo Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 2753fc50fce34c949198d78ead289f24 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:12.358973 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2753fc50fce34c949198d78ead289f24", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2753fc50fce34c949198d78ead289f24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2753fc50fce34c949198d78ead289f24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2753fc50fce34c949198d78ead289f24"}]}] Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 2753fc50fce34c949198d78ead289f24 Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443 Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsAccessNegativeTestJSON-1550967443-project Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 29847de2c3704348a07b66256a607223 Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1550967443-project Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: {"removeTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} Oct 19 00:44:12.361464 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '231169383', 'body': {'removeTenantAccess': {'tenant': '2753fc50fce34c949198d78ead289f24'}}} Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can( Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:12.362847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 19 00:44:12.365380 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:12.367448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ffb288c-7dd5-4109-bb77-5096cf599684 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:12.367448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ffb288c-7dd5-4109-bb77-5096cf599684 tempest-FlavorsAccessNegativeTestJSON-1550967443 tempest-FlavorsAccessNegativeTestJSON-1550967443-project] 10.222.0.27 "POST /compute/v2.1/flavors/231169383/action" status: 403 len: 133 microversion: 2.1 time: 0.021659 Oct 19 00:44:12.367448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 75/125] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:12 2022] POST /compute/v2.1/flavors/231169383/action => generated 133 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:12.376513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f015e3e-fab4-414c-9d5b-10e3c168ddd3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2753fc50fce34c949198d78ead289f24"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:12.869739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d19da0da-23f2-4ffe-a9f1-9ffadfd8b774 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:12.885536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d19da0da-23f2-4ffe-a9f1-9ffadfd8b774 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.411593 Oct 19 00:44:12.886833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 76/126] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:44:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:12.907413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:12.909539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:12.941953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.945502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.946536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:12.947530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:12.948067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:12.948585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:12.989733 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:13.193126 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=16,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:13.282561 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f015e3e-fab4-414c-9d5b-10e3c168ddd3 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/231169383/action" status: 200 len: 21 microversion: 2.1 time: 0.905133 Oct 19 00:44:13.287032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 51/127] 10.222.0.27 () {60 vars in 1197 bytes} [Wed Oct 19 00:44:12 2022] POST /compute/v2.1/flavors/231169383/action => generated 21 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:13.317425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:13.331499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1cacd9d-1d87-45f8-bdfc-3aa80d7e12c3 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.441977 Oct 19 00:44:13.335155 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 77/128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:12 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:13.351723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d98d5eb6-e3e3-491f-80da-597cd291dcae tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:13.401986 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d98d5eb6-e3e3-491f-80da-597cd291dcae tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/231169383" status: 202 len: 0 microversion: 2.1 time: 0.062176 Oct 19 00:44:13.407178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 78/129] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:44:13 2022] DELETE /compute/v2.1/flavors/231169383 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:13.426189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee05fbb0-9f4a-4d03-a1fb-768a08c799e5 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:13.537393 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee05fbb0-9f4a-4d03-a1fb-768a08c799e5 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.124239 Oct 19 00:44:13.538415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 79/130] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:13.578264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2096689e-a5a5-473c-83fc-33bbcd3ee53a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1975303445", "id": 2126473999, "os-flavor-access:is_public": "False"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:13.654293 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2096689e-a5a5-473c-83fc-33bbcd3ee53a tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.079375 Oct 19 00:44:13.656779 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 80/131] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:13.699445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0485f8e-ef43-459c-935f-7e821565fac7 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0573aaefe05443c5840f4e1fa532606b"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:13.796345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e535c868-f1e2-4211-ae30-e2916679082c tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-505446716", "id": 205429470, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:13.881906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e535c868-f1e2-4211-ae30-e2916679082c tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.590941 Oct 19 00:44:13.886126 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 52/132] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:13 2022] POST /compute/v2.1/flavors => generated 421 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:13.906673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e430b975-33a1-4258-9a9f-8117cde55d92 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:13.918360 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e430b975-33a1-4258-9a9f-8117cde55d92 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017052 Oct 19 00:44:13.921219 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 53/133] 10.222.0.27 () {58 vars in 1182 bytes} [Wed Oct 19 00:44:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:44:13.938790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f4ab755-099b-4cdc-90a0-ccf2befe0538 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1590414171", "id": 415488716, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:13.988829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f4ab755-099b-4cdc-90a0-ccf2befe0538 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.057099 Oct 19 00:44:14.002524 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 54/134] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:13 2022] POST /compute/v2.1/flavors => generated 422 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:14.009457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c783d0d6-17d1-4303-9264-a70006525fbc tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:14.027241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c783d0d6-17d1-4303-9264-a70006525fbc tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022447 Oct 19 00:44:14.028787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 55/135] 10.222.0.27 () {58 vars in 1182 bytes} [Wed Oct 19 00:44:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:14.052976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b7afbeb-e07e-4b19-9eb3-391ffacaf845 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Action: 'create', calling method: .version_select at 0x7f2af5ff4670>, body: {"keypair": {"name": "tempest-keypair-1596044564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtcg4wW9+67zcZAA5tWEsr7esnkpQd1YRBg3di0irSqtkgFjfIXl8SKKYnIPNn1R1ZSrmjwJbK3bmLDE22NIF8WIS0snqCgbm4XnDpb0XgFwrB+D4b6Xn/qAsxilesuzg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:14.112545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5b7afbeb-e07e-4b19-9eb3-391ffacaf845 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:14.122563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5b7afbeb-e07e-4b19-9eb3-391ffacaf845 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for user 729379ca02904136b0d5c96d6b28c490 and project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:14.199798 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b7afbeb-e07e-4b19-9eb3-391ffacaf845 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157795 Oct 19 00:44:14.208944 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 56/136] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:44:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:14.361422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:14.362444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:14.387834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:14.388875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:14.390167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:14.391909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:14.393724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:14.394823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:14.400955 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=81 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:14.826820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:14.846835 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49e3a452-27f9-4179-8667-07de3f528bf4 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.488301 Oct 19 00:44:14.848224 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 57/137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:14 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:14.928094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c0485f8e-ef43-459c-935f-7e821565fac7 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] HTTP exception thrown: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0485f8e-ef43-459c-935f-7e821565fac7 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Request method failure captured: Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/flavors/2126473999/action HTTP/1.1 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 70 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hSU_nJ4IXLIMaPY2aE-gG6DMvXO0nfBcdVvs2Pcz4MhbM5dSRijQbOCi_YAik9xD0jn0VEpBjJgZwbsI47ZV4CVmWVbfXy6LPeF3joLDQ038lHTiPqukOs7xWDR6eXDj6JiMVwdSGlOgKSWtCymPn_QSvrrxuD2uE9t-HjALiLQRY Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:14.933105 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_40bfaccf90554a5a8083798d95072c10", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/40bfaccf90554a5a8083798d95072c10"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/40bfaccf90554a5a8083798d95072c10"}]}] Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 40bfaccf90554a5a8083798d95072c10 Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480 Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 819cc35a92c94712b15c305cf0790b62 Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: {"removeTenantAccess": {"tenant": "0573aaefe05443c5840f4e1fa532606b"}} Oct 19 00:44:14.934410 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '2126473999', 'body': {'removeTenantAccess': {'tenant': '0573aaefe05443c5840f4e1fa532606b'}}} Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 19 00:44:14.935036 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:14.936079 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0485f8e-ef43-459c-935f-7e821565fac7 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Returning 404 to user: Flavor access not found for 33 / 0573aaefe05443c5840f4e1fa532606b combination. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:14.937328 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c0485f8e-ef43-459c-935f-7e821565fac7 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/2126473999/action" status: 404 len: 124 microversion: 2.1 time: 1.261825 Oct 19 00:44:14.938465 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 81/138] 10.222.0.27 () {60 vars in 1200 bytes} [Wed Oct 19 00:44:13 2022] POST /compute/v2.1/flavors/2126473999/action => generated 124 bytes in 1269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:14.951299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26e62743-ee9a-41bb-9084-1e467cc65944 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:15.017812 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26e62743-ee9a-41bb-9084-1e467cc65944 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2126473999" status: 202 len: 0 microversion: 2.1 time: 0.073680 Oct 19 00:44:15.019128 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 58/139] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:44:14 2022] DELETE /compute/v2.1/flavors/2126473999 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:15.029506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-245bbf3e-facc-4694-8841-2e8a87f40815 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:15.089733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-245bbf3e-facc-4694-8841-2e8a87f40815 tempest-FlavorsAccessNegativeTestJSON-1536884480 tempest-FlavorsAccessNegativeTestJSON-1536884480-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.060898 Oct 19 00:44:15.104654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 82/140] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:15 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:15.889642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:15.890259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:15.899179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:15.899584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:15.900213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:15.901129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:15.903173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:15.904009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:16.378402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:16.400718 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35c912dc-e1cd-4c68-be26-bcd79e39cc19 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.515649 Oct 19 00:44:16.404023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 59/141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:15 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:17.506716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1884642921", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:17.603437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:17.607648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Calling method '.version_select at 0x7f2af5ff40d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:17.610713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.611609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.612297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.642881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.643621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.644278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.660303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.661027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.661505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.672723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-538e2719-a7bf-4977-bbd4-77f8ec01e102 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.480027 Oct 19 00:44:17.683887 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 60/142] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:17.683887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:17.683887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:17.693887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.694392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.694838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.696427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.697104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.697690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:17.959124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:17.959579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:17.960294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:17.960571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:17.960752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:17.961355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:17.977402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:17.977637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5378d56c-fc97-4d2c-8255-74bf0e13849a tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.302390 Oct 19 00:44:17.988642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 61/143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:17 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:17.990288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:17.998905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1678519052", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "415488716", "adminPass": "***", "networks": [{"uuid": "b070b134-510e-4207-bcb2-70fa5455416b"}], "security_groups": [{"name": "tempest-securitygroup--1881682287"}], "key_name": "tempest-keypair-1596044564", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:18.000008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.001116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.002026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.002661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.038369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:18.060385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:18.081728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:18.084916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:18.147976 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eec1e802-b3e8-4d1b-951c-cb92e44da92a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.155533 Oct 19 00:44:18.149048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 83/144] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:44:18.226961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] validate_networks() for [('b070b134-510e-4207-bcb2-70fa5455416b', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:18.465031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e5ef694-056c-4731-bc38-821d3183f579 tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Calling method '.version_select at 0x7f2af5c6cc10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.466962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4e5ef694-056c-4731-bc38-821d3183f579 tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '27b94e8a05964ad1b2c9a27341b48d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2dcb0cfc58456aae5afdc226600eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e5ef694-056c-4731-bc38-821d3183f579 tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Request method failure captured: Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/n-h2-master-1/search HTTP/1.1 Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hfoS3AHQy4Dg0ypq05_4aAX8-UDuBxZQvKS_LuiIJPJnfhIZeiwIxNgYd3TxqR035rx8ZYL1JGlHnfJTNdl-LMr_XMQ9ou-h3cCKvVovw5McdJPKROGdX6K9Bx8gVcgdda1Jv6BQ-ObGiKbaF_nJfdczZRtH7UBB-GWmBUaS-GYaY Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fe2dcb0cfc58456aae5afdc226600eec Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:18.468731 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe2dcb0cfc58456aae5afdc226600eec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe2dcb0cfc58456aae5afdc226600eec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe2dcb0cfc58456aae5afdc226600eec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe2dcb0cfc58456aae5afdc226600eec"}]}] Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fe2dcb0cfc58456aae5afdc226600eec Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-861725522-project Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 27b94e8a05964ad1b2c9a27341b48d90 Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522-project Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 00:44:18.469977 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-h2-master-1'} Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:18.471058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 19 00:44:18.472262 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.474966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e5ef694-056c-4731-bc38-821d3183f579 tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:18.474966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e5ef694-056c-4731-bc38-821d3183f579 tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.324306 Oct 19 00:44:18.475426 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 84/145] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/os-hypervisors/n-h2-master-1/search => generated 117 bytes in 326 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:18.492958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23d475de-148b-450b-8e56-9f9acb6310c0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.496112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23d475de-148b-450b-8e56-9f9acb6310c0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:18.515826 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9,nova_api:DELETE=7 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:18.625454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-23d475de-148b-450b-8e56-9f9acb6310c0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:18.644801 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23d475de-148b-450b-8e56-9f9acb6310c0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1213 microversion: 2.1 time: 0.166930 Oct 19 00:44:18.650239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 85/146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:18.658887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Calling method '.version_select at 0x7f2af5fdc280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.667805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.668508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.671696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.682731 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Request method failure captured: Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hhnRyhvoBY97gFWLh8E7ykMhR2HyXCBnOhgdWfQ3pZ0mNX8G0WrNiogM7tffWwWkq1zfz1CWuE19Vap7lvgLYSb5osO-B5x7bjh1S-FekP9PXorM6ZkuRg94glMBhy8neKlhwyp9c0tMTUwPvcGNJQIzL6UtODxqNKo49kdYLd-ws Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 300ff6e84ff84169a18ade1faeae90ed Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:18.684232 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_300ff6e84ff84169a18ade1faeae90ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/300ff6e84ff84169a18ade1faeae90ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/300ff6e84ff84169a18ade1faeae90ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/300ff6e84ff84169a18ade1faeae90ed"}]}] Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 300ff6e84ff84169a18ade1faeae90ed Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee590c5e09ad4af0a98a5610254bce30 Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 00:44:18.685584 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.686341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.687654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:18.691081 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae63601c-5436-490c-a945-a29b6bfb8fdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.039433 Oct 19 00:44:18.696287 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 86/147] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:18.706781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Calling method '.version_select at 0x7f2af5c16a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.708841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.709650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.710247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.739686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.750642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.751233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.773060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.773581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.773982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.785694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eafe388a-23d1-4804-8ba4-229702996824 tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.082983 Oct 19 00:44:18.794961 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 87/148] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:18.803982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7848a51e-9928-4661-9804-bd405cd5c8bb tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Calling method '.version_select at 0x7f2af5fdc0d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.805854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7848a51e-9928-4661-9804-bd405cd5c8bb tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '27b94e8a05964ad1b2c9a27341b48d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe2dcb0cfc58456aae5afdc226600eec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7848a51e-9928-4661-9804-bd405cd5c8bb tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Request method failure captured: Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hfoS3AHQy4Dg0ypq05_4aAX8-UDuBxZQvKS_LuiIJPJnfhIZeiwIxNgYd3TxqR035rx8ZYL1JGlHnfJTNdl-LMr_XMQ9ou-h3cCKvVovw5McdJPKROGdX6K9Bx8gVcgdda1Jv6BQ-ObGiKbaF_nJfdczZRtH7UBB-GWmBUaS-GYaY Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fe2dcb0cfc58456aae5afdc226600eec Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:18.807453 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe2dcb0cfc58456aae5afdc226600eec", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe2dcb0cfc58456aae5afdc226600eec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe2dcb0cfc58456aae5afdc226600eec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe2dcb0cfc58456aae5afdc226600eec"}]}] Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fe2dcb0cfc58456aae5afdc226600eec Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522 Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-861725522-project Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 27b94e8a05964ad1b2c9a27341b48d90 Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-861725522-project Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 00:44:18.809129 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1'} Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:18.809742 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 19 00:44:18.810714 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.811711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7848a51e-9928-4661-9804-bd405cd5c8bb tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:18.811711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7848a51e-9928-4661-9804-bd405cd5c8bb tempest-HypervisorAdminNegativeUnderV252Test-861725522 tempest-HypervisorAdminNegativeUnderV252Test-861725522-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014518 Oct 19 00:44:18.817293 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 88/149] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:18.837988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Calling method '.version_select at 0x7f2af5ca2700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:18.845203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:18.846079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:18.846752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:18.863826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] HTTP exception thrown: No hypervisor matching '212af0ba-f138-4c0b-afc0-41cb30f055dd' could be found. Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Request method failure captured: Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hypervisors/212af0ba-f138-4c0b-afc0-41cb30f055dd/servers HTTP/1.1 Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hhnRyhvoBY97gFWLh8E7ykMhR2HyXCBnOhgdWfQ3pZ0mNX8G0WrNiogM7tffWwWkq1zfz1CWuE19Vap7lvgLYSb5osO-B5x7bjh1S-FekP9PXorM6ZkuRg94glMBhy8neKlhwyp9c0tMTUwPvcGNJQIzL6UtODxqNKo49kdYLd-ws Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 300ff6e84ff84169a18ade1faeae90ed Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:18.868115 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_300ff6e84ff84169a18ade1faeae90ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/300ff6e84ff84169a18ade1faeae90ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/300ff6e84ff84169a18ade1faeae90ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/300ff6e84ff84169a18ade1faeae90ed"}]}] Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 300ff6e84ff84169a18ade1faeae90ed Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802 Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee590c5e09ad4af0a98a5610254bce30 Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: exception: No hypervisor matching '212af0ba-f138-4c0b-afc0-41cb30f055dd' could be found. Oct 19 00:44:18.869291 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '212af0ba-f138-4c0b-afc0-41cb30f055dd'} Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '212af0ba-f138-4c0b-afc0-41cb30f055dd' could be found. Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.870288 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '212af0ba-f138-4c0b-afc0-41cb30f055dd' could be found. Oct 19 00:44:18.871256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:18.875101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] Returning 404 to user: No hypervisor matching '212af0ba-f138-4c0b-afc0-41cb30f055dd' could be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:18.876413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-70998d10-ea8c-447b-afb3-ac5c8c1b6cdd tempest-HypervisorAdminNegativeUnderV252Test-1775942802 tempest-HypervisorAdminNegativeUnderV252Test-1775942802-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/212af0ba-f138-4c0b-afc0-41cb30f055dd/servers" status: 404 len: 123 microversion: 2.1 time: 0.048187 Oct 19 00:44:18.878705 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 89/150] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 00:44:18 2022] GET /compute/v2.1/os-hypervisors/212af0ba-f138-4c0b-afc0-41cb30f055dd/servers => generated 123 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:19.412006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0614923-ce8b-4a4d-8291-1454c0b6af8c", "name": "network-vif-plugged", "status": "completed", "tag": "88847f45-85db-4721-9652-511d810752de"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:19.436539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:19.441672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:19.442745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:19.463051 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] Creating event network-vif-plugged:88847f45-85db-4721-9652-511d810752de for instance e0614923-ce8b-4a4d-8291-1454c0b6af8c on n-h2-master-1 Oct 19 00:44:19.470983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-db4eddc0-fc9e-4fcb-95bc-c6d092a07a8c req-69208c99-623e-49d4-9db8-3b914d727a09 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482436 Oct 19 00:44:19.474029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 90/151] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:19.492279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:19.493537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:19.508994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:19.510147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:19.511454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:19.513225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:19.514113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:19.515322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:19.850609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:19.862427 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e09f82e-61af-48c4-9cb2-209b7b7fe4d2 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.380629 Oct 19 00:44:19.863302 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 91/152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:19 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:20.133481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:20.134386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:20.135309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:20.137135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:20.138354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:20.173084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.173386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bdb52ca2-f81d-4be8-b1ed-1263c1db1375 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1582850931", "ram": 512, "vcpus": 1, "disk": 10, "id": 701013094, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:20.174740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.175999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.177149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.177825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.178472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.196150 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bdb52ca2-f81d-4be8-b1ed-1263c1db1375 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.331858 Oct 19 00:44:20.197025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 92/153] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:19 2022] POST /compute/v2.1/flavors => generated 413 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:20.203007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:20.203968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:20.205583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:20.211172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.211725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.212113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for user 729379ca02904136b0d5c96d6b28c490 and project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:20.212264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.212990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.213471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.214361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.229269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:20.233564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:20.301504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:20.304014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b1756e2-0335-4fca-bf5c-b8a1780caad9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.323906 Oct 19 00:44:20.305320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 62/154] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:44:20.320486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-325b28ab-dde5-4438-b46f-16f229f24548 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:20.324915 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4fe327af-9bd4-4a20-b252-3c2c0caf587e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1265 microversion: 2.1 time: 0.126570 Oct 19 00:44:20.326628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 93/155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:20 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:20.332384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4a6d233-530a-4e2b-96c2-c9fa30a242eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:20.333266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4a6d233-530a-4e2b-96c2-c9fa30a242eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:20.376690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-325b28ab-dde5-4438-b46f-16f229f24548 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069577 Oct 19 00:44:20.378431 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 63/156] 10.222.0.27 () {60 vars in 1221 bytes} [Wed Oct 19 00:44:20 2022] POST /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:20.447045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4a6d233-530a-4e2b-96c2-c9fa30a242eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:20.474538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4a6d233-530a-4e2b-96c2-c9fa30a242eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1263 microversion: 2.1 time: 0.146352 Oct 19 00:44:20.476459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 94/157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:20 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:20.724381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6737130-03a4-4a07-9a7f-5790b676e827 tempest-FlavorsExtraSpecsTestJSON-264822670 tempest-FlavorsExtraSpecsTestJSON-264822670-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:20.745377 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6737130-03a4-4a07-9a7f-5790b676e827 tempest-FlavorsExtraSpecsTestJSON-264822670 tempest-FlavorsExtraSpecsTestJSON-264822670-project] 10.222.0.27 "GET /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.355865 Oct 19 00:44:20.746539 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 64/158] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 00:44:20 2022] GET /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:20.775505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e8bfcfa-30e0-4eb3-984c-4b739f3054fe tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:20.888585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:20.889295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:20.899225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.899725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.901163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.903926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:20.904423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:20.905642 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e8bfcfa-30e0-4eb3-984c-4b739f3054fe tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.150433 Oct 19 00:44:20.906395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:20.914780 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 95/159] 10.222.0.27 () {60 vars in 1221 bytes} [Wed Oct 19 00:44:20 2022] POST /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:20.934729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab848fb8-7d2b-42f8-9332-780dbd83f134 tempest-FlavorsExtraSpecsTestJSON-264822670 tempest-FlavorsExtraSpecsTestJSON-264822670-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:20.967349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ab848fb8-7d2b-42f8-9332-780dbd83f134 tempest-FlavorsExtraSpecsTestJSON-264822670 tempest-FlavorsExtraSpecsTestJSON-264822670-project] 10.222.0.27 "GET /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.042969 Oct 19 00:44:20.973311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 96/160] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:44:20 2022] GET /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes => generated 22 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:20.997927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b6be632-5c12-4f93-a1ef-b722228b2a62 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:21.125716 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b6be632-5c12-4f93-a1ef-b722228b2a62 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.144234 Oct 19 00:44:21.133804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 97/161] 10.222.0.27 () {60 vars in 1221 bytes} [Wed Oct 19 00:44:20 2022] POST /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:21.140308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6832edba-9df7-4977-83e0-89093b406a4f tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.158337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6832edba-9df7-4977-83e0-89093b406a4f tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019966 Oct 19 00:44:21.166407 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 98/162] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:21.172206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f52cdc0-24c5-448b-b63b-5f7ea7214993 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:21.217238 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f52cdc0-24c5-448b-b63b-5f7ea7214993 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.049431 Oct 19 00:44:21.218480 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 99/163] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:44:21 2022] PUT /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes => generated 22 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:44:21.233336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1773d7c5-5715-41a2-8c61-aa379be41fbf tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.263392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1773d7c5-5715-41a2-8c61-aa379be41fbf tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037100 Oct 19 00:44:21.264003 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 100/164] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/flavors/701013094/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:21.278329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f1246a54-e4c6-4c7c-89b3-9ade5b69af0c tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.363845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:21.390189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f1246a54-e4c6-4c7c-89b3-9ade5b69af0c tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.112776 Oct 19 00:44:21.398207 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28684758-c2ad-436b-b65e-aff1d2870ebd tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1339 microversion: 2.1 time: 0.513307 Oct 19 00:44:21.399064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 101/165] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:44:21 2022] DELETE /compute/v2.1/flavors/701013094/os-extra_specs/hw:numa_nodes => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 00:44:21.408047 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 65/166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:20 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1339 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:21.418232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.419230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.431711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.436003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.436680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.437548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.438237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.438865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.457991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-edca8a4e-fd5b-4361-b515-109cf5654e02 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.510485 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-edca8a4e-fd5b-4361-b515-109cf5654e02 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/701013094/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.098921 Oct 19 00:44:21.516110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 66/167] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:44:21 2022] DELETE /compute/v2.1/flavors/701013094/os-extra_specs/hw:cpu_policy => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:21.528149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.529388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:21.540589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.542524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.543753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.544761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:21.545393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:21.546012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:21.549124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:21.562944 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1fbdf2e9-7a13-43aa-a2d0-d66d1d9d4893 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1271 microversion: 2.1 time: 0.160214 Oct 19 00:44:21.565345 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 102/168] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:21.571749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce01f62c-70b4-43c8-8df9-dcdd6e8ab9dc tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.584008 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce01f62c-70b4-43c8-8df9-dcdd6e8ab9dc tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/701013094/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.017139 Oct 19 00:44:21.594018 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 103/169] 10.222.0.27 () {58 vars in 1200 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/flavors/701013094/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:21.609893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8dd1e56a-f97d-44cf-8da8-e343d9dd464d tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.642830 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8dd1e56a-f97d-44cf-8da8-e343d9dd464d tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/701013094" status: 202 len: 0 microversion: 2.1 time: 0.040681 Oct 19 00:44:21.643515 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 104/170] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:44:21 2022] DELETE /compute/v2.1/flavors/701013094 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:44:21.653681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ee5a4b7-b3dc-4ee5-8b37-66216c954f05 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:21.689190 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ee5a4b7-b3dc-4ee5-8b37-66216c954f05 tempest-FlavorsExtraSpecsTestJSON-172499548 tempest-FlavorsExtraSpecsTestJSON-172499548-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.040389 Oct 19 00:44:21.690722 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 105/171] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:21.878424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:21.889821 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d24b06d-2e52-495e-ab0b-206c3a483aaf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1267 microversion: 2.1 time: 0.372407 Oct 19 00:44:21.905650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 67/172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:21 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:22.443707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.450381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:22.468923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.470132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.471221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.472955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.474105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.475294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.598040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.599285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:22.608522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.609457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.609989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.610669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.611142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.611582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.774165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:22.804097 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f68f307-81f3-4973-ac5b-b2b730fa2f42 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1489 microversion: 2.1 time: 0.373223 Oct 19 00:44:22.805163 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 106/173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:22 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1489 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:22.870290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.871258 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:22.902462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.903237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.919673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.919673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.919673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.919673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.944308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:22.956608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6f6709cd-9f8d-42d8-832a-d0129719e765 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.368773 Oct 19 00:44:22.957765 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 68/174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:22 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:22.962991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:22.964361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:22.971047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.971823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.972415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:22.975288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:22.975980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:22.976736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.209875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:23.253617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce5ad471-d487-4618-846e-dff140309677 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1267 microversion: 2.1 time: 0.293975 Oct 19 00:44:23.269831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 69/175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:22 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1267 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:23.429762 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ce7f6c5-bd32-44d0-9074-1e826fdbabcf tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1640 microversion: 2.1 time: 0.584916 Oct 19 00:44:23.433538 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 107/176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:22 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1640 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:23.455178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:23.455832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:23.462867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.463297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.464333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.465567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.466038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.466463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.517676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:44:23.638673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "compute-rpcapi-router" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:44:23.639314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ce174f8-dbdc-46ec-a526-2c3c86e5d583 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquired lock "compute-rpcapi-router" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:44:23.640763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.641552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.642079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.643722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.644319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.644639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.654259 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.rpcapi [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 19 00:44:23.655060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] Releasing lock "compute-rpcapi-router" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:44:23.709119 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65aad651-fef3-447e-92a0-e787c1309a6e None None] 10.222.0.27 "DELETE /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 204 len: 0 microversion: 2.1 time: 0.259428 Oct 19 00:44:23.710682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 70/177] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:44:23 2022] DELETE /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:44:23.720737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:23.721954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:23.735436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.736678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.738161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.739235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:23.739868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:23.740289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:23.905590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:23.929105 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc7cf0da-2667-4a46-a3c8-ccc8e980c29c tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1495 microversion: 2.1 time: 0.213419 Oct 19 00:44:23.929703 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 108/178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:23 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1495 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:24.002276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:24.003350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:24.005608 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=5,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:24.013225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.014048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.014743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.015672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.016586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.017336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.272109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:24.282167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca38958c-d887-497b-9af8-430e237f3951 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.285562 Oct 19 00:44:24.282771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 71/179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:23 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:24.287534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:24.288169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:24.294341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.294840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.295286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.295999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.296590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.296959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.395629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:24.406217 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e156fda2-a268-4f27-bbe8-d5d0c0d2418c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1267 microversion: 2.1 time: 0.122357 Oct 19 00:44:24.407545 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 72/180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:24 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1267 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:24.613190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e292d8b8-4da2-450e-b106-9a1e52c1da92 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-613788930", "ram": 512, "vcpus": 1, "disk": 10, "id": 1161327468, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:24.642415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e292d8b8-4da2-450e-b106-9a1e52c1da92 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.450621 Oct 19 00:44:24.643896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 109/181] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:24 2022] POST /compute/v2.1/flavors => generated 415 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:24.919982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbaf854e-d446-408c-a7b9-5e8dcc457ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:24.933267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-cbaf854e-d446-408c-a7b9-5e8dcc457ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] HTTP exception thrown: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbaf854e-d446-408c-a7b9-5e8dcc457ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Request method failure captured: Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hment8VbGu9pOkL2Jam3ywds5_GtU7oQ9IKdnHLISmBF3T90yAFFvlo8sMRSdKhx89driMdZqLcVan6eDZnPAOPNZd30u4pESvL8uMkppAapJ-UC4rDz6sd-u0ijCI0u7S2Cy3GGFTv2jKklW2NtxazPXCTH6ShoGOp8rAeIREKiU Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:24.936407 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_009288be91794393b779e14d30e5c421", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/009288be91794393b779e14d30e5c421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}] Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9fe239d58cbf4c4d9d1b8023b5c4ebdb Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:24.937989 n-d-master-1 devstack@n-api.service[131450]: exception: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: action_args: {'flavor_id': '1161327468', 'id': 'hw:cpu_thread_policy'} Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:24.938830 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:24.940330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.941967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbaf854e-d446-408c-a7b9-5e8dcc457ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Returning 404 to user: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:24.942926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cbaf854e-d446-408c-a7b9-5e8dcc457ebb tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] 10.222.0.27 "GET /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.288857 Oct 19 00:44:24.943573 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 73/182] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:44:24 2022] GET /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:44:24.953274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-811fe339-c29c-43e7-a269-1037bba0f2df tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:24.953798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:24.954934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:24.956976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-811fe339-c29c-43e7-a269-1037bba0f2df tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '9fe239d58cbf4c4d9d1b8023b5c4ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009288be91794393b779e14d30e5c421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-811fe339-c29c-43e7-a269-1037bba0f2df tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Request method failure captured: Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/flavors/1161327468/os-extra_specs HTTP/1.1 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 66 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hment8VbGu9pOkL2Jam3ywds5_GtU7oQ9IKdnHLISmBF3T90yAFFvlo8sMRSdKhx89driMdZqLcVan6eDZnPAOPNZd30u4pESvL8uMkppAapJ-UC4rDz6sd-u0ijCI0u7S2Cy3GGFTv2jKklW2NtxazPXCTH6ShoGOp8rAeIREKiU Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:24.959116 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_009288be91794393b779e14d30e5c421", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/009288be91794393b779e14d30e5c421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}] Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9fe239d58cbf4c4d9d1b8023b5c4ebdb Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 19 00:44:24.960276 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: action_args: {'flavor_id': '1161327468', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:24.961059 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 19 00:44:24.962894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:24.965317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-811fe339-c29c-43e7-a269-1037bba0f2df tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:24.965317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-811fe339-c29c-43e7-a269-1037bba0f2df tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] 10.222.0.27 "POST /compute/v2.1/flavors/1161327468/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011401 Oct 19 00:44:24.968159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 110/183] 10.222.0.27 () {60 vars in 1224 bytes} [Wed Oct 19 00:44:24 2022] POST /compute/v2.1/flavors/1161327468/os-extra_specs => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:24.977600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.978815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.980373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:24.981266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5bc6258d-7908-4409-bb87-0add8bd11640 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:24.984232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:24.985831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:24.987823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.048491 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:25.067309 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5bc6258d-7908-4409-bb87-0add8bd11640 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1161327468/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.094819 Oct 19 00:44:25.074864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 111/184] 10.222.0.27 () {60 vars in 1224 bytes} [Wed Oct 19 00:44:24 2022] POST /compute/v2.1/flavors/1161327468/os-extra_specs => generated 66 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:25.080537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9eb863ed-0ef0-4cd0-9938-c06d89e71202 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.082512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9eb863ed-0ef0-4cd0-9938-c06d89e71202 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '9fe239d58cbf4c4d9d1b8023b5c4ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009288be91794393b779e14d30e5c421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9eb863ed-0ef0-4cd0-9938-c06d89e71202 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Request method failure captured: Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hment8VbGu9pOkL2Jam3ywds5_GtU7oQ9IKdnHLISmBF3T90yAFFvlo8sMRSdKhx89driMdZqLcVan6eDZnPAOPNZd30u4pESvL8uMkppAapJ-UC4rDz6sd-u0ijCI0u7S2Cy3GGFTv2jKklW2NtxazPXCTH6ShoGOp8rAeIREKiU Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:25.089632 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_009288be91794393b779e14d30e5c421", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/009288be91794393b779e14d30e5c421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}] Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9fe239d58cbf4c4d9d1b8023b5c4ebdb Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:25.090895 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: action_args: {'flavor_id': '1161327468', 'id': 'hw:numa_nodes'} Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:25.091604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 19 00:44:25.092810 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.095680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9eb863ed-0ef0-4cd0-9938-c06d89e71202 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:25.096921 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9eb863ed-0ef0-4cd0-9938-c06d89e71202 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020567 Oct 19 00:44:25.106332 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 112/185] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:44:25 2022] DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:25.113851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e89c21f5-4c6c-44c7-8a85-200850067544 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:25.161347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e89c21f5-4c6c-44c7-8a85-200850067544 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1161327468/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053326 Oct 19 00:44:25.162298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 113/186] 10.222.0.27 () {60 vars in 1224 bytes} [Wed Oct 19 00:44:25 2022] POST /compute/v2.1/flavors/1161327468/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:44:25.180659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d32b0cf9-92af-4df6-b2a4-fc47d713c6f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:25.185728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d32b0cf9-92af-4df6-b2a4-fc47d713c6f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '9fe239d58cbf4c4d9d1b8023b5c4ebdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '009288be91794393b779e14d30e5c421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d32b0cf9-92af-4df6-b2a4-fc47d713c6f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Request method failure captured: Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 22 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hment8VbGu9pOkL2Jam3ywds5_GtU7oQ9IKdnHLISmBF3T90yAFFvlo8sMRSdKhx89driMdZqLcVan6eDZnPAOPNZd30u4pESvL8uMkppAapJ-UC4rDz6sd-u0ijCI0u7S2Cy3GGFTv2jKklW2NtxazPXCTH6ShoGOp8rAeIREKiU Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:25.190877 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_009288be91794393b779e14d30e5c421", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/009288be91794393b779e14d30e5c421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/009288be91794393b779e14d30e5c421"}]}] Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 009288be91794393b779e14d30e5c421 Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9fe239d58cbf4c4d9d1b8023b5c4ebdb Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: {"hw:numa_nodes": "1"} Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:25.193784 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: action_args: {'flavor_id': '1161327468', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:25.208863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 19 00:44:25.212962 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.218219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d32b0cf9-92af-4df6-b2a4-fc47d713c6f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:25.218219 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d32b0cf9-92af-4df6-b2a4-fc47d713c6f6 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435 tempest-FlavorsExtraSpecsNegativeTestJSON-1960397435-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.025240 Oct 19 00:44:25.218219 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 114/187] 10.222.0.27 () {60 vars in 1265 bytes} [Wed Oct 19 00:44:25 2022] PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes => generated 124 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:25.218219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-805b7dff-d1b6-4c1d-a002-ba799d7549c6 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.422768 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-805b7dff-d1b6-4c1d-a002-ba799d7549c6 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] HTTP exception thrown: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-805b7dff-d1b6-4c1d-a002-ba799d7549c6 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Request method failure captured: Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ho9_uj_SeXRIBbX3tqr6IXph5K0FOkhgRDcSKv0xAMlJvHNNk6E4gYUeSqwqPYIIaRemMGHGPDTMOk7yZuhSOBBCQpIdPsV2tg5gk7QOUERussTcT2PLpAlJx2MdNZL1L3oCaz2iVrsoyLc2FyIqwKaJ6FHnqNfac_3638mK_bzDw Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:25.425981 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f002025aca2c472ab186d16c6745a0b3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}] Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a864687612404b139227d92ff7564d8b Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:25.428375 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: action_args: {'flavor_id': '1161327468', 'id': 'hw:cpu_thread_policy'} Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.429600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. Oct 19 00:44:25.432893 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.434826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.438509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-805b7dff-d1b6-4c1d-a002-ba799d7549c6 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Returning 404 to user: Flavor 1161327468 has no extra specs with key hw:cpu_thread_policy. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:25.440480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-805b7dff-d1b6-4c1d-a002-ba799d7549c6 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.233523 Oct 19 00:44:25.441944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 115/188] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:44:25 2022] DELETE /compute/v2.1/flavors/1161327468/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 236 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:25.451748 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c946116c-f3e6-40d2-90c1-c74b847bfd4e tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1495 microversion: 2.1 time: 0.502549 Oct 19 00:44:25.460684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 74/189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:24 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1495 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:25.465914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.466890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:25.469738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.470381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:25.482165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.483080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.483203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.483648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.484098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.484509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.485591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.486423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.487105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.487946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:25.488442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:25.491152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:25.629914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.641539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5cf8655b-3bc3-4926-85e7-b959aa79759e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1267 microversion: 2.1 time: 0.187713 Oct 19 00:44:25.642534 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 75/190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:25 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:25.649462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d87ede3b-c919-4e9d-adbe-a212e41780ac tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:25.656235 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d87ede3b-c919-4e9d-adbe-a212e41780ac tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d87ede3b-c919-4e9d-adbe-a212e41780ac tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Request method failure captured: Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 27 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0ho9_uj_SeXRIBbX3tqr6IXph5K0FOkhgRDcSKv0xAMlJvHNNk6E4gYUeSqwqPYIIaRemMGHGPDTMOk7yZuhSOBBCQpIdPsV2tg5gk7QOUERussTcT2PLpAlJx2MdNZL1L3oCaz2iVrsoyLc2FyIqwKaJ6FHnqNfac_3638mK_bzDw Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:25.660676 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f002025aca2c472ab186d16c6745a0b3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}] Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: a864687612404b139227d92ff7564d8b Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: {"hw:cpu_policy": "shared"} Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:25.661792 n-d-master-1 devstack@n-api.service[131450]: exception: Request body and URI mismatch Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: action_args: {'flavor_id': '1161327468', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.662456 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.663434 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:25.663434 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:25.663434 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 19 00:44:25.663434 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.665344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d87ede3b-c919-4e9d-adbe-a212e41780ac tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:25.668682 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d87ede3b-c919-4e9d-adbe-a212e41780ac tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024687 Oct 19 00:44:25.672748 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 76/191] 10.222.0.27 () {60 vars in 1265 bytes} [Wed Oct 19 00:44:25 2022] PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes => generated 73 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:44:25.682930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff880a4b-d2ee-4869-a951-cb379ad68fa9 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff880a4b-d2ee-4869-a951-cb379ad68fa9 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Request method failure captured: Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 49 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0ho9_uj_SeXRIBbX3tqr6IXph5K0FOkhgRDcSKv0xAMlJvHNNk6E4gYUeSqwqPYIIaRemMGHGPDTMOk7yZuhSOBBCQpIdPsV2tg5gk7QOUERussTcT2PLpAlJx2MdNZL1L3oCaz2iVrsoyLc2FyIqwKaJ6FHnqNfac_3638mK_bzDw Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:25.697606 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f002025aca2c472ab186d16c6745a0b3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f002025aca2c472ab186d16c6745a0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f002025aca2c472ab186d16c6745a0b3"}]}] Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f002025aca2c472ab186d16c6745a0b3 Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: a864687612404b139227d92ff7564d8b Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 19 00:44:25.700434 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: action_args: {'flavor_id': '1161327468', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance: Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 19 00:44:25.701125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.702346 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 19 00:44:25.703569 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:25.705458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff880a4b-d2ee-4869-a951-cb379ad68fa9 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:25.707477 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff880a4b-d2ee-4869-a951-cb379ad68fa9 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.029035 Oct 19 00:44:25.708707 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 77/192] 10.222.0.27 () {60 vars in 1265 bytes} [Wed Oct 19 00:44:25 2022] PUT /compute/v2.1/flavors/1161327468/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:44:25.724497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c966f21b-3793-4417-851c-f0cbcfbe1967 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.759402 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c966f21b-3793-4417-851c-f0cbcfbe1967 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1161327468" status: 202 len: 0 microversion: 2.1 time: 0.045516 Oct 19 00:44:25.761587 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 78/193] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:44:25 2022] DELETE /compute/v2.1/flavors/1161327468 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:25.775037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da1461c0-0795-4855-97a0-7aea4cf195a0 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:25.804475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da1461c0-0795-4855-97a0-7aea4cf195a0 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682 tempest-FlavorsExtraSpecsNegativeTestJSON-143714682-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.038238 Oct 19 00:44:25.806390 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 79/194] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:44:25 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:25.925168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:25.938690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54f14c52-3d0c-46ab-85fb-68faca63d1cf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.492058 Oct 19 00:44:25.939645 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 116/195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:25 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:26.483491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:26.484148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:26.494558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.495270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.495837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.496337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.501846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.502540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.625089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:26.638278 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-582f481a-83a5-4378-90a8-7ca45e587329 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1453 microversion: 2.1 time: 0.160106 Oct 19 00:44:26.655270 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 80/196] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:26 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:26.684575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:26.685250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:26.708061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.709169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.710184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.714779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.729963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0614923-ce8b-4a4d-8291-1454c0b6af8c", "name": "network-vif-deleted", "tag": "88847f45-85db-4721-9652-511d810752de"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:26.734334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.744342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.827645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:26.831030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:26.832084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:26.892545 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] Creating event network-vif-deleted:88847f45-85db-4721-9652-511d810752de for instance e0614923-ce8b-4a4d-8291-1454c0b6af8c on n-h2-master-1 Oct 19 00:44:26.900371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7f31e9d3-1cd3-41ea-89de-38639279896e req-7056cb8c-d25f-4f8c-8d7a-8cf3f3a64d65 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180196 Oct 19 00:44:26.903481 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 81/197] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:26.983049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:26.993458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:26.998018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:27.004536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3509a52e-a02e-43b3-8679-30433b55752a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1267 microversion: 2.1 time: 0.323354 Oct 19 00:44:27.005502 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 117/198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:26 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1267 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:27.012808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.017267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.018701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.020587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.022064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.022515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.039953 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:27.663298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:27.664278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:27.675163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:27.697522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31962bf8-5e68-4b95-82a3-2457541c4b7b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.720633 Oct 19 00:44:27.718913 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 82/199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:26 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:27.721588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.723849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.726191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.727972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.730646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.732899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.830936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:27.833847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:27.837499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:27.838357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lazy-loading 'fault' on Instance uuid e0614923-ce8b-4a4d-8291-1454c0b6af8c {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:27.992863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be64be1ba172441eb0ee9a03fabb0bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c64d39f0a00b4dab9da6f0ffd2832210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:28.004974 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3c7d338-4dc1-43e1-ba4b-7e16c5d6c8e9 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 200 len: 1329 microversion: 2.1 time: 0.345771 Oct 19 00:44:28.012329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 118/200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:27 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 1329 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:28.025745 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:28.032212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:28.033035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:28.046924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.047457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.048928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.051207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.053625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.054628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.282150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:28.288162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-23071889", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:28.303660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fbe5bf09-32e7-45da-8565-09af8d78db88 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1315 microversion: 2.1 time: 0.278636 Oct 19 00:44:28.306535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 119/201] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:28 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:28.381297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:28.724496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:28.725149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:28.739574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.741691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.745376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.755313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.757444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.758133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.935995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:28.936528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:28.936932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:28.937354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:28.937770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:28.961827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.962535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.963473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:28.964907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:28.965877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:28.967027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.015980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Getting quotas for project b553e8276e214de6b1fa6db1fb52e6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:29.023135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Getting quotas for user 97fb5d3a021149d4a90bef39a518ada2 and project b553e8276e214de6b1fa6db1fb52e6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:29.052068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:29.059052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:29.198177 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f4480eb-96e3-440c-abe4-472ea2c2c3ba tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436663 Oct 19 00:44:29.208799 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 83/202] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:44:29.211561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:29.225702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.226284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.226727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.251826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] Creating event network-changed:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h1-master-1 Oct 19 00:44:29.269560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-314cc211-52c7-4426-a8f4-dd51ab81d3c9 req-dd972be4-d055-4517-9e20-079a6fe388f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066325 Oct 19 00:44:29.273158 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 84/203] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:29.290585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:29.294855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:29.309614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:29.312020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.312862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.313378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.314619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.315346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.315991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.334621 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e327e98-6abd-4956-b192-cd0c48fc15cc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.614085 Oct 19 00:44:29.349606 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] HTTP exception thrown: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Request method failure captured: Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c HTTP/1.1 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g7PlqIVdyAr5s0kN-oWfYnY0Jdg2aTnLyyH7a3kywxIMR5zzcGHGTWnAVYd97GTb2Jc0AInvHO6yS9hYHlJaioMV2u4UM2GP2e7-TAi8fa840yCBjKKtRpx4Lk4aqKtQsdwkOaB7TlVmBNBI20EJAVfAinjZ_foed7hoTSwxNl-CE Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:29.357472 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c64d39f0a00b4dab9da6f0ffd2832210", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}] Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: be64be1ba172441eb0ee9a03fabb0bda Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:29.358864 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e0614923-ce8b-4a4d-8291-1454c0b6af8c'} Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:29.359552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:29.360801 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:29.365980 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 120/204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:28 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:29.377195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Returning 404 to user: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:29.381723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f52ca6da-8ec1-4c5c-b405-1bb8490ce162 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 404 len: 111 microversion: 2.1 time: 0.104901 Oct 19 00:44:29.389398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 85/205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:29 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:29.389878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ce54173-12ac-4677-b5f8-7f2648d4f41b tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:29.390534 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ce54173-12ac-4677-b5f8-7f2648d4f41b tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:29.397425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:29.398213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:29.412459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.419626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.419626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.422203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.422203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.422203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.670157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ce54173-12ac-4677-b5f8-7f2648d4f41b tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:29.678281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ce54173-12ac-4677-b5f8-7f2648d4f41b tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1217 microversion: 2.1 time: 0.311293 Oct 19 00:44:29.688763 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 121/206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:29 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1217 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:29.708128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e78421e0-a14c-4c89-8a49-11a70825b739 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:29.733668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:29.751005 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-919bd997-5b68-4caf-9e6f-95ba5f03211c tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1321 microversion: 2.1 time: 0.363926 Oct 19 00:44:29.766687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e78421e0-a14c-4c89-8a49-11a70825b739 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:29.767933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e78421e0-a14c-4c89-8a49-11a70825b739 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:29.768520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e78421e0-a14c-4c89-8a49-11a70825b739 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:29.780008 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 86/207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:29 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:30.004344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e78421e0-a14c-4c89-8a49-11a70825b739 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.1 time: 0.317368 Oct 19 00:44:30.012944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 122/208] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:30.019405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24c97634-346d-48ca-85bb-9024639e5591 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:30.076971 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24c97634-346d-48ca-85bb-9024639e5591 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.062740 Oct 19 00:44:30.078541 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 87/209] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:30.093936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8813e59a-3890-4bb5-91ef-d740dc85736d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1814213320"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:30.097916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-8813e59a-3890-4bb5-91ef-d740dc85736d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 5a3808ce-0fbc-450e-a2fc-7353e8bc67cc for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:30.136517 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8813e59a-3890-4bb5-91ef-d740dc85736d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.044741 Oct 19 00:44:30.138643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 123/210] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:30.149781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6cedbb5-c8ac-42ee-9baf-5d8c3d42c16d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:30.163554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6cedbb5-c8ac-42ee-9baf-5d8c3d42c16d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.164370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6cedbb5-c8ac-42ee-9baf-5d8c3d42c16d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.165021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6cedbb5-c8ac-42ee-9baf-5d8c3d42c16d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:30.363503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:30.364540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:30.378090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.378967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.379644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:30.380586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.381874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.382532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:30.885676 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6cedbb5-c8ac-42ee-9baf-5d8c3d42c16d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.739907 Oct 19 00:44:30.886591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 88/211] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:30 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:30.906542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:30.911617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:30.936692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.942538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.944602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:30.950792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:30.952977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:30.955775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:31.197065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:31.212654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08074ffa-6398-46f4-8cb2-4b12499fb796 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1269 microversion: 2.1 time: 0.321307 Oct 19 00:44:31.214693 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 89/212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:30 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1269 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:31.237949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:31.239367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:31.253612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:31.254127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:31.254406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:31.255033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:31.255559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:31.256064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:31.257677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:31.276896 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a623c4c0-fd11-4c32-b3c3-82219db2bbe6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.916229 Oct 19 00:44:31.285173 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 124/213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:30 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:31.299747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-478686cb-82f7-4976-8dfe-07b78def7c66 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:31.326563 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-478686cb-82f7-4976-8dfe-07b78def7c66 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.030958 Oct 19 00:44:31.331781 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 125/214] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:44:31 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:31.348908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ff28a6d-4ff7-45e7-a7c4-0911afe400ec tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:31.377824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ff28a6d-4ff7-45e7-a7c4-0911afe400ec tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:31.381787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ff28a6d-4ff7-45e7-a7c4-0911afe400ec tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:31.382169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ff28a6d-4ff7-45e7-a7c4-0911afe400ec tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:31.399429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:31.415345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9539d84-d1b1-4ede-ad4b-5f851abe510f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1321 microversion: 2.1 time: 0.198165 Oct 19 00:44:31.419856 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 90/215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:31 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:31.450662 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:31.646244 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ff28a6d-4ff7-45e7-a7c4-0911afe400ec tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.305168 Oct 19 00:44:31.649427 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 126/216] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:31.667694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9515251b-995f-475c-be51-d1335cbafdd4 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:31.714235 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9515251b-995f-475c-be51-d1335cbafdd4 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.044974 Oct 19 00:44:31.723065 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 91/217] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:31.742255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97d88621-0843-4606-abc5-8b7b926daa02 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-389747937"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:31.763048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-97d88621-0843-4606-abc5-8b7b926daa02 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 84a8a17d-5c39-4346-8983-5a6bf18174f5 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:31.845360 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97d88621-0843-4606-abc5-8b7b926daa02 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.111435 Oct 19 00:44:31.849338 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 127/218] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:31 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:31.860560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c11e22bb-5410-4dde-a3f7-153fa181959e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:31.874290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11e22bb-5410-4dde-a3f7-153fa181959e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:31.875184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11e22bb-5410-4dde-a3f7-153fa181959e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:31.875722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11e22bb-5410-4dde-a3f7-153fa181959e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.181479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c11e22bb-5410-4dde-a3f7-153fa181959e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.326423 Oct 19 00:44:32.183110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 92/219] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:32.197605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6028e6c-cb8f-479c-93c3-42989db083c2 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:32.233512 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6028e6c-cb8f-479c-93c3-42989db083c2 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.042663 Oct 19 00:44:32.237095 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 93/220] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:44:32 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:32.248048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:32.250992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:32.278021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.279608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.280379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.281868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.284080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.285603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.412909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3fc88bfa-2981-423d-ac1c-63e42004e131 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Action: 'create', calling method: .version_select at 0x7f2af5fdc550>, body: {"keypair": {"name": "tempest-keypair-479770750", "type": "ssh", "user_id": "fa1bdd6156f4450db16c3a1cbeabd4c8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBEywj6gV7L0wfDxOn5gwtX6TmU38lyNS6cRdC+P7eoiAw3JrdnjAvqBB7pCC3+yrJmu9ISTBFf4PfINKL61TMN5oXWhgg981lzSyNR/c9r3+ILnw9T4/TYb3ZtkEG+lQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:32.417451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:32.434447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f191c3c5-8aad-40ac-a860-fd4c77398d53 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1275 microversion: 2.1 time: 0.195849 Oct 19 00:44:32.435059 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 94/221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:32 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:32.441721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0011c92e-ca67-4082-8e47-d1349e423d01 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:32.467012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0011c92e-ca67-4082-8e47-d1349e423d01 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.470015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3fc88bfa-2981-423d-ac1c-63e42004e131 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:32.472407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0011c92e-ca67-4082-8e47-d1349e423d01 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.473078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0011c92e-ca67-4082-8e47-d1349e423d01 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.495973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3fc88bfa-2981-423d-ac1c-63e42004e131 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for user c9b206a5e2b849b2a6b5c61c4b9ec3c8 and project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:32.595043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3fc88bfa-2981-423d-ac1c-63e42004e131 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.477535 Oct 19 00:44:32.605477 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 128/222] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 00:44:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 489 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:44:32.610822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:32.611727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:32.619428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.620355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.621119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.622064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.622739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.623870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.785269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0011c92e-ca67-4082-8e47-d1349e423d01 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 226 microversion: 2.1 time: 0.348492 Oct 19 00:44:32.786216 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 95/223] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 226 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:32.797841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:32.799567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:32.809660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.810701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.811307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.813275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:32.813850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:32.814473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:32.911903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:32.926680 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dcaae0a1-e511-4490-9ea9-15c1a5ed29e0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.319436 Oct 19 00:44:32.928758 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 129/224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:32 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:32.936440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3232a72c-13e0-4652-86c8-97be754c3bf5 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Action: 'create', calling method: .version_select at 0x7f2af5ca21f0>, body: {"keypair": {"name": "tempest-keypair-1261781939", "type": "ssh", "user_id": "fa1bdd6156f4450db16c3a1cbeabd4c8", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKP5zX/1Yyw9qbVq/8jahavEkEa+idBiKGNgTXzwkbAFmQYuHm9e+0VNCPY78JDhPQS9yGq4XLlvjBpZ8wB7GeV9rbYxipJP+3dgLYGJiuHxRoOIE9Y+YnIY+t9/22M6/Q=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:32.967599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3232a72c-13e0-4652-86c8-97be754c3bf5 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:32.975582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3232a72c-13e0-4652-86c8-97be754c3bf5 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for user c9b206a5e2b849b2a6b5c61c4b9ec3c8 and project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:33.013508 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3232a72c-13e0-4652-86c8-97be754c3bf5 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.083016 Oct 19 00:44:33.022009 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 130/225] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 00:44:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:44:33.030113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b78ba47-821c-4d3d-b772-036daf4bc08f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.083485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b78ba47-821c-4d3d-b772-036daf4bc08f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.058450 Oct 19 00:44:33.086168 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 131/226] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:33.113102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-705361f5-4cfd-4159-b92b-df183a91fa24 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Calling method '.version_select at 0x7f2af5d0f820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.137622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-705361f5-4cfd-4159-b92b-df183a91fa24 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-479770750?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8" status: 200 len: 511 microversion: 2.10 time: 0.042740 Oct 19 00:44:33.139168 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 132/227] 10.222.0.27 () {60 vars in 1337 bytes} [Wed Oct 19 00:44:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-479770750?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8 => generated 511 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:33.156930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1278a283-0391-4979-95c0-ed0d59ebeb7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-623057894"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:33.164019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-1278a283-0391-4979-95c0-ed0d59ebeb7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid c1fa5041-2c31-427a-8518-3c0854389e58 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:33.215646 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1278a283-0391-4979-95c0-ed0d59ebeb7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.074334 Oct 19 00:44:33.216777 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 133/228] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:33.239066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-99e94acf-4a7f-4d60-9dae-14ace5faac8d tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Action: 'create', calling method: .version_select at 0x7f2af5c40af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-659662859", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjmd5W9/BvehnKa/LX7vgfvoewRu2livJo9KGlCAcaBy1yh6/e4sNGUpbNuB9cLNiH07SYHDY+YnPieCEBTC6Qo1ThO97HOkNNYeB1X6KOz8eQE699w6xnZpX/yG2rQfg=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:33.262368 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=87,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:33.275276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-99e94acf-4a7f-4d60-9dae-14ace5faac8d tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:33.292513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-99e94acf-4a7f-4d60-9dae-14ace5faac8d tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Getting quotas for user c9b206a5e2b849b2a6b5c61c4b9ec3c8 and project 3b9f87c69d264030af37a186609edf48. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:33.335455 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-99e94acf-4a7f-4d60-9dae-14ace5faac8d tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.117389 Oct 19 00:44:33.337193 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 134/229] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 00:44:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:44:33.350880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:33.356608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69554aad-5d17-4837-a312-d5f7a19f1172 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:33.377818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69554aad-5d17-4837-a312-d5f7a19f1172 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:33.378463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69554aad-5d17-4837-a312-d5f7a19f1172 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:33.379220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69554aad-5d17-4837-a312-d5f7a19f1172 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:33.389183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b91ed307-edbf-4ffc-a424-43c4c96d1acf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.601628 Oct 19 00:44:33.393515 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 96/230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:32 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:33.404431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf585ed6-5c16-4a46-885a-440a77e32ac2 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Calling method '.version_select at 0x7f2af5d2bf70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.433554 n-d-master-1 devstack@n-api.service[131450]: WARNING oslo_db.sqlalchemy.utils [None req-cf585ed6-5c16-4a46-885a-440a77e32ac2 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:44:33.481509 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf585ed6-5c16-4a46-885a-440a77e32ac2 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8" status: 200 len: 725 microversion: 2.10 time: 0.082443 Oct 19 00:44:33.489295 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 97/231] 10.222.0.27 () {60 vars in 1259 bytes} [Wed Oct 19 00:44:33 2022] GET /compute/v2.1/os-keypairs?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8 => generated 725 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:33.495557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.496542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:33.505706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:33.506205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:33.506644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:33.508738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:33.509659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:33.511107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:33.625925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69554aad-5d17-4837-a312-d5f7a19f1172 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.286687 Oct 19 00:44:33.634217 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 135/232] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:33.639634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e7380fd-257b-4783-b2f7-3c04e1addb96 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Calling method '.version_select at 0x7f2af5c40550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.674621 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e7380fd-257b-4783-b2f7-3c04e1addb96 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-659662859" status: 204 len: 0 microversion: 2.10 time: 0.039011 Oct 19 00:44:33.681908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 136/233] 10.222.0.27 () {60 vars in 1322 bytes} [Wed Oct 19 00:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-659662859 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:44:33.689338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14e732cf-46c5-445e-acd3-c03c7155ea91 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:33.722773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14e732cf-46c5-445e-acd3-c03c7155ea91 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:33.726007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14e732cf-46c5-445e-acd3-c03c7155ea91 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:33.727108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14e732cf-46c5-445e-acd3-c03c7155ea91 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:33.957243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:33.968424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-664d5367-2ead-424a-9971-25d1ab2164d1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1275 microversion: 2.1 time: 0.477772 Oct 19 00:44:33.969632 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 98/234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:33 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1275 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:33.974812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-676f8ac9-3a63-4455-8a0a-b8ac66cfc042 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Calling method '.version_select at 0x7f2af5d33940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:33.990071 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:34.008536 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-676f8ac9-3a63-4455-8a0a-b8ac66cfc042 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261781939?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8" status: 204 len: 0 microversion: 2.10 time: 0.037048 Oct 19 00:44:34.009309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 99/235] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261781939?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:44:34.015732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.016159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:34.027458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.028049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.028498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.029292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.029761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.030199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.081694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14e732cf-46c5-445e-acd3-c03c7155ea91 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.397532 Oct 19 00:44:34.082664 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 137/236] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:34.185299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a124b96-1795-4584-92f9-201cb18838d9", "tag": "f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.199448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.200739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.201408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.215750 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] Creating event network-changed:f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967 for instance 3a124b96-1795-4584-92f9-201cb18838d9 on n-h1-master-1 Oct 19 00:44:34.221425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5b58d92f-c1de-4c18-b130-098fb6d5eb52 req-b497c415-1c6f-490a-96dc-9863b8abaf4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130571 Oct 19 00:44:34.222067 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 138/237] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:34.227853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e8bd0dd-a50f-41d5-84f0-3b763179da87 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] Calling method '.version_select at 0x7f2af5ca2c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.245470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:34.257379 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e8bd0dd-a50f-41d5-84f0-3b763179da87 tempest-KeyPairsV210TestJSON-177540573 tempest-KeyPairsV210TestJSON-177540573-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-479770750?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8" status: 204 len: 0 microversion: 2.10 time: 0.033811 Oct 19 00:44:34.259088 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 139/238] 10.222.0.27 () {60 vars in 1340 bytes} [Wed Oct 19 00:44:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-479770750?user_id=fa1bdd6156f4450db16c3a1cbeabd4c8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:44:34.261480 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3fc4b61-ffab-4cf5-865b-e0620a05a302 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.248013 Oct 19 00:44:34.262670 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 100/239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:34 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:34.264999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-380937df-2927-43aa-b2f8-69d398abfb00 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.304571 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-380937df-2927-43aa-b2f8-69d398abfb00 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.044981 Oct 19 00:44:34.305447 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 140/240] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:34 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:34.326210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bba4d11-13f2-4b86-aa6f-cea0b4769eed tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-39698634"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.330132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3711a36d-6b78-47bc-8233-f7ff9253b846 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-848617223"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.331143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-9bba4d11-13f2-4b86-aa6f-cea0b4769eed tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 6ffbcd50-d0e6-4619-84c7-bef53e7fc85f for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:34.338961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-3711a36d-6b78-47bc-8233-f7ff9253b846 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 0fb0c34c-376e-45cf-afc6-d6444e12055b for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:34.372410 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bba4d11-13f2-4b86-aa6f-cea0b4769eed tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.052566 Oct 19 00:44:34.373447 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 141/241] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:34.396392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c33e4b0-c2d1-4787-9cdf-7a38235baf20 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.403253 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3711a36d-6b78-47bc-8233-f7ff9253b846 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083508 Oct 19 00:44:34.404383 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 101/242] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:34.419201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-69ff5cae-e8da-4088-a48d-3c830889b7ab tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.429632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c33e4b0-c2d1-4787-9cdf-7a38235baf20 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.430158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c33e4b0-c2d1-4787-9cdf-7a38235baf20 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.430604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c33e4b0-c2d1-4787-9cdf-7a38235baf20 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.459128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-69ff5cae-e8da-4088-a48d-3c830889b7ab tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.046484 Oct 19 00:44:34.462363 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 102/243] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:34 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 19 00:44:34.475063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.477908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:34.495262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.496903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.497971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.499751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.500818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.502545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.723830 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c33e4b0-c2d1-4787-9cdf-7a38235baf20 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 240 microversion: 2.1 time: 0.339967 Oct 19 00:44:34.725018 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 142/244] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates/5/action => generated 240 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:34.730572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-878800e3-eeee-42fe-9af3-c44ff0f95187 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.755777 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-878800e3-eeee-42fe-9af3-c44ff0f95187 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-878800e3-eeee-42fe-9af3-c44ff0f95187 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Request method failure captured: Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g92PDIBF7ZyMh4q7l9w9gvqO0mPT5bXGd-haNsM0yYjiDkssBqNF1oMBN2cbrDc2TVAeOaCenKsPypUHTHPRe5HYj_I7Q1hZ-ONL1E97ZSivwC0Tz_3T_dY3-zFnICWK2x_8lTB3fmEx6hjXE1zNOihQuMmcPT1kaDeljP8m49jpY Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:34.770414 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba978ee0a80d4f4db74b9340f647efd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}] Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6ea7abfc3333406a9db9853bfa0f12b0 Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: exception: Aggregate 6 could not be found. Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6'} Oct 19 00:44:34.771852 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.772681 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 19 00:44:34.773753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.777050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-878800e3-eeee-42fe-9af3-c44ff0f95187 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:34.781902 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-878800e3-eeee-42fe-9af3-c44ff0f95187 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.055787 Oct 19 00:44:34.782681 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 143/245] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:44:34 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:34.801209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.829893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.830404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.831017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.853526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:34.875793 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef7b4975-1f26-4cb7-b745-441271cc4a10 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.409751 Oct 19 00:44:34.884841 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Aggregate 5 already has host n-h2-master-1. Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 39 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:34.894347 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: {"add_host": {"host": "n-h2-master-1"}} Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:34.895620 n-d-master-1 devstack@n-api.service[131449]: exception: Aggregate 5 already has host n-h2-master-1. Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result.read() Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:44:34.896345 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-master-1-5' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 00:44:34.897427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 00:44:34.898499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 00:44:34.899588 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result.read() Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-master-1-5' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 0, 44, 34, 870240), 'updated_at': None, 'host': 'n-h2-master-1', 'aggregate_id': 5}] Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.900538 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 5 already has host n-h2-master-1. Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.904397 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 5 already has host n-h2-master-1. Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:34.913409 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:34.917393 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 already has host n-h2-master-1. Oct 19 00:44:34.917393 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.917731 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 103/246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:34 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:34.918091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 409 to user: Aggregate 5 already has host n-h2-master-1. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:34.918091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6cb21206-b5de-4803-99ea-876074179193 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 409 len: 95 microversion: 2.1 time: 0.108974 Oct 19 00:44:34.918091 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 144/247] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates/5/action => generated 95 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 19 00:44:34.922519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-598dc506-8402-4c42-b21a-e3ae49448cc4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:34.926608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-203e609e-5441-45f0-a8ce-16b7323f97cc tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:34.947215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598dc506-8402-4c42-b21a-e3ae49448cc4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:34.948191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598dc506-8402-4c42-b21a-e3ae49448cc4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:34.948789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598dc506-8402-4c42-b21a-e3ae49448cc4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:34.958661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-203e609e-5441-45f0-a8ce-16b7323f97cc tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-203e609e-5441-45f0-a8ce-16b7323f97cc tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Request method failure captured: Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g92PDIBF7ZyMh4q7l9w9gvqO0mPT5bXGd-haNsM0yYjiDkssBqNF1oMBN2cbrDc2TVAeOaCenKsPypUHTHPRe5HYj_I7Q1hZ-ONL1E97ZSivwC0Tz_3T_dY3-zFnICWK2x_8lTB3fmEx6hjXE1zNOihQuMmcPT1kaDeljP8m49jpY Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:34.968749 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba978ee0a80d4f4db74b9340f647efd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}] Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 6ea7abfc3333406a9db9853bfa0f12b0 Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: exception: Aggregate 6 could not be found. Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '6'} Oct 19 00:44:34.970079 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:34.970847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:34.971894 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:34.973084 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:34.973084 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:34.973084 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:34.973084 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 19 00:44:34.973084 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:34.977689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-203e609e-5441-45f0-a8ce-16b7323f97cc tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:34.979325 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-203e609e-5441-45f0-a8ce-16b7323f97cc tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.082766 Oct 19 00:44:34.983964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 104/248] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:34 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:35.002940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a7722373-8d94-4821-8bab-2b110b36cfda tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1042540447", "name": "tempest-test_aggregate-740226869"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:35.037894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-a7722373-8d94-4821-8bab-2b110b36cfda tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 82f21d3e-9479-4031-a40a-7063aa86c4d0 for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:35.195672 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a7722373-8d94-4821-8bab-2b110b36cfda tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.205067 Oct 19 00:44:35.205227 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 105/249] 10.222.0.27 () {60 vars in 1165 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:35.233365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.234458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:35.255328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:35.256546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-598dc506-8402-4c42-b21a-e3ae49448cc4 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 225 microversion: 2.1 time: 0.349803 Oct 19 00:44:35.263735 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 145/250] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:34 2022] POST /compute/v2.1/os-aggregates/5/action => generated 225 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:35.263735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce9da0aa-5acd-4bf1-8453-5c8f31d8479e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.266319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:35.267228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:35.268168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:35.269065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:35.273246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:35.320431 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce9da0aa-5acd-4bf1-8453-5c8f31d8479e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.061584 Oct 19 00:44:35.321105 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 146/251] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:35.329364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e20107e1-f308-438e-b8b2-b9b4efe6f3b7 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.446861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:35.456667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de46bb98-1d20-4c24-9ac8-c913c751b91c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1275 microversion: 2.1 time: 0.242223 Oct 19 00:44:35.461851 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 106/252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:35 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:35.464663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e20107e1-f308-438e-b8b2-b9b4efe6f3b7 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.138958 Oct 19 00:44:35.471780 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 147/253] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:35 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:35.477900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.478147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4a6d7ed-96bb-4276-a1d5-ecde307af619 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.484989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:35.498368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:35.501620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:35.502510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:35.505735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:35.506371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:35.506925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:35.513872 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e4a6d7ed-96bb-4276-a1d5-ecde307af619 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4a6d7ed-96bb-4276-a1d5-ecde307af619 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Request method failure captured: Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g92PDIBF7ZyMh4q7l9w9gvqO0mPT5bXGd-haNsM0yYjiDkssBqNF1oMBN2cbrDc2TVAeOaCenKsPypUHTHPRe5HYj_I7Q1hZ-ONL1E97ZSivwC0Tz_3T_dY3-zFnICWK2x_8lTB3fmEx6hjXE1zNOihQuMmcPT1kaDeljP8m49jpY Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:35.515504 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba978ee0a80d4f4db74b9340f647efd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}] Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6ea7abfc3333406a9db9853bfa0f12b0 Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: exception: Aggregate 7 could not be found. Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7'} Oct 19 00:44:35.516770 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.517873 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 19 00:44:35.519909 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.522562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4a6d7ed-96bb-4276-a1d5-ecde307af619 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:35.527308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4a6d7ed-96bb-4276-a1d5-ecde307af619 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.054307 Oct 19 00:44:35.531216 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 148/254] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:44:35 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:35.544479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77bf4a30-a79c-4853-8967-18ac60afa880 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1356431303"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:35.551262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-77bf4a30-a79c-4853-8967-18ac60afa880 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 603c60cc-152a-4f82-95ea-8c1dba339a7e for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:35.630401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77bf4a30-a79c-4853-8967-18ac60afa880 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096687 Oct 19 00:44:35.632042 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 149/255] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:35.642101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8307d2ac-8e35-4eee-b96d-bb22294c2c7d tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1563391028"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:35.646893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-8307d2ac-8e35-4eee-b96d-bb22294c2c7d tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Generated uuid f8358508-b411-49b1-ba3f-001c8c208440 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:35.701498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8307d2ac-8e35-4eee-b96d-bb22294c2c7d tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.062744 Oct 19 00:44:35.702660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 150/256] 10.222.0.27 () {62 vars in 1205 bytes} [Wed Oct 19 00:44:35 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:35.717961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-043f39a7-0acc-4552-ace6-90856549483e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:35.735932 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-043f39a7-0acc-4552-ace6-90856549483e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-043f39a7-0acc-4552-ace6-90856549483e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Request method failure captured: Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g92PDIBF7ZyMh4q7l9w9gvqO0mPT5bXGd-haNsM0yYjiDkssBqNF1oMBN2cbrDc2TVAeOaCenKsPypUHTHPRe5HYj_I7Q1hZ-ONL1E97ZSivwC0Tz_3T_dY3-zFnICWK2x_8lTB3fmEx6hjXE1zNOihQuMmcPT1kaDeljP8m49jpY Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:35.738469 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ba978ee0a80d4f4db74b9340f647efd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ba978ee0a80d4f4db74b9340f647efd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ba978ee0a80d4f4db74b9340f647efd6"}]}] Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ba978ee0a80d4f4db74b9340f647efd6 Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1208383445 Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6ea7abfc3333406a9db9853bfa0f12b0 Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminTestJSON-1208383445-project-admin Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: exception: Aggregate 7 could not be found. Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7'} Oct 19 00:44:35.740273 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:35.741176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:35.742610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:35.744103 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:35.744103 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:35.744103 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:35.744103 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 19 00:44:35.744103 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:35.746029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-043f39a7-0acc-4552-ace6-90856549483e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:35.747265 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-043f39a7-0acc-4552-ace6-90856549483e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.035185 Oct 19 00:44:35.748334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 151/257] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:36.075148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:36.091239 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b94446e9-6b06-4e61-8b50-be879765b0c7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.628026 Oct 19 00:44:36.097315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 107/258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:35 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:36.118242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd166a40-87ae-41af-8e99-a158cab992db tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1695175293"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:36.264979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a48620d-61ac-4593-9f09-2e9c96f852fc tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:36.281244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8a48620d-61ac-4593-9f09-2e9c96f852fc tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a48620d-61ac-4593-9f09-2e9c96f852fc tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 39 Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:36.288291 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: {"add_host": {"host": "n-h2-master-1"}} Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:36.289673 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h2-master-1'}}} Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:36.290668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 19 00:44:36.292073 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:36.294587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a48620d-61ac-4593-9f09-2e9c96f852fc tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:36.297960 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a48620d-61ac-4593-9f09-2e9c96f852fc tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.548086 Oct 19 00:44:36.303398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 152/259] 10.222.0.27 () {60 vars in 1191 bytes} [Wed Oct 19 00:44:35 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 551 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:36.309919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb9bbba7-f29f-4cef-99fb-1b837493beba tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-662250584"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:36.328823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-fb9bbba7-f29f-4cef-99fb-1b837493beba tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 677fda51-225c-4c72-99fb-43e40294475b for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:36.395383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb9bbba7-f29f-4cef-99fb-1b837493beba tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.090373 Oct 19 00:44:36.397855 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 153/260] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:36 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:36.410414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:36.411175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:36.433008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.433867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.434619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.435613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.436261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.436920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.738003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd166a40-87ae-41af-8e99-a158cab992db tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.638452 Oct 19 00:44:36.739585 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 108/261] 10.222.0.27 () {62 vars in 1210 bytes} [Wed Oct 19 00:44:36 2022] PUT /compute/v2.1/os-aggregates/9 => generated 299 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:36.757090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2dcd432-f656-433c-98b6-5dc329927691 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:36.840046 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2dcd432-f656-433c-98b6-5dc329927691 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.097453 Oct 19 00:44:36.840536 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 109/262] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:36 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:36.856422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-90f6dc2e-9f68-4a40-92b1-48e7d9918d49 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:36.878114 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-90f6dc2e-9f68-4a40-92b1-48e7d9918d49 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 227 microversion: 2.1 time: 0.035334 Oct 19 00:44:36.880831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 110/263] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:36 2022] GET /compute/v2.1/os-aggregates/10 => generated 227 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:36.898259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:36.901605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:36.919154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.919154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.919154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.923278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:36.923890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:36.927605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:36.979774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:36.997085 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3245c17f-a48c-4d1b-b82c-c9e88a8005fa tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.597916 Oct 19 00:44:36.998039 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 154/264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:36 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:37.003700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-faac1676-2905-4e8a-aea3-cb30d33ba774 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:37.054179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-faac1676-2905-4e8a-aea3-cb30d33ba774 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.048989 Oct 19 00:44:37.055104 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 155/265] 10.222.0.27 () {60 vars in 1190 bytes} [Wed Oct 19 00:44:36 2022] GET /compute/v2.1/os-aggregates/9 => generated 299 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:37.076170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-404af9a8-3354-4071-abdb-faacf7c21334 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1811595103"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.109634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-404af9a8-3354-4071-abdb-faacf7c21334 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid b36782c6-a065-4241-a232-62e05d28237c for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:37.124763 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:DELETE=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:37.180156 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-404af9a8-3354-4071-abdb-faacf7c21334 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.124154 Oct 19 00:44:37.182727 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 156/266] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:37.196921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9567756b-3f9a-484a-b09f-db6d094fe53d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.262194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9567756b-3f9a-484a-b09f-db6d094fe53d tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 265 microversion: 2.1 time: 0.074907 Oct 19 00:44:37.272914 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 157/267] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates/10/action => generated 265 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:37.285566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-525079eb-cec5-43d5-bf1f-2e704c234114 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.307797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:37.328684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-525079eb-cec5-43d5-bf1f-2e704c234114 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.332837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-525079eb-cec5-43d5-bf1f-2e704c234114 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.336792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-525079eb-cec5-43d5-bf1f-2e704c234114 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.345584 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a5bc195-a232-4e96-a21b-6d2e46a904f1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.461018 Oct 19 00:44:37.348293 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 111/268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:36 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:37.357625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:37.359943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:37.369119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.370150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.370836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.371948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.372688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.373674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.595376 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-525079eb-cec5-43d5-bf1f-2e704c234114 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 314 microversion: 2.41 time: 0.321302 Oct 19 00:44:37.596373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 158/269] 10.222.0.27 () {62 vars in 1232 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:37.608191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1994077916"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.623477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.624585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.625393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.641517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.642329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.642983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.653473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1994077916 could not be found. Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 58 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:37.656375 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: {"add_host": {"host": "tempest-nonexist_host-1994077916"}} Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:37.657619 n-d-master-1 devstack@n-api.service[131449]: exception: Compute host tempest-nonexist_host-1994077916 could not be found. Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-1994077916'}}} Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1994077916' is not mapped to any cell Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.658406 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 19 00:44:37.660093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1994077916 could not be found. Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1994077916 could not be found. Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.661208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1994077916 could not be found. Oct 19 00:44:37.664204 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.665032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:37.666189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1994077916 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:37.667325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb2c4013-4df7-4914-8369-6819333ba7da tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 111 microversion: 2.1 time: 0.069769 Oct 19 00:44:37.670891 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 159/270] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:37.673585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52250019-5e4e-4b4e-a8b0-2b20cc59240e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:37.674412 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97bc8d8c-25ae-4542-b718-4643d9fc2f8b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.322884 Oct 19 00:44:37.682922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52250019-5e4e-4b4e-a8b0-2b20cc59240e tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 241 microversion: 2.1 time: 0.013574 Oct 19 00:44:37.684061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 160/271] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:37 2022] GET /compute/v2.1/os-aggregates/10 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:37.688941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7cf6324-d6c0-422f-a10e-bd4ac0668c6e tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.689685 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 112/272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:37 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:37.705683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7cf6324-d6c0-422f-a10e-bd4ac0668c6e tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:37.706569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7cf6324-d6c0-422f-a10e-bd4ac0668c6e tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:37.707400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7cf6324-d6c0-422f-a10e-bd4ac0668c6e tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:37.714963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87cc37d0-2924-47d5-ae47-ae25dec17c08 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:37.796240 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87cc37d0-2924-47d5-ae47-ae25dec17c08 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.104768 Oct 19 00:44:37.800325 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 113/273] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:37 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:37.805936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12e5cd09-143c-4680-86b7-e5691c3889ba tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:37.841961 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12e5cd09-143c-4680-86b7-e5691c3889ba tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.040056 Oct 19 00:44:37.843053 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 114/274] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:37 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:37.851251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4a01e9e-506b-4767-9f23-30e8f2116437 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4a01e9e-506b-4767-9f23-30e8f2116437 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 283 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:37.868792 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.871324 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:44:37.872075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:37.872824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.873764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.874577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:44:37.874577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:44:37.874577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:44:37.874577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.878047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4a01e9e-506b-4767-9f23-30e8f2116437 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:37.880316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4a01e9e-506b-4767-9f23-30e8f2116437 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035957 Oct 19 00:44:37.881566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 115/275] 10.222.0.27 () {60 vars in 1165 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:44:37.890067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d39e4dc2-18ab-454b-995e-1f2c00620d7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885313215", "availability_zone": "tempest-test_az-392528998"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.895436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-d39e4dc2-18ab-454b-995e-1f2c00620d7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 826c7b5e-8a3b-4239-b8d9-4ab4cdca8705 for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:37.955977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d39e4dc2-18ab-454b-995e-1f2c00620d7f tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.073076 Oct 19 00:44:37.961788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 116/276] 10.222.0.27 () {60 vars in 1165 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:37.973961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-870a43fd-df14-44dd-b4c1-73abab3f259c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-870a43fd-df14-44dd-b4c1-73abab3f259c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 27 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:37.977686 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: {"aggregate": {"name": ""}} Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:37.979038 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi '' Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:37.979883 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 00:44:37.981238 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:37.982300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-870a43fd-df14-44dd-b4c1-73abab3f259c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:37.982378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7cf6324-d6c0-422f-a10e-bd4ac0668c6e tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 299 microversion: 2.41 time: 0.296416 Oct 19 00:44:37.984431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 161/277] 10.222.0.27 () {62 vars in 1232 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates/9/action => generated 299 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:37.994118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-961fbbf8-a9a6-49e0-b357-f0160c2521cd tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-885313215_new", "availability_zone": "tempest-test_az-392528998_new"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:37.995410 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-870a43fd-df14-44dd-b4c1-73abab3f259c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016308 Oct 19 00:44:38.002734 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 117/278] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:37 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:44:38.024132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-140289dd-3513-4093-a0d9-7ea53925a138 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.072014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-140289dd-3513-4093-a0d9-7ea53925a138 tempest-AggregatesAdminTestV241-92033634 tempest-AggregatesAdminTestV241-92033634-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.070867 Oct 19 00:44:38.073238 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 118/279] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:44:37 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.087723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6286b727-f183-49f0-98ec-375a7ec513ae tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-508910716"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:38.093202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6286b727-f183-49f0-98ec-375a7ec513ae tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6286b727-f183-49f0-98ec-375a7ec513ae tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 59 Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:38.095196 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: {"aggregate": {"name": "tempest-test_aggregate-508910716"}} Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:38.096420 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-508910716'}}} Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:38.097184 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:38.098225 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 19 00:44:38.101099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.106793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6286b727-f183-49f0-98ec-375a7ec513ae tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:38.108266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6286b727-f183-49f0-98ec-375a7ec513ae tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.033666 Oct 19 00:44:38.109428 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 119/280] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:38.117202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.117971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:38.129515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.130246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.130932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.131764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.132341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.133381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.171333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961fbbf8-a9a6-49e0-b357-f0160c2521cd tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.174358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961fbbf8-a9a6-49e0-b357-f0160c2521cd tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.174574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961fbbf8-a9a6-49e0-b357-f0160c2521cd tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.259454 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-961fbbf8-a9a6-49e0-b357-f0160c2521cd tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 334 microversion: 2.1 time: 0.271584 Oct 19 00:44:38.261940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 162/281] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 00:44:37 2022] PUT /compute/v2.1/os-aggregates/12 => generated 334 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.284308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce2b6348-47af-4993-b884-ca3b565ca520 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-998233534"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:38.310438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-ce2b6348-47af-4993-b884-ca3b565ca520 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 3751fdd3-69c6-416b-99fd-df173357bb5d for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:38.362940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce2b6348-47af-4993-b884-ca3b565ca520 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094597 Oct 19 00:44:38.365671 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 163/282] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.380121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "name": "network-vif-plugged", "status": "completed", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:38.392205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.392945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.393520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.408570 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] Creating event network-vif-plugged:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h1-master-1 Oct 19 00:44:38.414469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-be81320d-790c-44c7-9add-7d3fbc13f0b8 req-60042f02-a555-491a-a4b4-1702211ce176 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041736 Oct 19 00:44:38.415575 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 164/283] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.425400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f523ab23-a00d-41fd-aee2-e497c752891a tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.434829 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f523ab23-a00d-41fd-aee2-e497c752891a tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 551 microversion: 2.1 time: 0.016863 Oct 19 00:44:38.435781 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 165/284] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:44:38 2022] GET /compute/v2.1/os-aggregates => generated 551 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.453407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.455468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:38.469936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:38.470774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.471315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.471778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.472600 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:38.472874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.473322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.474076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.487014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d7a4aa1-3a4a-4772-b201-f4ff5c0ca86e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.375884 Oct 19 00:44:38.497621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 120/285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:38 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:38.519648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30950612-d79c-473d-97eb-6827289302bd", "tag": "9a7d2f16-f420-4b14-8c01-ee20fdec611f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:38.545298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.545856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.546621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.570989 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] Creating event network-changed:9a7d2f16-f420-4b14-8c01-ee20fdec611f for instance 30950612-d79c-473d-97eb-6827289302bd on n-h2-master-1 Oct 19 00:44:38.579305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2e9810e7-d017-41c8-bde6-09a2362d149e req-026fb5fc-bb53-490e-bf62-4a1225df72f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079057 Oct 19 00:44:38.600011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 121/286] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:38.611924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-998233534"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:38.620808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid a67a1cbe-c554-4335-bf52-3cb0923abeaf for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:38.658406 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-998233534 already exists. Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 59 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:38.663448 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: {"aggregate": {"name": "tempest-test_aggregate-998233534"}} Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:38.665911 n-d-master-1 devstack@n-api.service[131450]: exception: Aggregate tempest-test_aggregate-998233534 already exists. Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-998233534'}}} Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 19 00:44:38.668057 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-998233534 already exists. Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:38.670253 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-998233534 already exists. Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-998233534 already exists. Oct 19 00:44:38.672533 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:38.678919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-998233534 already exists. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:38.680764 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47304844-f43b-4044-b2f9-499a29fc4fdd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.078419 Oct 19 00:44:38.682609 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 122/287] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:38.693018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e135dcc-ed2b-424b-a4f2-d26bd692bdd4 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.748176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e135dcc-ed2b-424b-a4f2-d26bd692bdd4 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.063695 Oct 19 00:44:38.750380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 123/288] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:38 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:38.764382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-253452c7-8780-4fb8-b114-e5170220c636 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.815069 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-253452c7-8780-4fb8-b114-e5170220c636 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.055234 Oct 19 00:44:38.821090 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 124/289] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:38 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:38.831741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:38.833501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:38.851790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.852896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.856119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.860362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:38.864911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:38.869249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:38.927297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:38.961749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-914a6eb8-527e-4fbc-ba8c-6ebec08d064a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.522477 Oct 19 00:44:38.980659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 166/290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:38 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:38.997676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83f69c3c-544d-4ba4-a3c8-5be7dbda81ef tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1514372809"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:39.007689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-83f69c3c-544d-4ba4-a3c8-5be7dbda81ef tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Generated uuid 7fb38e10-aa08-42a0-bf4f-e16cbf1931e0 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:39.027177 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:39.039676 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:39.066826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83f69c3c-544d-4ba4-a3c8-5be7dbda81ef tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093622 Oct 19 00:44:39.069632 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 167/291] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:39.091567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bfc9da8e-3e15-4778-a8b9-69e25d48102e tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2126708334"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:39.099917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-bfc9da8e-3e15-4778-a8b9-69e25d48102e tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 0bba0791-ab40-45de-a740-026cf5b296a7 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:39.149156 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bfc9da8e-3e15-4778-a8b9-69e25d48102e tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077341 Oct 19 00:44:39.152532 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 168/292] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:39.169976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e17bef0-fe22-4810-b00c-678c3238ebf1 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.198220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e17bef0-fe22-4810-b00c-678c3238ebf1 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 446 microversion: 2.1 time: 0.043693 Oct 19 00:44:39.208087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 169/293] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/os-aggregates => generated 446 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:39.217995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b727a70-8644-4531-9105-f0298df77400 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.220655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b727a70-8644-4531-9105-f0298df77400 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b727a70-8644-4531-9105-f0298df77400 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:39.222479 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 00:44:39.225078 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '15'} Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:39.227792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.231883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b727a70-8644-4531-9105-f0298df77400 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.240686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b727a70-8644-4531-9105-f0298df77400 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015061 Oct 19 00:44:39.240686 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 170/294] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:39.240686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-caf203ea-1c20-44a2-9220-e4fd01dcc864 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.278371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-caf203ea-1c20-44a2-9220-e4fd01dcc864 tempest-AggregatesAdminTestJSON-1208383445 tempest-AggregatesAdminTestJSON-1208383445-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.050644 Oct 19 00:44:39.280673 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 171/295] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:39.291795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9e637d2-467c-48a8-805a-9fd31094c4cd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.308270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:39.333250 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62e396f4-cc70-4fe4-a17e-d7a146c62e55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.514479 Oct 19 00:44:39.355774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9e637d2-467c-48a8-805a-9fd31094c4cd tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.071995 Oct 19 00:44:39.361879 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 172/296] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:39.367372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 125/297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:38 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:39.371410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.372129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:39.380823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.383542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.383698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35ddd447-c1a9-4c78-820c-1e89bc11cd2d tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.384295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.388319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.389138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.389937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.413774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] HTTP exception thrown: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Request method failure captured: Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c HTTP/1.1 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g7PlqIVdyAr5s0kN-oWfYnY0Jdg2aTnLyyH7a3kywxIMR5zzcGHGTWnAVYd97GTb2Jc0AInvHO6yS9hYHlJaioMV2u4UM2GP2e7-TAi8fa840yCBjKKtRpx4Lk4aqKtQsdwkOaB7TlVmBNBI20EJAVfAinjZ_foed7hoTSwxNl-CE Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:39.416163 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c64d39f0a00b4dab9da6f0ffd2832210", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}] Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: be64be1ba172441eb0ee9a03fabb0bda Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.417447 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e0614923-ce8b-4a4d-8291-1454c0b6af8c'} Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.418120 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.419340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.420544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-35ddd447-c1a9-4c78-820c-1e89bc11cd2d tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 00:44:39.422844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Returning 404 to user: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.424038 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09ccd903-7e10-4662-a40b-acdb0c0a06db tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 404 len: 111 microversion: 2.1 time: 0.060717 Oct 19 00:44:39.428204 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 173/298] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35ddd447-c1a9-4c78-820c-1e89bc11cd2d tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:39.428318 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: exception: Aggregate -1 could not be found. Oct 19 00:44:39.429556 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '-1'} Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:39.430258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.431317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 00:44:39.432999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.434264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35ddd447-c1a9-4c78-820c-1e89bc11cd2d tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.436314 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35ddd447-c1a9-4c78-820c-1e89bc11cd2d tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.066966 Oct 19 00:44:39.437405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 126/299] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:39.450266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.452168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] [instance: e0614923-ce8b-4a4d-8291-1454c0b6af8c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:39.460057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b5daaba-abd7-4fb2-95d6-96fb1f0ca686 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1931235672"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:39.468014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.470432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-5b5daaba-abd7-4fb2-95d6-96fb1f0ca686 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 6c5da045-9ade-42bc-b463-402c474b5c13 for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:39.470942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.472306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.475392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.475880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.476319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.509209 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] HTTP exception thrown: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Request method failure captured: Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c HTTP/1.1 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g7PlqIVdyAr5s0kN-oWfYnY0Jdg2aTnLyyH7a3kywxIMR5zzcGHGTWnAVYd97GTb2Jc0AInvHO6yS9hYHlJaioMV2u4UM2GP2e7-TAi8fa840yCBjKKtRpx4Lk4aqKtQsdwkOaB7TlVmBNBI20EJAVfAinjZ_foed7hoTSwxNl-CE Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:39.515035 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c64d39f0a00b4dab9da6f0ffd2832210", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c64d39f0a00b4dab9da6f0ffd2832210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c64d39f0a00b4dab9da6f0ffd2832210"}]}] Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c64d39f0a00b4dab9da6f0ffd2832210 Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-84783104 Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: be64be1ba172441eb0ee9a03fabb0bda Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminTestJSON-84783104-project Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.516406 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e0614923-ce8b-4a4d-8291-1454c0b6af8c'} Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.517542 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. Oct 19 00:44:39.518627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.520302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b5daaba-abd7-4fb2-95d6-96fb1f0ca686 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.076159 Oct 19 00:44:39.527263 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 127/300] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:44:39.532556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] Returning 404 to user: Instance e0614923-ce8b-4a4d-8291-1454c0b6af8c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.535391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2583de0e-d178-464f-9e5a-2df6cd0aa265 tempest-AggregatesAdminTestJSON-84783104 tempest-AggregatesAdminTestJSON-84783104-project] 10.222.0.27 "GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c" status: 404 len: 111 microversion: 2.1 time: 0.105346 Oct 19 00:44:39.542723 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 174/301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/servers/e0614923-ce8b-4a4d-8291-1454c0b6af8c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:39.544457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.546350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:39.549582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-241c5fb3-371e-44c6-a41a-fa8ed52cf478 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.553043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-241c5fb3-371e-44c6-a41a-fa8ed52cf478 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:39.554011 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=78,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-241c5fb3-371e-44c6-a41a-fa8ed52cf478 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:39.555653 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 00:44:39.557803 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '16'} Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:39.558654 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 19 00:44:39.560024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.563363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-241c5fb3-371e-44c6-a41a-fa8ed52cf478 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.567564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-241c5fb3-371e-44c6-a41a-fa8ed52cf478 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023349 Oct 19 00:44:39.573357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 175/302] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:39.575988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.579868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.580602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.581738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.582431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.583317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28c121fd-0e5b-4e24-ab3b-6d6e6970ee58 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.584150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:39.628381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28c121fd-0e5b-4e24-ab3b-6d6e6970ee58 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.053798 Oct 19 00:44:39.633568 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 176/303] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:39 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:39.638640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae52cbf4-192e-44ac-8f0d-576ff8a1d581 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.655087 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ae52cbf4-192e-44ac-8f0d-576ff8a1d581 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae52cbf4-192e-44ac-8f0d-576ff8a1d581 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:39.660304 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: exception: Aggregate -1 could not be found. Oct 19 00:44:39.661874 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '-1'} Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.662521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 19 00:44:39.663595 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.673346 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae52cbf4-192e-44ac-8f0d-576ff8a1d581 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.674828 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae52cbf4-192e-44ac-8f0d-576ff8a1d581 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.040196 Oct 19 00:44:39.680271 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 177/304] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:39.691007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25e3a7d1-74b6-44c4-8123-7de3fdf3ef35 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:39.693750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-25e3a7d1-74b6-44c4-8123-7de3fdf3ef35 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25e3a7d1-74b6-44c4-8123-7de3fdf3ef35 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:39.700165 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 00:44:39.701872 n-d-master-1 devstack@n-api.service[131449]: action_args: {} Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:39.703649 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:39.706814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25e3a7d1-74b6-44c4-8123-7de3fdf3ef35 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:39.707952 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25e3a7d1-74b6-44c4-8123-7de3fdf3ef35 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021988 Oct 19 00:44:39.713688 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 178/305] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:39.726157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1041514-7627-4753-b47d-f49968d70fe3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2096723564"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:39.732130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.aggregate [None req-a1041514-7627-4753-b47d-f49968d70fe3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid ecd2e772-a45b-4618-afcb-5da9b726c351 for aggregate {{(pid=131449) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:39.781638 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1041514-7627-4753-b47d-f49968d70fe3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065181 Oct 19 00:44:39.782647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 179/306] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:39.797753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1fb70249-d2a0-4680-b784-64774b6df672 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:39.812834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fb70249-d2a0-4680-b784-64774b6df672 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:39.813693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fb70249-d2a0-4680-b784-64774b6df672 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:39.814416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fb70249-d2a0-4680-b784-64774b6df672 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.165567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:40.173256 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1fb70249-d2a0-4680-b784-64774b6df672 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.381961 Oct 19 00:44:40.174294 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 180/307] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:39 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:40.183695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:40.184336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:40.216469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4cae96e-9f96-4414-a9f6-72b86b3d6598 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.690149 Oct 19 00:44:40.217688 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 128/308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:39 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:40.247665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-400c3a90-4825-481f-9d33-aab05bbea604 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:40.266587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.266963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-400c3a90-4825-481f-9d33-aab05bbea604 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '4863c5d0793842d29c6b8f7c69ecd297', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bed859f9c7a4895b8808ce7f2649d6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:40.267477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.268239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.276488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.277448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.281009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-400c3a90-4825-481f-9d33-aab05bbea604 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Request method failure captured: Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 42 Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g8pylpPp13r8uG98JTpNpafMcKzCOB5ys1o-CbQlmKG9wvH0D1XMXx4YYJcENLhhf-6FVrvbdxVY4acRgmp8faBkX35_m2oaIx1WxhxCE25NcQ6OrFXZQ_npi1js3nVx8kmTdHphCwZHOsgX0HntSAr0rYd45qrm0WpcpHiLVuCIM Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:44:40.284477 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3bed859f9c7a4895b8808ce7f2649d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3bed859f9c7a4895b8808ce7f2649d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3bed859f9c7a4895b8808ce7f2649d6b"}]}] Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 3bed859f9c7a4895b8808ce7f2649d6b Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-554775519 Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 4863c5d0793842d29c6b8f7c69ecd297 Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-554775519-project Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: {"remove_host": {"host": "n-h2-master-1"}} Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:40.287113 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-master-1'}}} Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:40.290221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 19 00:44:40.294401 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:40.296705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-400c3a90-4825-481f-9d33-aab05bbea604 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:40.296705 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-400c3a90-4825-481f-9d33-aab05bbea604 tempest-AggregatesAdminNegativeTestJSON-554775519 tempest-AggregatesAdminNegativeTestJSON-554775519-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.063904 Oct 19 00:44:40.296705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 129/309] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 69 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:40.309944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f851043-0852-4f59-91f6-43b7268e2354 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:40.363931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f851043-0852-4f59-91f6-43b7268e2354 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.365423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f851043-0852-4f59-91f6-43b7268e2354 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.366477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f851043-0852-4f59-91f6-43b7268e2354 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.531862 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:40.805595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f851043-0852-4f59-91f6-43b7268e2354 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.500840 Oct 19 00:44:40.809472 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 130/310] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:40 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:40.841861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:40.845277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:40.878948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.879462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.879908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:40.881653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:40.884189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:40.886107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.111109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:41.155704 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea84d5cd-ac6b-4972-82ab-c79ec0737349 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.979452 Oct 19 00:44:41.166620 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 181/311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:40 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:41.200422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4d00b69-5dcc-4fe6-8b7d-f0982a87cb8e tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:41.313906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:41.316411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4d00b69-5dcc-4fe6-8b7d-f0982a87cb8e tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.146619 Oct 19 00:44:41.318566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 182/312] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:41 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:41.325871 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99794862-6e31-4dab-98c9-ad61fd055b50 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1313 microversion: 2.1 time: 0.514399 Oct 19 00:44:41.330891 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 131/313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:40 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:41.338281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57e35a1b-250f-407e-bda7-7f65a29b6387 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1499621118"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:41.342207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-57e35a1b-250f-407e-bda7-7f65a29b6387 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Generated uuid 960f193a-4a33-4e12-8c8e-f6e56b8087ab for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 00:44:41.372140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:41.373185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:41.386496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.387352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.389276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.391416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.392207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.392865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.418887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57e35a1b-250f-407e-bda7-7f65a29b6387 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082269 Oct 19 00:44:41.423506 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 132/314] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 00:44:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:41.449635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:41.473176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.474521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.475434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.490212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:41.495265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:41.504815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:41.524195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.compute.aggregates [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 00:44:41.525177 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Request method failure captured: Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 42 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0g_-PK0pdAEpGM7GD6A1IRFIjEEFMhDZRziRMz9dq3FgM32V-bilvSpb_2dRAzGqYEc2294K-s32JAWf5k0pnBdj9LE0SrCnNDd8OpKeiRQWT-fHLgyMC6OkKo3stjPUpbLUfroQtRn8N47MAIL9AxXSHT00PW6vRUU24yrAvhrRnI Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:44:41.532817 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ed8ecf3ae5ca4ed7a3ca096de9d927d7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ed8ecf3ae5ca4ed7a3ca096de9d927d7"}]}] Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ed8ecf3ae5ca4ed7a3ca096de9d927d7 Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-358591705 Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d1ce97805d904c8f8f29b996ef4ce0a4 Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: {"remove_host": {"host": "nonexist_host"}} Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:44:41.534106 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 19 00:44:41.534837 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 19 00:44:41.535906 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.536998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 19 00:44:41.543093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:44:41.545615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:41.547460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d738a8b9-2898-4336-bcd1-51f7b14c21c3 tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.109409 Oct 19 00:44:41.548784 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 133/315] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 00:44:41 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:44:41.583094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-920d7510-3c8b-41b3-9140-9d79dd59337c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:41.668345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-920d7510-3c8b-41b3-9140-9d79dd59337c tempest-AggregatesAdminNegativeTestJSON-358591705 tempest-AggregatesAdminNegativeTestJSON-358591705-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.112177 Oct 19 00:44:41.669545 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 134/316] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:44:41 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 00:44:42.186096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:42.188338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:42.205811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.206989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.208071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.211168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.212057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.213391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.518687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:42.533456 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dea1d83a-009e-4181-8a04-60b8bef79936 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 1.205671 Oct 19 00:44:42.542062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 183/317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:41 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:42.547656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:42.559688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:42.577946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.578926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.579849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.581591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:42.582280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:42.583053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:42.804828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:42.815245 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8a66650-01a6-4ae1-a5bd-363a11624eb4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.633958 Oct 19 00:44:42.821251 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 135/318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:42 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:43.091660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:43.106537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3baaa4f-c75e-4fe3-b6d9-b43735f5007c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1462 microversion: 2.1 time: 0.560079 Oct 19 00:44:43.107462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 184/319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:42 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1462 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:43.564371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:43.566483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:43.568988 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=24 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:43.585070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.586880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.588805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:43.590639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.592470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.593307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:43.785908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:43.786933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:43.806033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.807708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.808850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:43.809975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:43.812827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:43.815076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:44.135169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:44.145069 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b141715-7653-4e7c-8de5-534c41543d66 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.586201 Oct 19 00:44:44.150944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 185/320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:43 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:44.174827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:44.179789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:44.194315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:44.200869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:44.201585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:44.206311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:44.208167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:44.209231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:44.671977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:44.682084 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ce9526f-3293-4d96-9f95-d69126da797e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.514396 Oct 19 00:44:44.689076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 186/321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:44 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:45.248496 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16719cba-ddb3-4d0e-8d25-4486a52bf02b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1613 microversion: 2.1 time: 2.113244 Oct 19 00:44:45.249091 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 136/322] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:43 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1613 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:45.271869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:45.272514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:45.288324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.289153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.291070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.295143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.295881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.296528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.638824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:45.649295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c1989029-cf61-4c59-ab7d-72adbb8d5ceb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.381242 Oct 19 00:44:45.649946 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 137/323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:45 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:45.668986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a124b96-1795-4584-92f9-201cb18838d9", "name": "network-vif-plugged", "status": "completed", "tag": "f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:45.697294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.699281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.700052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.726199 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] Creating event network-vif-plugged:f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967 for instance 3a124b96-1795-4584-92f9-201cb18838d9 on n-h1-master-1 Oct 19 00:44:45.743339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1084f66a-86cf-41a3-9bdc-b52db99d0613 req-86934365-31a3-49e9-8b40-848a9764a419 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090086 Oct 19 00:44:45.750852 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 138/324] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:45.756348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5ace9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:45.761006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:45.762006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:45.784494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.785455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.786140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.788726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:45.790632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:45.791887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:45.977878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '886050a9ea1a46428ee4927b2e5fdbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fec863e8446128e270320b0ef204d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:45.979088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] flavor_id is None. Assuming migration. {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 00:44:45.979548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 00:44:46.343949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afae5778-9169-4fa9-b0b2-75d95bdbfeb6 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc/action" status: 202 len: 0 microversion: 2.1 time: 0.590909 Oct 19 00:44:46.346518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 139/325] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:44:45 2022] POST /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc/action => generated 0 bytes in 595 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:44:46.362272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:46.364840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:46.386243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.387448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.389661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.396142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.396989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.398843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.707888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.708877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.709391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.710233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.712408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.713049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.862423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:46.882404 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-674d9bc3-6aec-4476-a474-ef8091e0417f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.534374 Oct 19 00:44:46.888894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 140/326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:46 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:46.892583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b637e9c-970f-4765-8d4e-9d43e2909421 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679" status: 200 len: 148 microversion: 2.57 time: 1.855965 Oct 19 00:44:46.893616 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 187/327] 10.222.0.27 () {62 vars in 1303 bytes} [Wed Oct 19 00:44:45 2022] PUT /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679 => generated 148 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:44:46.905848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:46.906558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:46.910215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:46.914914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:46.926367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.927019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.927468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.929418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.930302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.931298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.932560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.933961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:46.934271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.934735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:46.935362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:46.935804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.265569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:47.277150 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d613d32-2e74-4cdc-b462-d559a1be03cd tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1389 microversion: 2.1 time: 0.380315 Oct 19 00:44:47.277766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 188/328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:46 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1389 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:47.306029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Calling method '.version_select at 0x7f2af5ab20d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.500219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:47.516422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83a31fcd-6f81-4028-8b98-5e14f076964e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1471 microversion: 2.1 time: 0.623642 Oct 19 00:44:47.517223 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 141/329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:46 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:47.909488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:47.910108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:47.930789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.933132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.933577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:47.934476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:47.935238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:47.935946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.117627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.120781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.122959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.125260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.134960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.135601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.171832 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:48.202446 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-919c28d4-4494-4fdc-9287-a41edd9f8530 tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679/detail" status: 200 len: 463 microversion: 2.57 time: 0.908078 Oct 19 00:44:48.207192 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 189/330] 10.222.0.27 () {60 vars in 1304 bytes} [Wed Oct 19 00:44:47 2022] GET /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679/detail => generated 463 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:48.307461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:48.308123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:48.325628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.326127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.326576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.327521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.328196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.329058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.574583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:48.617032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-842febb4-0ca9-4fc5-a596-e3df10309dd1 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.708884 Oct 19 00:44:48.619579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 142/331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:47 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:48.638199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:48.641070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:48.670951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.672141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.672954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:48.674239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:48.682569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:48.687493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.103649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:49.135081 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bdeb13a6-f8bd-482f-b82b-ddf9740d70b9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1589 microversion: 2.1 time: 0.827104 Oct 19 00:44:49.150130 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 190/332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:48 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1589 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:49.172074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30950612-d79c-473d-97eb-6827289302bd", "name": "network-vif-plugged", "status": "completed", "tag": "9a7d2f16-f420-4b14-8c01-ee20fdec611f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:49.193912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.194435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.196013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.225726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] Creating event network-vif-plugged:9a7d2f16-f420-4b14-8c01-ee20fdec611f for instance 30950612-d79c-473d-97eb-6827289302bd on n-h2-master-1 Oct 19 00:44:49.242175 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e206fa7b-7e50-4736-833d-a9a54defc104 req-0913fa21-f65f-43ab-bfb4-e287212abe5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089395 Oct 19 00:44:49.243355 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 191/333] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:49.254685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:49.258312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:49.270361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.271632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.272301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.273319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.273989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.274756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.296369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:49.304204 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3591e5e-f84c-4ffa-8da4-b72eae8354ca tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1471 microversion: 2.1 time: 0.678812 Oct 19 00:44:49.317248 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 143/334] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:48 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1471 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:49.321999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5b4e160>, body: {"quota_set": {"ram": "2048"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:49.642118 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad986722-7fed-4f0f-b16f-f49a4b404504 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.396737 Oct 19 00:44:49.649329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 192/335] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:44:49 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9/os-interface => generated 285 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:49.659184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:49.659861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:49.667651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.668284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.668828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:49.669862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:49.671847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:49.672810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.296553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.297135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.297528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.298259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.298722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.299149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.416130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:50.431082 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-713431f8-5af3-493d-8a4b-1fcb6a1af365 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1317 microversion: 2.1 time: 0.776650 Oct 19 00:44:50.434514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.435012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.435452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.436356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.436994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.437601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.448859 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 193/336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:49 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:50.453709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:50.454586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:50.469549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.469942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.470433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.471075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:50.471571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:50.471938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:50.544549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e738704-45a5-4385-b7a8-99150166f85a tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679?user_id=a624ed9281f94cedb0c6d392dfdbc447" status: 200 len: 148 microversion: 2.57 time: 1.226168 Oct 19 00:44:50.551682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 144/337] 10.222.0.27 () {62 vars in 1384 bytes} [Wed Oct 19 00:44:49 2022] PUT /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679?user_id=a624ed9281f94cedb0c6d392dfdbc447 => generated 148 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:50.559983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2899ba6-f9b2-49b8-b9f1-8d23dd1ba65b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] Calling method '.version_select at 0x7f2af5d339d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:51.112213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2899ba6-f9b2-49b8-b9f1-8d23dd1ba65b tempest-QuotasAdminTestV257-161108147 tempest-QuotasAdminTestV257-161108147-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679?user_id=a624ed9281f94cedb0c6d392dfdbc447" status: 200 len: 190 microversion: 2.57 time: 0.558766 Oct 19 00:44:51.116291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 145/338] 10.222.0.27 () {60 vars in 1364 bytes} [Wed Oct 19 00:44:50 2022] GET /compute/v2.1/os-quota-sets/43cab5470a484788965df76c6ea93679?user_id=a624ed9281f94cedb0c6d392dfdbc447 => generated 190 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:51.227351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:51.252381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11e7dd2e-9b2b-46b2-809a-782219cbdf5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1471 microversion: 2.1 time: 0.800659 Oct 19 00:44:51.266016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 194/339] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:50 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1471 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:52.069692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1173508464", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:52.147303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:52.158140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91b9f67c-ebeb-4af6-8840-d7e6ab5b68f9 tempest-AZAdminNegativeTestJSON-496959450 tempest-AZAdminNegativeTestJSON-496959450-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.160446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91b9f67c-ebeb-4af6-8840-d7e6ab5b68f9 tempest-AZAdminNegativeTestJSON-496959450 tempest-AZAdminNegativeTestJSON-496959450-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '964a40ff09e24604b79aec09824fbd3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3806e04d88e4a96be04b3c437abcdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91b9f67c-ebeb-4af6-8840-d7e6ab5b68f9 tempest-AZAdminNegativeTestJSON-496959450 tempest-AZAdminNegativeTestJSON-496959450-project] Request method failure captured: Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0iATssuZyPR5Vyc0BQVyslYncnq7GIYCNskwWMIJkFJUNoA3rCb6mN8Pzysskifs9mc4WxTNa2i4Ha43JCHXwRNms9_4IK_dDM2ua6X5mNWGJ7Ka321oHPMhrG2ne_z5mlDHkCCBl62GbeM2nqGG02I3GVhpFFImhW59B965fh45rg Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a3806e04d88e4a96be04b3c437abcdfe Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AZAdminNegativeTestJSON-496959450 Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:44:52.162504 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a3806e04d88e4a96be04b3c437abcdfe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3806e04d88e4a96be04b3c437abcdfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a3806e04d88e4a96be04b3c437abcdfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a3806e04d88e4a96be04b3c437abcdfe"}]}] Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AZAdminNegativeTestJSON-496959450 Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a3806e04d88e4a96be04b3c437abcdfe Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-496959450 Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AZAdminNegativeTestJSON-496959450-project Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 964a40ff09e24604b79aec09824fbd3e Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AZAdminNegativeTestJSON-496959450-project Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 00:44:52.164016 n-d-master-1 devstack@n-api.service[131449]: action_args: {} Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:44:52.165355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:52.167028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91b9f67c-ebeb-4af6-8840-d7e6ab5b68f9 tempest-AZAdminNegativeTestJSON-496959450 tempest-AZAdminNegativeTestJSON-496959450-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:52.168590 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91b9f67c-ebeb-4af6-8840-d7e6ab5b68f9 tempest-AZAdminNegativeTestJSON-496959450 tempest-AZAdminNegativeTestJSON-496959450-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.897387 Oct 19 00:44:52.173387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 195/340] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:44:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 903 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:44:52.187567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.191696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:52.208997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.209968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.214208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.221522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.222987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.224071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.771636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:52.788738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7951090-4d0b-4da3-b4b3-14d9e400e60e tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1466 microversion: 2.1 time: 0.610125 Oct 19 00:44:52.790398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 196/341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:52 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1466 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:52.798237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:52.799192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:52.808969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.809798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.810807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.812824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.814684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.815539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.877479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:52.878223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:52.879794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:52.880585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:52.881354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:52.901672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.902806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.904214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.905852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:52.906999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:52.907662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:52.939658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Getting quotas for project ec62e1fb72ba44da8443be083f172b90. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:52.946180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Getting quotas for user 0ba955efddd645e8ada9987c22bc52ee and project ec62e1fb72ba44da8443be083f172b90. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:52.966253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:52.971511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:53.060465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b41fdf7-1688-4457-8b94-0c2d06a292af tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.942137 Oct 19 00:44:53.077457 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 146/342] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:44:53.217231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:53.227738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02e41b5b-f92e-4f8d-aee2-7af0520c1331 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1471 microversion: 2.1 time: 0.435055 Oct 19 00:44:53.233150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 197/343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:52 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1471 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:53.255284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:53.255909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:53.267153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.267651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.270488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.271307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:53.271780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:53.272212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:53.586310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1304033080", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "696b9f21-afb6-4919-9bae-ea78136fef02"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:53.719793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] validate_networks() for [('696b9f21-afb6-4919-9bae-ea78136fef02', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:54.222434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:54.248138 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de580b1a-227c-474a-9c98-137281f00428 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 200 len: 1589 microversion: 2.1 time: 1.013848 Oct 19 00:44:54.263746 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 198/344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:53 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 1589 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:54.298205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a124b96-1795-4584-92f9-201cb18838d9", "tag": "f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:54.347937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:54.348794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:54.352390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:54.404011 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] Creating event network-changed:f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967 for instance 3a124b96-1795-4584-92f9-201cb18838d9 on n-h1-master-1 Oct 19 00:44:54.417782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b75b8ed7-7d79-4c3f-84d1-e4a706968331 req-3dfb5f72-49a3-417c-96e1-2b88925f7388 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152542 Oct 19 00:44:54.421081 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 199/345] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:44:55.141414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1767739205", "block_migration": true, "disk_over_commit": false}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:55.145998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:55.189258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.190357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.191128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:55.197635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:55.200241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:55.201186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.115912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:56.117072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:56.117732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:56.118494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:56.119203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:56.169274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.175751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.187566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.197167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.201916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.211649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.314543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:56.323434 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:56.332815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for user a24b98f6af634c61af828bb20ce1e945 and project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:56.371674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:56.379742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:56.410490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lazy-loading 'flavor' on Instance uuid 30950612-d79c-473d-97eb-6827289302bd {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:44:56.502263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] [instance: 30950612-d79c-473d-97eb-6827289302bd] Going to try to live migrate instance to tempest-host-1767739205 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:44:56.507704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87891dbe-2542-40cf-9f53-8101f0c2ff4f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.424737 Oct 19 00:44:56.511347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 147/346] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:44:56.520897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:56.521554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:56.528539 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] HTTP exception thrown: Compute host tempest-host-1767739205 could not be found. Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Request method failure captured: Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd/action HTTP/1.1 Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 107 Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hroLD7H8oUXlYLJn24TXZNV0K99aftuvxc204GR3aFsy9EMSh0Je39vEp2N6Gi6fKnoVixdtkyuXJ7i7C1V1Ddqu4iBY20dR_LIuDv0WhVrsnrexqIePqloTmlafxwsMSVL-ZFFSYwr7jqdLji_lT6Yvh305eoj6MyB-aAUp8XdSM Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4cd0a5bce77f4182967d71e36658224f Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:44:56.535360 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4cd0a5bce77f4182967d71e36658224f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4cd0a5bce77f4182967d71e36658224f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4cd0a5bce77f4182967d71e36658224f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4cd0a5bce77f4182967d71e36658224f"}]}] Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4cd0a5bce77f4182967d71e36658224f Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-LiveMigrationNegativeTest-356801827-project-admin Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a37341e416ed42dfbe9b34a4e5ff2ba9 Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-LiveMigrationNegativeTest-356801827-project-admin Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: {"os-migrateLive": {"host": "tempest-host-1767739205", "block_migration": true, "disk_over_commit": false}} Oct 19 00:44:56.536816 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: exception: Compute host tempest-host-1767739205 could not be found. Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '30950612-d79c-473d-97eb-6827289302bd', 'body': {'os-migrateLive': {'host': 'tempest-host-1767739205', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:44:56.537555 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1767739205 could not be found. Oct 19 00:44:56.538632 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1767739205 could not be found. Oct 19 00:44:56.539797 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1767739205 could not be found. Oct 19 00:44:56.543698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:44:56.545003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.545003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.545003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.545003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.545503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.545503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.545744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Returning 400 to user: Compute host tempest-host-1767739205 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:44:56.546975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-498e55ab-9fe7-42b7-b3ac-060f23fe0fe8 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd/action" status: 400 len: 100 microversion: 2.1 time: 2.123791 Oct 19 00:44:56.547524 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 200/347] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Oct 19 00:44:54 2022] POST /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd/action => generated 100 bytes in 2126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:44:56.558114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:56.558886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:56.580797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.581495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.581965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.592828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.593342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.594082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.597891 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:56.703449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:56.714586 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-541b6c51-5445-42bf-91cb-ff71a5ed294d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1278 microversion: 2.1 time: 0.202042 Oct 19 00:44:56.717424 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 148/348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:56 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:56.729127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-beaf27b6-123d-40c6-8607-d8c1c7e65dbb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:56.731433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-beaf27b6-123d-40c6-8607-d8c1c7e65dbb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:56.883771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-beaf27b6-123d-40c6-8607-d8c1c7e65dbb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:56.899328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-beaf27b6-123d-40c6-8607-d8c1c7e65dbb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1211 microversion: 2.1 time: 0.178215 Oct 19 00:44:56.902537 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 149/349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:56 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1211 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:56.913498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:56.917295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:56.951175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.952109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.968720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:56.971895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:56.972806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:56.985173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.089912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:57.124538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf577cad-5492-4c01-b699-b8123e617ef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.571602 Oct 19 00:44:57.137531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 201/350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:56 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:57.325087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:57.350608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d999e16-0cde-44e1-8ac9-7d69c225203f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1466 microversion: 2.1 time: 0.446411 Oct 19 00:44:57.352132 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 150/351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:56 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1466 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:57.786146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:57.791791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:57.840139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.845198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.847256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.853245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.855588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.858756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.923357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:57.923995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:57.941176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.941701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.942211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:57.943037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:57.949894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:57.951797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.115740 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:58.142019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:58.172975 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:58.176145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62bb0a52-2639-4428-9189-045cbd32bccd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1215 microversion: 2.1 time: 0.256622 Oct 19 00:44:58.184999 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 151/352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:57 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1215 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:44:58.212307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-97177909", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:58.293180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:58.311816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:44:58.319619 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2262c3a-56fd-4080-b172-8b9067bc4a7c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.548632 Oct 19 00:44:58.322939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 202/353] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:57 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:58.354082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:58.358135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:58.379950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.380448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.380910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.382411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.382411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.382878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.788671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:58.802741 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52a41571-4f26-43ba-85a2-f567f2c84b82 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.457964 Oct 19 00:44:58.806083 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 203/354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:58 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:58.941994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:44:58.942964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:44:58.943700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:44:58.944281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:44:58.945420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:44:58.968657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.970369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.972546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:58.974740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:58.975584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:58.976182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.014043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Getting quotas for project b553e8276e214de6b1fa6db1fb52e6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:44:59.020914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Getting quotas for user 97fb5d3a021149d4a90bef39a518ada2 and project b553e8276e214de6b1fa6db1fb52e6a9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:44:59.041451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:44:59.045322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:44:59.092332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1c0abd2a-31a3-44a1-aad0-8571dc093f6d tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] Calling method '.version_select at 0x7f2af5ab2310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.149600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc957b52-f06b-43a5-ac50-964a12294e2a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961812 Oct 19 00:44:59.151482 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1c0abd2a-31a3-44a1-aad0-8571dc093f6d tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.343864 Oct 19 00:44:59.153123 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 152/355] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:44:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:44:59.163497 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 204/356] 10.222.0.27 () {60 vars in 1226 bytes} [Wed Oct 19 00:44:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:59.171689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44eb578b-a32a-4212-8f69-df55cf1f516a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.173085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44eb578b-a32a-4212-8f69-df55cf1f516a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.178126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef421236-a320-4dee-b3c7-88a28703fd32 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5aa44c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:59.301135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44eb578b-a32a-4212-8f69-df55cf1f516a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.314695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44eb578b-a32a-4212-8f69-df55cf1f516a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1217 microversion: 2.1 time: 0.150218 Oct 19 00:44:59.317615 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 153/357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.335538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.340994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.371717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.374940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.379073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.380958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.382124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.385418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.498722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.514175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2826726-a2db-4159-9c9a-d74109d8c8da tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1281 microversion: 2.1 time: 0.192972 Oct 19 00:44:59.515812 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 154/358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.523172 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=2,nova_api:INSERT=7,nova_api:UPDATE=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:44:59.530830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.533337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.554038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.555477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.557759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.563560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.565370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.567811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.608771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef421236-a320-4dee-b3c7-88a28703fd32 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.443829 Oct 19 00:44:59.619018 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 205/359] 10.222.0.27 () {62 vars in 1247 bytes} [Wed Oct 19 00:44:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:59.633838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5024851e-a221-4c7b-aded-ea19b9d69422 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] Calling method '.version_select at 0x7f2af59c5430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.659739 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5024851e-a221-4c7b-aded-ea19b9d69422 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.036404 Oct 19 00:44:59.660791 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 206/360] 10.222.0.27 () {60 vars in 1226 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:44:59.673013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f92175ed-878f-4d57-a318-c9af3d266eb1 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] Action: 'update', calling method: .version_select at 0x7f2af58c1700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:44:59.802384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f92175ed-878f-4d57-a318-c9af3d266eb1 tempest-QuotaClassesAdmin257Test-1316823385 tempest-QuotaClassesAdmin257Test-1316823385-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.133497 Oct 19 00:44:59.804028 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 207/361] 10.222.0.27 () {62 vars in 1247 bytes} [Wed Oct 19 00:44:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:44:59.832791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:44:59.838124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:44:59.840244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:44:59.845042 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ac73576-f63f-4d44-aecc-4f5f1775a5b5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.327660 Oct 19 00:44:59.848941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 155/362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:44:59.854936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.856127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.856778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:44:59.857816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:44:59.858658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:44:59.859417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.057289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f953527c-2b73-4559-ac8f-fbe7a36358f2", "tag": "ef2d4087-5fea-45cf-b7bb-bdd33f353e62"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:00.107445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.111562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.112988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.151207 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] Creating event network-changed:ef2d4087-5fea-45cf-b7bb-bdd33f353e62 for instance f953527c-2b73-4559-ac8f-fbe7a36358f2 on n-h2-master-1 Oct 19 00:45:00.163785 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff4048a5-da92-4666-a855-c6e3afb2a93b req-f5403a9b-979a-4a56-bcd9-4fff601479ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117271 Oct 19 00:45:00.166457 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 156/363] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:00.180294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:00.194140 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-360ae13a-1f5e-4ace-823c-5a94dcf1d9f3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.368758 Oct 19 00:45:00.209983 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 208/364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:44:59 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:00.378592 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:00.414511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:00.414511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.414511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.414511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.421601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.423092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.423792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.506204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:00.517702 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53d4cb20-5567-4ce2-a035-e8cdfa28c327 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1221 microversion: 2.1 time: 0.154787 Oct 19 00:45:00.518727 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 157/365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1221 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:00.544944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:00.546005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:00.553703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.554579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.555284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.556716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.557451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.558642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.879693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:00.881234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:00.912979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.917998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.921008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:00.926464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:00.928008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:00.929015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.032704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.056679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f91fc039-fbf9-45ae-991c-dcf90a812977 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1269 microversion: 2.1 time: 0.516334 Oct 19 00:45:01.081371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 209/366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1269 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:01.223806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:01.225364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:01.232948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.233779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.234211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.235084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.236391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.237007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.473584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.533156 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d21f2b6b-5613-4e33-9295-03cad4cb1e99 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.645796 Oct 19 00:45:01.533156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 158/367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:00 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:01.567473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:01.574631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:01.590414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.591713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.592826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.596489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:01.601909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:01.603108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:01.701983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.716585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-367fdbd5-36f1-476d-98e9-0d35b2c5648c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.495950 Oct 19 00:45:01.717739 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 210/368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:01 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:01.848165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:01.859612 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e24dc4dd-626c-4700-86a6-4c9cc441f97f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1277 microversion: 2.1 time: 0.303612 Oct 19 00:45:01.860212 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 159/369] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:01 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:02.104575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:02.109539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:02.132513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.137025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.138355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.142092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.143213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.146618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.345071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:02.357622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a46f1fe-c498-4d35-b61a-883b2f75fdb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.260022 Oct 19 00:45:02.358341 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 211/370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:02 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:02.551199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:02.556509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:02.570479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.572560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.573279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.574294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.575202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.575823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.838933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:02.843352 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:02.861003 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1fd41303-2038-4ae6-93e4-d6d170862f8c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.315624 Oct 19 00:45:02.863445 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 212/371] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:02 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:02.874900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:02.876395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:02.889126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.889766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.890879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.891783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:02.892694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:02.893278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:02.979848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1266003434", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:03.062751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:03.063485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:03.064280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:03.064892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:03.065533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:03.084846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.096676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.097168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.098015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.098859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.099533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.134360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Getting quotas for project c5b69c18338643abba49d008af53c18e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:03.142382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Getting quotas for user 2f399df50fd34de3b8d9c69d8461fc13 and project c5b69c18338643abba49d008af53c18e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:03.161441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:03.164784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:03.192047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.205531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32d77fc5-1437-4758-a7d9-92ebb1e5d50a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.340308 Oct 19 00:45:03.228873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 213/372] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:02 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:03.238038 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:03.239191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:03.248448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.249419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.250386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.251942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.252652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.253279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.260160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-69ba5b3f-ac5b-4f93-b1d3-8972b1818773 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.751549 Oct 19 00:45:03.262227 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 160/373] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:45:03.491673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.516231 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f0cd74b5-d60c-428c-9ade-666e889ca8de tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1275 microversion: 2.1 time: 0.283386 Oct 19 00:45:03.517387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 214/374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:03.536827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:03.538739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:03.652812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.664610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.667069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:03.690727 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd06057f-804c-413e-a3c9-bd15e85d6a83 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1454 microversion: 2.91 time: 0.167598 Oct 19 00:45:03.694947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 215/375] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:03.716126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505afe68-f76e-4a63-9e4a-ee2de533db5a", "tag": "9630d069-1da0-4c40-ad15-19f23f6bf9f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:03.743851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.745026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.753494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f080d532-3abe-40fe-b4b1-4885de3f3d44 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-881501631", "id": 1359421843, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:03.760073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.801496 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] Creating event network-changed:9630d069-1da0-4c40-ad15-19f23f6bf9f6 for instance 505afe68-f76e-4a63-9e4a-ee2de533db5a on n-h1-master-1 Oct 19 00:45:03.806323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f080d532-3abe-40fe-b4b1-4885de3f3d44 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.542234 Oct 19 00:45:03.807100 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 161/376] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:45:03 2022] POST /compute/v2.1/flavors => generated 448 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:03.814123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:03.822841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:03.827962 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-88cb6de5-176f-4c07-a6b7-1f312df29adf req-95d1e9f5-9ca9-4a05-94f0-b174d8a148a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130993 Oct 19 00:45:03.830493 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 216/377] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:03.842802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.858530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.867662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:03.869843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:03.873491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:03.875754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.104378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e262169a-242a-4d3d-929b-65c0e5b77f12 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.120588 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e262169a-242a-4d3d-929b-65c0e5b77f12 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] 10.222.0.27 "GET /compute/v2.1/flavors/1359421843" status: 200 len: 448 microversion: 2.55 time: 0.287931 Oct 19 00:45:04.135431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 217/378] 10.222.0.27 () {60 vars in 1199 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/flavors/1359421843 => generated 448 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:04.146654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.148561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.164869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.166511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.167174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.168154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.168922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.169756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.235074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.246657 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5784183c-a225-4f3c-a039-d1163ac95c91 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.436248 Oct 19 00:45:04.252009 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 162/379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:03 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.264100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45e06a7e-9cb8-4538-bc54-f935ea9bd4ab tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] Action: 'update', calling method: .version_select at 0x7f2af6fcaee0>, body: {"flavor": {"description": "new"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:04.411912 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45e06a7e-9cb8-4538-bc54-f935ea9bd4ab tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1359421843" status: 200 len: 449 microversion: 2.55 time: 0.158852 Oct 19 00:45:04.412574 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 163/380] 10.222.0.27 () {62 vars in 1219 bytes} [Wed Oct 19 00:45:04 2022] PUT /compute/v2.1/flavors/1359421843 => generated 449 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:04.428247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.428823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.448593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.449207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.452367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.454303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.457946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.458693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.464376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.478203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12217c3c-5dff-4d3f-a16e-d3209a08a9f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.341283 Oct 19 00:45:04.479989 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 218/381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.487009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8858b7b-7be3-43bc-bb3d-c0bfded4c7a1 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.520471 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8858b7b-7be3-43bc-bb3d-c0bfded4c7a1 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6589 microversion: 2.55 time: 0.038520 Oct 19 00:45:04.521684 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 219/382] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/flavors/detail => generated 6589 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:04.542981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.544119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.561138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.562064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.562732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.563751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.564492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.565240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.674203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.691395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20bb1c78-cc36-426a-b534-fb95fd1d77c7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1275 microversion: 2.1 time: 0.154954 Oct 19 00:45:04.695470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 220/383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1275 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:04.711492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b3a3fc3-d6ee-470f-8068-9985fdc4f7b1 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.757434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:04.777798 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b3a3fc3-d6ee-470f-8068-9985fdc4f7b1 tempest-FlavorsV255TestJSON-1988495245 tempest-FlavorsV255TestJSON-1988495245-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.55 time: 0.080272 Oct 19 00:45:04.778676 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6ceb53b-33af-4900-8c04-e2c8c897f105 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.355304 Oct 19 00:45:04.779658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 221/384] 10.222.0.27 () {60 vars in 1166 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:04.792398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 164/385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:04.801149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.804221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:04.807771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f32b69bb-690d-4c8c-816b-9e8c88731112 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.824818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.828158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.828875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.831359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:04.833507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:04.837149 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f32b69bb-690d-4c8c-816b-9e8c88731112 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1359421843" status: 202 len: 0 microversion: 2.55 time: 0.042865 Oct 19 00:45:04.838323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:04.841209 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 165/386] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Oct 19 00:45:04 2022] DELETE /compute/v2.1/flavors/1359421843 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:04.857184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47fb89f2-dc82-41e2-8b8d-edbb58b23d75 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:04.924088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47fb89f2-dc82-41e2-8b8d-edbb58b23d75 tempest-FlavorsV255TestJSON-146136715 tempest-FlavorsV255TestJSON-146136715-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6150 microversion: 2.55 time: 0.073952 Oct 19 00:45:04.929350 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 166/387] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/flavors/detail => generated 6150 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:05.069925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.106561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.111819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.128226 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd8a0b73-bf79-4f9e-98f0-f39393f5b05d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1506 microversion: 2.91 time: 0.346253 Oct 19 00:45:05.131040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 222/388] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:04 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:05.286539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.289381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.325577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.330594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.331443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.335394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.338914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.340754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.507033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.507702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.529056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.529794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.531078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.532242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.533066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.533681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.770662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.786477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:05.787349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-671baacc-82d0-4cec-a970-016b0b2be6a8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.510229 Oct 19 00:45:05.788004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 167/389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:05.793291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.803254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.812039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4690e504-9da5-4ead-a596-245b549797e1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.309188 Oct 19 00:45:05.819867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.820651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.822674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.825231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 223/390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:05.825484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.826127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.827444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.834802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:05.835481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:05.843238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.843740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.844729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:05.849550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:05.850183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:05.850632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.141889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.151514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87293f7a-aa50-4789-88f9-7cadf483815d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.362173 Oct 19 00:45:06.152811 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 168/391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:06.177912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:06.178878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:06.186918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.187889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.188328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.189189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.189863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.190491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.246172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.263989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a3997a8-52a9-44d0-95d1-b938e05a38d6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.435006 Oct 19 00:45:06.265800 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 224/392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:05 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:06.392945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.434250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.437270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:06.451142 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:06.453540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-962db837-7157-4b58-8794-525d35159d0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1506 microversion: 2.91 time: 0.285495 Oct 19 00:45:06.468843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 169/393] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:06 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:06.695310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "730e86a4-449e-46d6-9954-4aa482150258", "tag": "a794fa0e-49de-4b77-b96a-19d811bcc6fe"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:06.728023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.729643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.731648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.760603 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] Creating event network-changed:a794fa0e-49de-4b77-b96a-19d811bcc6fe for instance 730e86a4-449e-46d6-9954-4aa482150258 on n-h2-master-1 Oct 19 00:45:06.772270 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e87f92ee-24d5-42f9-ae27-9da3559ff48c req-5e64cffb-7b67-4a33-86de-31ccdf920aa9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080792 Oct 19 00:45:06.779818 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 225/394] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:06.816154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:06.817621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:06.829157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.830085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.830665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.831494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.832247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.833276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.846851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:06.849416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:06.876031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.876992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.877822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:06.879686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:06.880897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:06.882112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.145009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.156341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c340b0b7-eee7-4f68-b145-89dc7f5db85a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.343742 Oct 19 00:45:07.159680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 170/395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:06 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.165231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f953527c-2b73-4559-ac8f-fbe7a36358f2", "name": "network-vif-plugged", "status": "completed", "tag": "ef2d4087-5fea-45cf-b7bb-bdd33f353e62"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:07.190781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.191585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.191817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.192080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.206002 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] Creating event network-vif-plugged:ef2d4087-5fea-45cf-b7bb-bdd33f353e62 for instance f953527c-2b73-4559-ac8f-fbe7a36358f2 on n-h2-master-1 Oct 19 00:45:07.209541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a946a70-181d-43f0-83e9-bbdaa7b4c34d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.370877 Oct 19 00:45:07.211345 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 226/396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:06 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.219874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-474b7d04-44f5-4373-9ddb-5e913029c7a5 req-708ae63e-0766-4dd8-8d88-2b0ac9ad6728 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058099 Oct 19 00:45:07.227230 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 171/397] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:07.236787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.237589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:07.245701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.246403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.246943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.247766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.249219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.256897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.420998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.429611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffe40a62-178c-4388-adb3-0d919e8f8d01 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.199505 Oct 19 00:45:07.445074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 172/398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.445074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.445074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:07.449032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.449770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.450738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.452118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.453154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.453722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.634987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Action: 'update', calling method: .version_select at 0x7f2af584d0d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:07.687835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.695091 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:07.702536 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3715ea92-6e88-4f63-84af-47da14a9cbd6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.270752 Oct 19 00:45:07.717193 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 173/399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:07.725430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.726008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:07.730126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.730989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.731112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.731876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.732335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.732799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.733298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.733808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.734820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.734964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.735437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.735870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.811734 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8dcd32bd-134a-46d0-ab61-6a7580ff0416 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0" status: 200 len: 240 microversion: 2.36 time: 0.597691 Oct 19 00:45:07.812283 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 227/400] 10.222.0.27 () {62 vars in 1303 bytes} [Wed Oct 19 00:45:07 2022] PUT /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0 => generated 240 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:07.826868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Calling method '.version_select at 0x7f2af5aa4940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:07.830885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.840767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.842156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:07.847763 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8dc9b5f9-bacc-484b-99ea-21002e266626 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1512 microversion: 2.91 time: 0.129394 Oct 19 00:45:07.848484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 174/401] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:07.901258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.902395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.902998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.903853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:07.904498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:07.905257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:07.933752 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c63b2467-6012-45f3-81d9-4002f129e3c6 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0/detail" status: 200 len: 672 microversion: 2.36 time: 0.110726 Oct 19 00:45:07.934790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 228/402] 10.222.0.27 () {60 vars in 1304 bytes} [Wed Oct 19 00:45:07 2022] GET /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0/detail => generated 672 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:45:08.109753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Action: 'update', calling method: .version_select at 0x7f2af59b9f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:08.191932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.192882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.202655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.203040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.203523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.204566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.205230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.205694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.366680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.367299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.367987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.368939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.369485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.370210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.402659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.411370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.412009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.412608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.413458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2bb5eabe-ff64-43f3-a853-49882fce7eb7 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.225962 Oct 19 00:45:08.413608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.427534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.428301 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 229/403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.428385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.428459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.428459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.440089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.440307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.440885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.442503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.442981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.443715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.486860 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-427df6da-25e8-40e5-a363-e49ec3c622fc tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0?user_id=8fef55cd8fdc41668c71a4918e113c7b" status: 200 len: 240 microversion: 2.36 time: 0.381159 Oct 19 00:45:08.487564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 175/404] 10.222.0.27 () {62 vars in 1384 bytes} [Wed Oct 19 00:45:08 2022] PUT /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0?user_id=8fef55cd8fdc41668c71a4918e113c7b => generated 240 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:08.492481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.493866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.500867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.501484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.502086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.502941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.503496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.504260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.667898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.675961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2c7d920-6f13-477b-a088-edb4c3c2ad12 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1320 microversion: 2.1 time: 0.260876 Oct 19 00:45:08.676548 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 230/405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.688814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc35b978-c82a-48ae-9fb9-d938a30bbe33 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] Calling method '.version_select at 0x7f2af6182820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.705328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.717328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4adb0b1-4c55-4021-b709-3b0b537cd7ee tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.228611 Oct 19 00:45:08.718166 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 176/406] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:08.731563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.732241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.739103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.739783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.740233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.740982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.741447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.741879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.912601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:08.930553 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d756a92-e978-4f27-a357-4203da52ffbf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.203900 Oct 19 00:45:08.931739 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 177/407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:08.936770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:08.942031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:08.954884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.955625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.956232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:08.957261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:08.957888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:08.958477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.049139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.061262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.062730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.067853 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17b3a9f8-9ef6-4101-b78a-c56d1c3b1e9f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1512 microversion: 2.91 time: 0.134945 Oct 19 00:45:09.069359 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 178/408] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1512 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:09.075111 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc35b978-c82a-48ae-9fb9-d938a30bbe33 tempest-QuotasAdminTestV236-1561812644 tempest-QuotasAdminTestV236-1561812644-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0?user_id=8fef55cd8fdc41668c71a4918e113c7b" status: 200 len: 282 microversion: 2.36 time: 0.397301 Oct 19 00:45:09.076200 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 231/409] 10.222.0.27 () {60 vars in 1364 bytes} [Wed Oct 19 00:45:08 2022] GET /compute/v2.1/os-quota-sets/91f2d5cc332744da99f3f1ea042b88d0?user_id=8fef55cd8fdc41668c71a4918e113c7b => generated 282 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:09.450029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.450772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.466327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.466865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.469539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.470313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.470791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.471231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.703126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.704373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.708664 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:UPDATE=8,nova_api:SELECT=90,nova_api:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:09.710885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:09.721884 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-380ed972-cf96-4a03-bfc7-d275163be5e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.278255 Oct 19 00:45:09.722010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.722406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.722886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 179/410] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:09.724857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.725690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.726175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.726620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.748607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:09.749270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:09.757303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.757797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.758362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.759367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:09.759929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:09.760362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:09.987480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.004832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddb867f2-7029-41ef-a3a3-a835f282321a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1469 microversion: 2.1 time: 0.306755 Oct 19 00:45:10.008419 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 232/411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1469 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:10.009936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.019261 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96683869-608d-4291-b02f-5b6f63cef714 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.281000 Oct 19 00:45:10.020663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.021315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.033039 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 180/412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:09 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:10.038262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.042167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.042857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.043801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.046208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.047928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.254334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.270788 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.257715 Oct 19 00:45:10.272322 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 233/413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:10.282728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.283919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef2c1472-b213-485c-b854-e3e987325ccd tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001612 Oct 19 00:45:10.284351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 234/414] 10.222.0.27 () {56 vars in 886 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 00:45:10.292467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.293918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.304010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.305746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.306491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.308435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.309414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.310110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.404999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.406523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.418369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.419349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.420251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.421863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.423026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.423933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.438322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.449809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.451535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.463839 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-665204a3-657e-4d3a-a4f0-e2a020ddbe0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1533 microversion: 2.91 time: 0.176542 Oct 19 00:45:10.465090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 235/415] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1533 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:10.481806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:10.664527 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3af336b9-d865-4cfe-a97a-99cf2956ee5e tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 204 len: 0 microversion: 2.1 time: 0.630085 Oct 19 00:45:10.665952 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 181/416] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:10 2022] DELETE /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:10.675891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.676662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.685258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.685906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.686482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.687303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.687987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.688832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.801059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:10.801686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:10.814587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.815625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.816069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.817437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:10.818254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:10.819914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:10.973945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:10.985259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lazy-loading 'services' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:10.995349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b424399-bf85-4e58-9070-fee4b361f17b tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1475 microversion: 2.1 time: 0.324548 Oct 19 00:45:10.996678 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 182/417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1475 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:11.004409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.005288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.015208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.016105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.017108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.018563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.020216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.021085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.092880 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc486efe-de3b-4114-ba0c-9d0712ea9ca1 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1938 microversion: 2.91 time: 0.603362 Oct 19 00:45:11.094071 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 236/418] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1938 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:11.099054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "505afe68-f76e-4a63-9e4a-ee2de533db5a", "name": "network-vif-plugged", "status": "completed", "tag": "9630d069-1da0-4c40-ad15-19f23f6bf9f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:11.110114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.111016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.111792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.129648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] Creating event network-vif-plugged:9630d069-1da0-4c40-ad15-19f23f6bf9f6 for instance 505afe68-f76e-4a63-9e4a-ee2de533db5a on n-h1-master-1 Oct 19 00:45:11.142989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-71843103-b5f3-421f-85db-c22dbc8a3d6e req-5da0fe2e-9104-45b3-88cb-66f06640dc4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047429 Oct 19 00:45:11.144546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 237/419] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:11.155311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.156351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.165769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.166967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.167630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.168589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.169453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.170312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.203554 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:11.263314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.272202 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d710431d-bdec-42a4-9319-1b75f0cd020f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.273932 Oct 19 00:45:11.272825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 183/420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:10 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:11.279938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.280865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.287158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.287919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.288778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.289719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.290716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.291331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.367067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.376868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4ff908e5-dfa8-4779-8c6e-ab808c012701 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.230946 Oct 19 00:45:11.377451 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 238/421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:11.382433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.383281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.390420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.391004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.391506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.392287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.393209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.393892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.442529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lazy-loading 'services' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:11.512605 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b56767d4-2fe1-40f6-99a1-91e87c7a184f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1938 microversion: 2.91 time: 0.237259 Oct 19 00:45:11.513618 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 184/422] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1938 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:11.542477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.547739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.548609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.549387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.551282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.552145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.553409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.564297 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=21 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:11.588782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b7d63ab5-590a-4a33-a535-2a1f34cd2381 tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.050648 Oct 19 00:45:11.590730 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 185/423] 10.222.0.27 () {60 vars in 1217 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:11.602255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:11.603114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.604072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:11.610747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.611169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.611947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.612658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ca44e17f-0087-4414-8a7b-229fc261663b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.233824 Oct 19 00:45:11.613369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.613890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.614647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.628999 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 239/424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:11.641769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lazy-loading 'flavor' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:11.949962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93ef827f-ba4f-4132-8d28-1220c89884c1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action" status: 202 len: 0 microversion: 2.91 time: 0.351784 Oct 19 00:45:11.950569 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 186/425] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:45:11 2022] POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:11.959396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:11.960144 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:11.968041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.968759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.969361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:11.970133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:11.970686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:11.971336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.026359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.027029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.034600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.035052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.035437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.036337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.036842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.037428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.064463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.064989 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:12.074339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.076123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.081949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b21ff43d-5799-4dd6-b3ed-f971c01d7679 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.126457 Oct 19 00:45:12.082757 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 240/426] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:11 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:12.239556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.256110 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7a6cf75f-dcaf-4d95-ac60-275d2083e9fc tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1475 microversion: 2.1 time: 0.234529 Oct 19 00:45:12.258496 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 187/427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1475 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:12.297188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.298334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.306658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.307645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.308094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.308876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.309785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.310231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.401399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.402315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.409456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.410175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.411198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.412128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.412849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.413480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.631375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.640092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-acbdf5a2-ec44-4743-b25a-700f1656c45c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1311 microversion: 2.1 time: 0.347517 Oct 19 00:45:12.645384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 241/428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1311 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:12.659582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:12.660222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:12.677477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.677914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.678359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.679524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:12.679995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:12.684104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:12.842776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.856382 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c07efaa-2289-47d6-a1b3-d660a2855d70 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.460879 Oct 19 00:45:12.869130 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 188/429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:12.939169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:12.955213 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63b9f16a-7b34-4343-aef9-4304b4476f3b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.308556 Oct 19 00:45:12.958006 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 242/430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:12 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:12.986655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f953527c-2b73-4559-ac8f-fbe7a36358f2", "name": "network-vif-deleted", "tag": "ef2d4087-5fea-45cf-b7bb-bdd33f353e62"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:13.006021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.006942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.007649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.031197 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] Creating event network-vif-deleted:ef2d4087-5fea-45cf-b7bb-bdd33f353e62 for instance f953527c-2b73-4559-ac8f-fbe7a36358f2 on n-h2-master-1 Oct 19 00:45:13.042715 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-aa73faf6-1de4-4514-98a3-8eac82bdc071 req-c7d0b746-f8b0-490e-b392-31a4a0d42dd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068409 Oct 19 00:45:13.044176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 189/431] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:13.115820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.116936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.129381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.130781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.131410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.132892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.134368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.135077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.236969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.246630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.248280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.255422 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68bb52bd-c335-4f48-a8aa-59704f4fae91 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.147663 Oct 19 00:45:13.261405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 243/432] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:13.282384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.283177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.310527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.311106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.311578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.312741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.313391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.314032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.355732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.356218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.356675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.357126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid f953527c-2b73-4559-ac8f-fbe7a36358f2 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:13.421732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.436852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b083174-d919-4911-a04d-f28746c8c952 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 200 len: 1310 microversion: 2.1 time: 0.159887 Oct 19 00:45:13.437449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 190/433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 1310 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:13.668163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.669403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.678589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.679401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.680692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.682072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.683117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.683984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.872443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:13.885994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:13.886628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:13.899511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.900014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.900457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.901202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:13.901662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:13.902095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:13.903903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-337e2b05-7e00-4473-931a-c32b5043b7c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1494 microversion: 2.1 time: 0.239502 Oct 19 00:45:13.904506 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 244/434] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:14.097294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.107127 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a32660b-47e7-4c58-b015-16c9de8cc339 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.226444 Oct 19 00:45:14.108224 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 191/435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:14.113304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.113955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.121581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.123088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.124988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.126193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.127154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.128097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.282868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.291500 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5fd5b54-d463-45e6-bd1d-76a5a40046ea tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.182090 Oct 19 00:45:14.292907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 192/436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:14 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:14.351361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.353126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.362521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.363233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.363721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.364453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.364941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.365575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.421159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1253410227", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:14.478704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:14.806543 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b22c753-e405-442c-b87c-f831250332ea tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1645 microversion: 2.1 time: 0.878346 Oct 19 00:45:14.807973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 245/437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:13 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1645 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:14.813475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.814328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.820493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.821865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.822457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.823405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.824059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.824720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.907698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:14.908182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:14.908577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:14.909014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:14.909429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:14.920100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.920582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.921052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.921775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.922227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.922796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.928250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.937388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.939354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:14.941529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Getting quotas for project 517bd155a3d544e08fef047741fb70ce. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:14.944510 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-187c37b4-5230-4267-a362-10e27208a6cb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.135204 Oct 19 00:45:14.945334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 246/438] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:14 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:14.951195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:14.951806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:14.960191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Getting quotas for user b2a833999fff49a8a3601a6ab56349e9 and project 517bd155a3d544e08fef047741fb70ce. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:14.961009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.962234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.962802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.963611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:14.964141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:14.964659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:14.978976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:14.981781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:14.984112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 HTTP/1.1 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:45:14.985938 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:14.988441 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f953527c-2b73-4559-ac8f-fbe7a36358f2'} Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:14.990020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:14.995461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:14.998724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:14.998724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68a53f27-ea25-4c8f-b8e3-f44e3ada68a6 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 404 len: 111 microversion: 2.1 time: 0.040325 Oct 19 00:45:14.998724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 247/439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:14 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:14.998724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730e86a4-449e-46d6-9954-4aa482150258", "name": "network-vif-plugged", "status": "completed", "tag": "a794fa0e-49de-4b77-b96a-19d811bcc6fe"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:15.018606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.020556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.021420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.037677 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] Creating event network-vif-plugged:a794fa0e-49de-4b77-b96a-19d811bcc6fe for instance 730e86a4-449e-46d6-9954-4aa482150258 on n-h2-master-1 Oct 19 00:45:15.044142 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6ff9993a-e479-4b0a-861f-2223ea465697 req-e6f55f9b-e462-4057-b0e8-9720d0826f5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054946 Oct 19 00:45:15.052940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 248/440] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:15.056603 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0ca789d-f412-4ee7-9e24-b55c6c625574 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762265 Oct 19 00:45:15.057336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 193/441] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:15.064404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.065195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.070029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ec22d31-8347-46dd-a9c7-f65eb45b2769 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.071625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ec22d31-8347-46dd-a9c7-f65eb45b2769 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.076468 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:15.088240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.088760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.089214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.090066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.090530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.095261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.178473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ec22d31-8347-46dd-a9c7-f65eb45b2769 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.193121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ec22d31-8347-46dd-a9c7-f65eb45b2769 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1223 microversion: 2.1 time: 0.127666 Oct 19 00:45:15.194709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 194/442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:15.206095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.207681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.222184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.223463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.224531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.226126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.227507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.228613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.363580 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40cf70dc-600e-4f85-9570-3d723bc32150 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1645 microversion: 2.1 time: 0.309121 Oct 19 00:45:15.364433 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 249/443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1645 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:15.426702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.435039 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e84e7a81-4283-4779-aff9-e78ec7f6f954 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1317 microversion: 2.1 time: 0.237593 Oct 19 00:45:15.435889 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 195/444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:15.457234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1159911625", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:15.507662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8640465-7559-4bbb-a781-a70a73426571 tempest-InstanceUsageAuditLogTestJSON-801000734 tempest-InstanceUsageAuditLogTestJSON-801000734-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.526347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:15.530800 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8640465-7559-4bbb-a781-a70a73426571 tempest-InstanceUsageAuditLogTestJSON-801000734 tempest-InstanceUsageAuditLogTestJSON-801000734-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 00:45:15" status: 200 len: 318 microversion: 2.1 time: 0.164790 Oct 19 00:45:15.531673 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 250/445] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2000%3A45%3A15 => generated 318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:15.537229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.538118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.544550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.545006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.545442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.546147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.546604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.547035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.766069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:15.777971 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0eb312a0-5c4e-4abc-ac3e-a114beb99ae9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.244859 Oct 19 00:45:15.778572 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 251/446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:15.783203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.787154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.787641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.788274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.789067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.789557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.789987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.816783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:15.817013 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91c646eb-f3f7-4693-be2d-6df29b278d5a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037103 Oct 19 00:45:15.817855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:15.818003 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 252/447] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:15.818303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:15.818926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:15.819482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:15.823984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-24c1d2bd-3154-42bb-84be-a2234bb4f50e tempest-InstanceUsageAuditLogTestJSON-801000734 tempest-InstanceUsageAuditLogTestJSON-801000734-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.831880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.832543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.833081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.833899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.834439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.834953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.837815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-24c1d2bd-3154-42bb-84be-a2234bb4f50e tempest-InstanceUsageAuditLogTestJSON-801000734 tempest-InstanceUsageAuditLogTestJSON-801000734-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018950 Oct 19 00:45:15.838399 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 253/448] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:15.842820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:15.845883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:15.851414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.852062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.852497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.853569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:15.853678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:15.854081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:15.856277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Getting quotas for project ec62e1fb72ba44da8443be083f172b90. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:15.861523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Getting quotas for user 0ba955efddd645e8ada9987c22bc52ee and project ec62e1fb72ba44da8443be083f172b90. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:15.875007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:15.877281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:15.880649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lazy-loading 'flavor' on Instance uuid 505afe68-f76e-4a63-9e4a-ee2de533db5a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:15.894986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Going to try to live migrate instance to n-h2-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:45:15.926174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-975d4158-1859-49a4-9c44-44ff0996e0f1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.473083 Oct 19 00:45:15.932932 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 196/449] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:15.943107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60f131fa-0cd0-4a32-b282-2ab6f67ee14e tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:15.943728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60f131fa-0cd0-4a32-b282-2ab6f67ee14e tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.043185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60f131fa-0cd0-4a32-b282-2ab6f67ee14e tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.059717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60f131fa-0cd0-4a32-b282-2ab6f67ee14e tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1220 microversion: 2.1 time: 0.123760 Oct 19 00:45:16.078500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 197/450] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:15 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:16.084176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.085701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.111377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.113505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.114318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.115257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.116723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.118192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.229485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.240792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.251662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.264945 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5a6bafff-b29b-46ef-8c43-60d0f363a511 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.184466 Oct 19 00:45:16.268256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 198/451] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:16.278817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.280502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.295348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.296233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.298059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.299807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.301053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.302469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.406989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.424681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-919a66a9-1db5-4d3a-995f-7d5bd26114ca tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1219 microversion: 2.1 time: 0.154299 Oct 19 00:45:16.426351 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 199/452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:16.477913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.478394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.499493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.501168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.502057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.503738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.505368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.505855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.936862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:16.959324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0eeaa9a5-db0f-48e6-85f3-6fecb0e779b8 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1467 microversion: 2.1 time: 0.501017 Oct 19 00:45:16.960425 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 200/453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1467 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:16.970553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:16.973262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:16.985873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.986875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.987857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:16.989436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:16.990318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:16.991185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.256937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.266440 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08f22a12-7456-4d8b-863f-d4765c124a24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1476 microversion: 2.1 time: 0.303741 Oct 19 00:45:17.267105 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 201/454] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:16 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1476 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:17.271557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:17.272094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.281405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.281895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.282334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.283027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.283475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.283901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.316306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lazy-loading 'flavor' on Instance uuid 730e86a4-449e-46d6-9954-4aa482150258 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:17.461858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-166fd14d-48b6-486c-b03a-951c0fc664fb tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258/action" status: 202 len: 0 microversion: 2.1 time: 0.192909 Oct 19 00:45:17.465246 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 202/455] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:17 2022] POST /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:17.479389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:17.480164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.491259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.491764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.492213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.494932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.500553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.501150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.588643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.597409 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7834742e-9de1-4231-a501-4b0c00daf5f3 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1272 microversion: 2.1 time: 0.130696 Oct 19 00:45:17.597975 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 203/456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:17 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:17.603318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:17.603926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.609736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.610190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.610652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.611509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.611978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.612412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.684781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.693513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.694986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.700494 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68c7dc6f-eea4-4b9b-8aa7-bcd08275e083 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.101534 Oct 19 00:45:17.701115 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 204/457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:17 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:17.706242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:17.706814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.713594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.714032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.714475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.715238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.715636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.716063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.795810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:17.803750 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16c30590-ba49-4950-9c89-777da83202eb tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1281 microversion: 2.1 time: 0.101523 Oct 19 00:45:17.804478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 205/458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:17 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:17.826647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:17.828127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:17.834273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.834778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.835214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.835917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:17.837149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:17.837736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:17.842126 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:18.004532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.018839 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-672e7206-d612-4753-ad3b-da6dee1c9a9a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1475 microversion: 2.1 time: 0.199982 Oct 19 00:45:18.022372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 206/459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:17 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:18.316491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.319570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.349776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.350275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.356122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.358686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.359173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.365040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.677729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.693304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d97220d7-ed0b-4eee-9bdd-2305b5650f2a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1475 microversion: 2.1 time: 0.400230 Oct 19 00:45:18.693953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 207/460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:18.702112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "name": "network-vif-unplugged", "status": "completed", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:18.717905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.723304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.728203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.751167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Creating event network-vif-unplugged:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h2-master-1 Oct 19 00:45:18.774535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] Instance c6586352-0a39-4899-96f3-8d10855a64fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:45:18.787055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-159a180c-c044-4909-91a4-f1e5e273773b req-018f9574-faee-40c5-bc1a-1764dd23fa57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091614 Oct 19 00:45:18.788892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 208/461] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:18.795167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.796236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.803645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.804474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.805817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.806936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.807596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.808116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.894597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12f472b1-6e43-47d6-b7b9-9af7933cae2a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a/action" status: 202 len: 0 microversion: 2.1 time: 3.055039 Oct 19 00:45:18.899482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:18.900118 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 254/462] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:15 2022] POST /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a/action => generated 0 bytes in 3061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:18.908885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.909737 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4b3b53c-d79f-4dad-ba65-fb92c4271121 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1278 microversion: 2.1 time: 0.118593 Oct 19 00:45:18.910822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 209/463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:18.912357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.916738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:18.917524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:18.923921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.924850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.925530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.926683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.927565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.928420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.929019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.929552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.930118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:18.930355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:18.931923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:18.932560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.066666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.075978 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4de08977-e322-4351-9110-ef50516a01ac tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1281 microversion: 2.1 time: 0.163893 Oct 19 00:45:19.077515 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 210/464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:19.090101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.097181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.105537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.112502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.115864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.124346 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27b629aa-aa78-4210-9a23-67d29593032a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.221915 Oct 19 00:45:19.125344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 255/465] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:18 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:19.131872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.133280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.134025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.134530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.134978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.135705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.136165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.136658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.143565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.144425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.145101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.146117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.147283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.147912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.607435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.626875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:19.637434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae9722b3-da6f-4189-a154-45eff5b55692 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.557824 Oct 19 00:45:19.638420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 211/466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:19.639876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f95ff05-eb7a-4142-817c-05087a60ea2c tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1458 microversion: 2.1 time: 0.512819 Oct 19 00:45:19.640733 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 256/467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1458 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:19.662716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.663327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.670483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.671031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.671667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.672561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.673253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.673686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.723854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:19.724479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:19.734496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.735372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.736060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.737049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:19.737815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:19.738577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:19.744514 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:20.291335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.302935 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3435cf8-9031-446a-b4c0-35c2eb290e34 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1475 microversion: 2.1 time: 0.582948 Oct 19 00:45:20.304011 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 257/468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:20.327776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.331249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:20.347352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.347845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.386995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.388666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.391195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.392055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.491315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.501432 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3be28891-e9e8-49ed-83b2-1f3100a74f4f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1278 microversion: 2.1 time: 0.195292 Oct 19 00:45:20.503010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 258/469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:20.509332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.510896 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:20.521847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.522754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.523197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.523992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.524445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.525663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.638424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ed11d61-6594-4e40-8fee-f7ca45b401e9 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1609 microversion: 2.1 time: 0.979173 Oct 19 00:45:20.639415 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 212/470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:19 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1609 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:20.644386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.645042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:20.660680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.667550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.668189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.669886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.670554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.671147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.808410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.843631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.848011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.855441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:20.857272 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-465b1999-8336-4028-aea8-da8bc65e1165 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.352701 Oct 19 00:45:20.875930 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-767dbc4d-1084-49be-a5c9-82c67eb5fec0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.221420 Oct 19 00:45:20.875930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 213/471] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:20.877052 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 259/472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:20.883451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.887465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.888189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.888659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.889423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.889874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.890299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.917221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f1c3434-0d14-4479-bab6-b565d688e750 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038669 Oct 19 00:45:20.917844 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 260/473] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:20.922621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:20.923334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:20.930529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.931343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.931855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:20.932657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:20.933329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:20.933828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.027133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1411179375", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:21.114350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:21.169390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:21.193483 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-492329af-0501-42a6-99ca-4823b50b0a27 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.273613 Oct 19 00:45:21.209655 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 261/474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:20 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:21.237551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:21.258832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.261246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.261954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.286538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Creating event network-changed:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h2-master-1 Oct 19 00:45:21.313856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] Instance c6586352-0a39-4899-96f3-8d10855a64fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:45:21.340245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3f0c654a-7f65-4b80-81c4-10aef338087b req-e5271fcd-1839-4d4b-8337-d31f03b88be4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127425 Oct 19 00:45:21.342633 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 262/475] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:21.356803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:21.361443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:21.378090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.378613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.379058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.379803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.380266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.380973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.406247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:21.406666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:21.407491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:21.409151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:21.410550 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:21.419770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Lazy-loading 'flavor' on Instance uuid 730e86a4-449e-46d6-9954-4aa482150258 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:21.421280 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=73 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:21.424390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.425130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.425724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.426680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.427141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.427568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.442197 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 730e86a4-449e-46d6-9954-4aa482150258 while it is in vm_state suspended Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Request method failure captured: Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258/action HTTP/1.1 Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 97 Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hroLD7H8oUXlYLJn24TXZNV0K99aftuvxc204GR3aFsy9EMSh0Je39vEp2N6Gi6fKnoVixdtkyuXJ7i7C1V1Ddqu4iBY20dR_LIuDv0WhVrsnrexqIePqloTmlafxwsMSVL-ZFFSYwr7jqdLji_lT6Yvh305eoj6MyB-aAUp8XdSM Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4cd0a5bce77f4182967d71e36658224f Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:45:21.444852 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4cd0a5bce77f4182967d71e36658224f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4cd0a5bce77f4182967d71e36658224f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4cd0a5bce77f4182967d71e36658224f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4cd0a5bce77f4182967d71e36658224f"}]}] Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4cd0a5bce77f4182967d71e36658224f Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-356801827 Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-LiveMigrationNegativeTest-356801827-project-admin Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a37341e416ed42dfbe9b34a4e5ff2ba9 Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-LiveMigrationNegativeTest-356801827-project-admin Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} Oct 19 00:45:21.446551 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'os-migrateLive' instance 730e86a4-449e-46d6-9954-4aa482150258 while it is in vm_state suspended Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '730e86a4-449e-46d6-9954-4aa482150258', 'body': {'os-migrateLive': {'host': 'n-h1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 00:45:21.447329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 730e86a4-449e-46d6-9954-4aa482150258 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:45:21.448305 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 730e86a4-449e-46d6-9954-4aa482150258 while it is in vm_state suspended Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 730e86a4-449e-46d6-9954-4aa482150258 while it is in vm_state suspended Oct 19 00:45:21.451172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:45:21.453387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 730e86a4-449e-46d6-9954-4aa482150258 while it is in vm_state suspended {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:21.453387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-142f4413-ee8f-4a98-a03e-ee467fc7d1b0 tempest-LiveMigrationNegativeTest-356801827 tempest-LiveMigrationNegativeTest-356801827-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258/action" status: 409 len: 155 microversion: 2.1 time: 0.101498 Oct 19 00:45:21.453663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:21.456741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for user e94cc0780af240188e5024335e581dea and project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:21.460061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 263/476] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:21 2022] POST /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258/action => generated 155 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:45:21.466428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.467398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:21.472233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:21.474464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.474676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:21.475448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.476229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.478056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.479007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.479601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.534176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffd442c2-1772-4809-9743-16aaaa7f39e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663803 Oct 19 00:45:21.544660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 214/477] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:21.544660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.544660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:21.549283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.549923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.550377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.551092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.551807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.551970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.594051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:21.688375 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-48babdac-6a2a-4b7b-b959-3096a4736582 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "DELETE /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 204 len: 0 microversion: 2.1 time: 0.151964 Oct 19 00:45:21.689326 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 215/478] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:21 2022] DELETE /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:21.696873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.697814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:21.706165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.706950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.707450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.708199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:21.708677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:21.709112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:21.722810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:21.733113 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80c1fa25-fcc1-40cd-9650-8e0d72747218 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1473 microversion: 2.1 time: 0.271931 Oct 19 00:45:21.737313 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 264/479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:21 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:21.746685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1499143363", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:21.807522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:21.975266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:21.985787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb1f2610-b1a1-4bd7-8c9a-cbee1eb26e38 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.294906 Oct 19 00:45:21.986619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 216/480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:21 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:21.992232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:21.993312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.003852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.004681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.005723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.007430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.008422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.009463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.108745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:22.109520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:22.110179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:22.111623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:22.112099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:22.129992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.130561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.132922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.134365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.134857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.135300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.171044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:22.177071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for user e94cc0780af240188e5024335e581dea and project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:22.191090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:22.193658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:22.253264 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4593a5ab-c4b3-42cf-89fb-85da10ba11db tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512999 Oct 19 00:45:22.254529 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 265/481] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:22.260555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:22.261271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.269738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.270058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.270735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.271361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.272249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.272908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.273630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.282693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de5b2a4e-ddc3-4e0e-9080-c1c99949b8aa tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1464 microversion: 2.1 time: 0.294859 Oct 19 00:45:22.284499 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 217/482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:21 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:22.290221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:22.291296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.299234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.300091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.300795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.301704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.302347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.302979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.441799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.455752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.465192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.473067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea734eea-96a0-4f1f-920b-8f244378f4b1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.186792 Oct 19 00:45:22.474430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 218/483] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:22 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:22.482937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:22.484411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.495499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.497664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.498542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.499949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.500895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.501842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.546886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.561313 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80056d35-f7bd-47aa-b7f8-0acaf5086f10 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.305398 Oct 19 00:45:22.570443 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 266/484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:22 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:22.590854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e818e9f4-a5d1-405d-8dd0-ca472fb1766b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:22.591492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e818e9f4-a5d1-405d-8dd0-ca472fb1766b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.738755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e818e9f4-a5d1-405d-8dd0-ca472fb1766b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.750199 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e818e9f4-a5d1-405d-8dd0-ca472fb1766b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1214 microversion: 2.1 time: 0.175647 Oct 19 00:45:22.766515 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 267/485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:22 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:22.779337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:22.780041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:22.784924 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:22.794414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.795267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.796963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.799856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:22.800735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:22.802271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:22.821326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.856881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1dcffb40-4a06-4cb7-9e72-d7fa4a8f1ed9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.380862 Oct 19 00:45:22.857479 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 219/486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:22 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:22.963747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:22.973535 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-536a69f6-145e-4098-81e9-724c174b8464 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1473 microversion: 2.1 time: 0.204172 Oct 19 00:45:22.974431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 268/487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:22 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1473 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:23.011744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.012822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.018888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.019565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.020502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.021278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.021724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.022358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.214894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.224745 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-90dada13-454c-480c-9a7d-110263211658 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.219067 Oct 19 00:45:23.225599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 220/488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:23.311481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.312277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.319926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.321293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.321734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.322618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.323072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.323498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.382214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fed03f7-ab7e-4114-b63d-fbefb0d37ff6", "tag": "289f1ed9-785c-4807-8724-a7653e54edcd"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:23.401477 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:23.414787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.419728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.420365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.446874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] Creating event network-changed:289f1ed9-785c-4807-8724-a7653e54edcd for instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 on n-h2-master-1 Oct 19 00:45:23.463503 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-48932b1a-99a2-4c3a-9adc-f603798b0348 req-458e6620-2ecf-4d36-8a36-19e6d172d191 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095237 Oct 19 00:45:23.463878 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 221/489] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:23.512387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.513178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.514609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.521614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.522122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.522591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.523295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.523805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.524221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-abd911e9-d5c5-4cee-8aca-17be5c3ee052 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1464 microversion: 2.1 time: 0.216497 Oct 19 00:45:23.524336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.538629 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 269/490] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1464 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:23.600867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.602457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.609853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.613442 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:23.614385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.615589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.616650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.618836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.619374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.620059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.627875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.630508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.640851 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6bf509b6-f157-42b0-9a27-de7f2b780b16 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.133488 Oct 19 00:45:23.645405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 222/491] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:23.775448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.785059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.785961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.787378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df24f11c-be53-4671-891a-42adb2278912 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.194085 Oct 19 00:45:23.800664 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 270/492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:23.812230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.812769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.813345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.814042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.814670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.815107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.884438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:23.885100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:23.885736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:23.894091 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-003d5d33-c290-43b2-adfe-820502cb7e9d tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1266 microversion: 2.1 time: 0.120460 Oct 19 00:45:23.895231 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 223/493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:23.897804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.899730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.900549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:23.902727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:23.903800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:23.904434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.001133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:24.003160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:24.033304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.035537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.036113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.036947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.039373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.049325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.126967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.136906 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1634dca3-c950-40eb-8f9e-a6d6a5b6157a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.260858 Oct 19 00:45:24.137876 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 271/494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:24.249683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:24.250674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:24.257501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.258762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.259334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.260806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.261476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.261957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.281955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.294684 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fe2129c-bfe9-4d7b-b9e9-0a4b114831b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1473 microversion: 2.1 time: 0.299208 Oct 19 00:45:24.303461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 224/495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:23 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1473 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:24.564178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:24.565232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:24.574156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.575118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.576065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.577127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.577774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.578989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.646691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.671886 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4adc2ee3-b6a0-406e-9666-5d72aeacf0c5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.426172 Oct 19 00:45:24.675611 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 272/496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:24 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:24.681587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:24.682576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:24.689764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.690633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.691322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.692536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.693258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.693956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.897369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.910664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.914937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:24.919660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3a6c9ad-cdcd-4399-a715-8be8a8fc6b02 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.242715 Oct 19 00:45:24.920929 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 273/497] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:24 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:24.941177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:24.942217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:24.950603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.951454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.952105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:24.953147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:24.954277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:24.954942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.478353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.491002 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65836915-1a2c-4584-9d9c-38ce1ea7f100 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1464 microversion: 2.1 time: 0.940464 Oct 19 00:45:25.492637 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 225/498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:24 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1464 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:25.500754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:25.501638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:25.512233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.513897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.515580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.516578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.517624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.518398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.737263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.750322 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95ab7404-2aae-4c05-b2b7-784923cf6dc2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1272 microversion: 2.1 time: 0.255278 Oct 19 00:45:25.760705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 226/499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:25 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1272 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:25.760705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:25.760705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:25.764050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:25.775720 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e2db9b7-5241-4e4f-84bf-bc3ef055e1d2 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.853421 Oct 19 00:45:25.778598 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 274/500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:24 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:25.784102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.784793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.785511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.786501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.788280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.789261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.789735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:25.791449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:25.803860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.804362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.806199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:25.806941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:25.807405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:25.807836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.258887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.261182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.269946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a314dcc-e4eb-468d-9911-e9c155e6d83d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.490177 Oct 19 00:45:26.270738 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 275/501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:25 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:26.274350 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff26f9e7-4e42-41e0-af07-797ef59499bd tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.521759 Oct 19 00:45:26.276214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7778fd5-a769-4bce-aff6-64b397710901", "tag": "91bbe776-9443-4de4-a961-1676e440bd21"}, {"server_uuid": "505afe68-f76e-4a63-9e4a-ee2de533db5a", "name": "network-vif-unplugged", "status": "completed", "tag": "9630d069-1da0-4c40-ad15-19f23f6bf9f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:26.276398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 227/502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:25 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:26.287595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.290954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.297295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.298080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.298684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.307113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.308004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.308664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.309866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.310771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.311351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.319332 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Creating event network-changed:91bbe776-9443-4de4-a961-1676e440bd21 for instance c7778fd5-a769-4bce-aff6-64b397710901 on n-h2-master-1 Oct 19 00:45:26.320986 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] Creating event network-vif-unplugged:9630d069-1da0-4c40-ad15-19f23f6bf9f6 for instance 505afe68-f76e-4a63-9e4a-ee2de533db5a on n-h1-master-1 Oct 19 00:45:26.332579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4a055eea-86a2-44e6-a7e8-4eeea5bbea8b req-2813dc27-9e25-4240-bda6-b96a7fa1a91f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.059442 Oct 19 00:45:26.334019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 276/503] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:26.342906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.344152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.361272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.361781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.365065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.366065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.369233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.369693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.400070 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:26.487324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.497085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.499165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.505714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17188a7d-436a-4c32-914b-17cfc35b18ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.170271 Oct 19 00:45:26.506329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 277/504] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:26.511795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:26.512458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.536435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.537241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.537905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.539805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.540569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.541537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.616085 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d19fda2-13fc-4b66-8210-b6cc062cecf3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc/action" status: 204 len: 0 microversion: 2.1 time: 0.108448 Oct 19 00:45:26.617123 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 278/505] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:26 2022] POST /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc/action => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:26.623678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "730e86a4-449e-46d6-9954-4aa482150258", "name": "network-vif-deleted", "tag": "a794fa0e-49de-4b77-b96a-19d811bcc6fe"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:26.629172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.636010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.636635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.637092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.650307 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] Creating event network-vif-deleted:a794fa0e-49de-4b77-b96a-19d811bcc6fe for instance 730e86a4-449e-46d6-9954-4aa482150258 on n-h2-master-1 Oct 19 00:45:26.655057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22fad88a-57f4-44b3-b211-423ca51a117d tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.373403 Oct 19 00:45:26.656535 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f1b5a3bd-38f1-4b0b-8156-1316ce938e43 req-abf0c13d-94c6-42fd-9f74-9343c2f24266 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037171 Oct 19 00:45:26.657135 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 228/506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:26.658101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 279/507] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:26.666760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.667332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.690790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.691285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.691728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.692461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.693132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.693754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.713700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.715771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.740201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.745324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.746338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.747762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.747849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.749313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.848374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:26.865473 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-efa737ad-a778-44e4-bc6d-a61e9c75c17f tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1422 microversion: 2.1 time: 0.207248 Oct 19 00:45:26.866072 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 229/508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1422 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:26.882438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:26.884505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:26.907621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.908374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.909006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:26.909910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:26.910522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:26.911109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.289527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.305153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1c69f77-5a62-4cff-985e-261cc04faeed tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.644861 Oct 19 00:45:27.307017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 280/509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:27.326478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.327184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.333832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.334599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.335263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.336798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.337422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.338008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.370692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.378953 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ccd0ba5b-a200-4e63-9984-8c5e6904e289 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.511583 Oct 19 00:45:27.379821 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 230/510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:26 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:27.394968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "name": "network-vif-plugged", "status": "completed", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:27.408531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.409218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.409926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.424573 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Creating event network-vif-plugged:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h2-master-1 Oct 19 00:45:27.431150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] Instance c6586352-0a39-4899-96f3-8d10855a64fc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:45:27.442577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-260175d1-cce2-463c-9093-1411c3ba62bd req-6e8f116d-91d1-4e8f-8db2-8bfb15c241cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054746 Oct 19 00:45:27.443107 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 231/511] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:27.450112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.450812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.457425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.458099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.458714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.459850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.460457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.461165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.732782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.740498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8636b802-5534-4459-a767-fc248f263540 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.430294 Oct 19 00:45:27.741357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 281/512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:27.746583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.747208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.754490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.755267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.756341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.758527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.759161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.760322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.797355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.810082 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d92b71a-170a-4e54-a610-e0b85dba6b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.365121 Oct 19 00:45:27.811975 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 232/513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:27.819291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.819918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.827897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.828978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.829586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.830468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.831271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.832001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.880030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.890183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.891630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:27.897497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-238f948c-c2cd-43d7-b260-0785eb27b590 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.155303 Oct 19 00:45:27.898085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 282/514] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:27.904114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:27.905006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:27.911517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.912277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.912898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.913923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.918029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.918496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.958636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:27.959150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:27.960578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:27.960578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lazy-loading 'fault' on Instance uuid 730e86a4-449e-46d6-9954-4aa482150258 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:28.059840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.069466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-51a65ed6-c61b-4ebd-adfa-140051f49422 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 200 len: 1307 microversion: 2.1 time: 0.168964 Oct 19 00:45:28.071956 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 283/515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:28.077182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:28.078125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:28.084514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.085899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.087005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.088265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.089000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.089638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.132446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:28.282134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad9f4356-ad88-4579-afe1-306880a1628d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 204 len: 0 microversion: 2.1 time: 0.208385 Oct 19 00:45:28.282949 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 284/516] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:28 2022] DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:28.333257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:28.333849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:28.349041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.349265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.349712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.350439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.350902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.351866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.551357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.559740 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-910dbdcc-8839-4f42-a3da-7b2a71271fb2 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.746543 Oct 19 00:45:28.560724 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 233/517] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:27 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:28.578979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "505afe68-f76e-4a63-9e4a-ee2de533db5a", "tag": "9630d069-1da0-4c40-ad15-19f23f6bf9f6"}, {"name": "network-changed", "server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:28.589811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.590301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.590743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.604791 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Creating event network-changed:9630d069-1da0-4c40-ad15-19f23f6bf9f6 for instance 505afe68-f76e-4a63-9e4a-ee2de533db5a on n-h1-master-1 Oct 19 00:45:28.605302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] Creating event network-changed:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:45:28.612388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e3a40871-8734-4676-b8ac-71de86808ecf req-46c55ea7-b760-492a-a9d9-669ce161df37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.050447 Oct 19 00:45:28.613021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 234/518] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:28.620150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:28.620447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:28.627020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.627505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.627946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.628837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.629116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.629542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.737499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.752158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8c15c94-fe05-4771-8c46-919e56e45be3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.423452 Oct 19 00:45:28.753287 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 285/519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:28 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:28.759666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-2093990228", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "205429470", "adminPass": "***", "networks": [{"uuid": "b070b134-510e-4207-bcb2-70fa5455416b"}], "security_groups": [{"name": "tempest-securitygroup--1881682287"}], "key_name": "tempest-keypair-1596044564", "user_data": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:28.890390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:28.918188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5f1d8e39-d3ca-4610-8519-167150cb6540 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.303387 Oct 19 00:45:28.922105 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 235/520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:28 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:28.928437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:28.929393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:28.936496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.937237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.938254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.939131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:28.939741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:28.940359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:28.967428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] validate_networks() for [('b070b134-510e-4207-bcb2-70fa5455416b', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:29.255820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.267464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-00479a29-42e9-402c-b533-5b6de42bf835 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.344002 Oct 19 00:45:29.268067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 236/521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:28 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:29.290299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.290526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.296980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.297484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.297929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.298645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.299113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.299548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.530176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.537390 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0dacd89-a744-4f16-ae18-72d37192d429 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.252267 Oct 19 00:45:29.537991 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 237/522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:29.543999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.544605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.551499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.552005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.552503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.553252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.553770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.554209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.637600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.639838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:29.640255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:29.640785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:29.641197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:29.641628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:29.646398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.647633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.649344 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=62,nova_cell0:UPDATE=7 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:29.655936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.656449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.656908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.657656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.657949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aa054c4e-0b97-491e-8a77-3f7d46fe29e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.118859 Oct 19 00:45:29.658113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.658783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 238/523] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:29.658976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.666902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0", "tag": "4ad823f3-226f-42e0-8c46-45c357270f6d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:29.677006 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=11 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:29.678544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.679521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.680376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.687748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:29.692187 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] Creating event network-changed:4ad823f3-226f-42e0-8c46-45c357270f6d for instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 on n-h1-master-1 Oct 19 00:45:29.692853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Getting quotas for user 729379ca02904136b0d5c96d6b28c490 and project 6be4ac47d8094dd2854afeadbfae9c96. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:29.697919 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e2c81cd4-fddb-41d8-9930-3ad096913fb0 req-c27df5d7-f71c-4524-b562-723525776e1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036273 Oct 19 00:45:29.698710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 239/524] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:29.704122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.704799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 730e86a4-449e-46d6-9954-4aa482150258] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.708438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:29.711564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:29.712406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.712931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.713370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.714119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.714579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.715008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.729983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] HTTP exception thrown: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Request method failure captured: Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 HTTP/1.1 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hpEkLMB8UZ-JUoUMwDXzD08MO0kpWvjR4IIj7e9ieZwYgOP_XMzAtHjN56eylAjbWKTs5OMFFIFJd8ei92lG4cf3xyZDqFl9wDxopUhNXKe5CSPKtUR4XiSfg-7tpfzWfXF8MYXBNR34ONTMedS6ruwyVv7iYlwZh2UiejD9BNQOQ Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b553e8276e214de6b1fa6db1fb52e6a9 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:29.731652 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b553e8276e214de6b1fa6db1fb52e6a9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b553e8276e214de6b1fa6db1fb52e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b553e8276e214de6b1fa6db1fb52e6a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b553e8276e214de6b1fa6db1fb52e6a9"}]}] Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b553e8276e214de6b1fa6db1fb52e6a9 Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveMigrationNegativeTest-1231196150-project Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 97fb5d3a021149d4a90bef39a518ada2 Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveMigrationNegativeTest-1231196150-project Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. Oct 19 00:45:29.733199 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '730e86a4-449e-46d6-9954-4aa482150258'} Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:29.734068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. Oct 19 00:45:29.735194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:29.736524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Returning 404 to user: Instance 730e86a4-449e-46d6-9954-4aa482150258 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:29.736524 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbec66b0-61bd-40bf-925d-13780684e21a tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258" status: 404 len: 111 microversion: 2.1 time: 0.033768 Oct 19 00:45:29.737498 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 240/525] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/730e86a4-449e-46d6-9954-4aa482150258 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:29.743057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.743772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.751031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.751458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.751903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.752705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.753094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.753528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.767981 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b14ebfb-45cd-4dc7-99c1-02494120333a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.013484 Oct 19 00:45:29.775418 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 286/526] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:29.779838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.780520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.793139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.793139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.793139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.793139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.793595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.793595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.823062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:29.919128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7dfe4255-e618-464d-a08c-2fa3b69f69a4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 204 len: 0 microversion: 2.1 time: 0.148588 Oct 19 00:45:29.920084 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 287/527] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:29 2022] DELETE /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:29.926996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3973a786-b6f1-49d2-a834-c44f15b363f5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.927951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3973a786-b6f1-49d2-a834-c44f15b363f5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.928850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:29.937595 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:29.948609 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f9db572-b0dc-4126-9420-29697f9beab5 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.209413 Oct 19 00:45:29.949194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 241/528] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:29.955315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:29.956671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:29.964438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.965059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.965581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:29.966642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:29.967243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:29.967804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.006744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3973a786-b6f1-49d2-a834-c44f15b363f5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.016432 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3973a786-b6f1-49d2-a834-c44f15b363f5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1263 microversion: 2.1 time: 0.094679 Oct 19 00:45:30.017077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 288/529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1263 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.033699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.034909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.049088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.049905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.050500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.051564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.052296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.053073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.209760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.219219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec52080e-9eba-4f91-8216-df6762b7d34c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.268051 Oct 19 00:45:30.219934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 242/530] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:29 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.225367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.226212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.241032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.241715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.243815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.244096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.244649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.245162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.264161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.272729 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe590416-cd39-438b-b992-f55b6558fc23 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1472 microversion: 2.1 time: 0.246538 Oct 19 00:45:30.273415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 289/531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.293827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.294457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.300602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.301129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.301570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.302288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.302746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.303177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.516551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.525037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ce90c08-28be-4552-8f1e-b68bff441224 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.303697 Oct 19 00:45:30.525723 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 243/532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.527725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.537324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be9845b2-2d9b-46e3-9b06-7a187868e176 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.247245 Oct 19 00:45:30.538030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 290/533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.562507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.563144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.570165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.571233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.571674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.572393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.572883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.573308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.687355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.688123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.696337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.697825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.697825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.698480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.699362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.699721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.704958 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:30.730323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.739353 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-696169b2-af63-42f7-9bc9-8e0decaca850 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.180647 Oct 19 00:45:30.740290 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 244/534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:30.776196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.785665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.787311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:30.793925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cdebe61c-3754-4e10-b5f2-4418c2b4f859 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.110815 Oct 19 00:45:30.794693 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 291/535] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:30.973931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:30.974643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:30.981699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.982193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.982664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:30.983387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:30.983836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:30.984264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.022597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fed03f7-ab7e-4114-b63d-fbefb0d37ff6", "name": "network-vif-plugged", "status": "completed", "tag": "289f1ed9-785c-4807-8724-a7653e54edcd"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:31.033796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.034615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.035250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.048707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] Creating event network-vif-plugged:289f1ed9-785c-4807-8724-a7653e54edcd for instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 on n-h2-master-1 Oct 19 00:45:31.055164 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-70d85430-cc05-4df6-b5ce-db10fcd539c1 req-03d285a5-7eb4-472a-9699-e0dee2705f55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036936 Oct 19 00:45:31.057094 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 292/536] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:45:31.064641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:31.065700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:31.075671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.076455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.077118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.078017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.078888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.079656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.217000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.229993 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4e9bb80-2ee3-4482-ac90-356a060ce74f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1267 microversion: 2.1 time: 0.171870 Oct 19 00:45:31.230764 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 293/537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:31 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:31.250625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:31.251267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:31.258210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.259340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.260092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.260858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.261357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.261750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.395287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.404769 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81d3f771-d026-4f66-b6c9-0a6febea6958 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.434653 Oct 19 00:45:31.406523 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 245/538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:30 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:31.411802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:31.412756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:31.419847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.420712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.421368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.422299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.422977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.423792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.442688 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=7 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:31.466319 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:31.668585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.682999 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dfdd5e41-cdeb-4a67-80bb-e37738d75722 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.444609 Oct 19 00:45:31.683969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 294/539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:31 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:31.688806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:31.689421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:31.699637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.700413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.702079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.703771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.705528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.706366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.879583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:31.897619 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b067d4a2-fc49-4f86-b7ce-534782046da4 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1472 microversion: 2.1 time: 0.489661 Oct 19 00:45:31.899023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 246/540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:31 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:31.904283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:31.905302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:31.911980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.912986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.913702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:31.914724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:31.915496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:31.916172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.191523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.205128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-71b96272-647b-4bad-b341-140c62279bd7 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.519999 Oct 19 00:45:32.220650 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 295/541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:31 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:32.231875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.233029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.243124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.244129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.245562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.246893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.248768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.249581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.279936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.291048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbf21cd8-edc8-4411-a72f-36538e9626a0 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 0.387736 Oct 19 00:45:32.297445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 247/542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:31 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:32.303228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.307768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.318201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.321007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.321747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.323104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.323698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.324232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.438988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.451030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.454744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.462159 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49e4bd5d-d091-450c-8363-728f419ebd35 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.163491 Oct 19 00:45:32.464171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 248/543] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:32.469687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.470670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.479351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.480182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.480885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.481881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.482552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.483211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.773007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.789219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a9737fd-75e5-47dc-af2a-149627283b48 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1315 microversion: 2.1 time: 0.322820 Oct 19 00:45:32.807571 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 249/544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:32.819386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.820874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.833014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.834680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.835511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.838669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.839796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.841619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.883709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:32.899337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b5d7a62-26d3-4a29-aff9-88c045b3454e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.681388 Oct 19 00:45:32.901256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 296/545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:32.924357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:32.925549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:32.934076 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:32.938623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.939267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.940564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:32.942012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:32.942822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:32.943730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.141116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.154931 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ec5e251-45f4-4c53-bde0-39c32cb5cfec tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.345494 Oct 19 00:45:33.157328 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 250/546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:33.169684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:33.172665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:33.189836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.190426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.190975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.191806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.192375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.192955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.240814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.283564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-faeab72d-a81f-4631-a29c-de5401dea853 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1470 microversion: 2.1 time: 0.368307 Oct 19 00:45:33.317370 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 297/547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:32 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1470 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:33.332893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7778fd5-a769-4bce-aff6-64b397710901", "name": "network-vif-plugged", "status": "completed", "tag": "91bbe776-9443-4de4-a961-1676e440bd21"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:33.363745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.364247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.364732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.373439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:33.382488 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5681ec3-03a1-4a39-acb4-822b073e13ca tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1430 microversion: 2.1 time: 0.222461 Oct 19 00:45:33.387710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 251/548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:33 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1430 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:33.405262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:33.406452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:33.430026 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] Creating event network-vif-plugged:91bbe776-9443-4de4-a961-1676e440bd21 for instance c7778fd5-a769-4bce-aff6-64b397710901 on n-h2-master-1 Oct 19 00:45:33.438585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b20b90d3-0b57-43fc-b62d-842d3c7715b8 req-ef48f020-75b8-45f6-ba26-1901dacda075 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129961 Oct 19 00:45:33.439481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.439668 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 298/549] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:33.440470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.441344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.442598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.443435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.444214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.445466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:33.446619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:33.454749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.455911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.456588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:33.457625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:33.458878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:33.461048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.139587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.159229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b3d750f-f130-4078-b62c-0126bfd4224c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.769783 Oct 19 00:45:34.159884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 252/550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:33 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:34.180291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30950612-d79c-473d-97eb-6827289302bd", "name": "network-vif-deleted", "tag": "9a7d2f16-f420-4b14-8c01-ee20fdec611f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:34.211902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.212725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.214488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.258422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] Creating event network-vif-deleted:9a7d2f16-f420-4b14-8c01-ee20fdec611f for instance 30950612-d79c-473d-97eb-6827289302bd on n-h2-master-1 Oct 19 00:45:34.275342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-afbf9e80-3078-44d0-8f5f-556861dfd450 req-3406af5c-5efd-4e86-a2a5-4d11309bd2a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112345 Oct 19 00:45:34.281438 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 253/551] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:34.294780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:34.295583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:34.326620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.327245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.327837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.328863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.329333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.329771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.846806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.859687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.864364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:34.881854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac1aa113-f249-46b3-a79c-4970aad7ea0f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.597434 Oct 19 00:45:34.882908 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 254/552] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:34 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:34.892411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:34.894835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:34.911633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.912136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.912573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:34.913341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:34.920112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:34.920595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.166301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.182841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.185491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c1e90abd-b3be-4d68-a070-827cb34933bf tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1321 microversion: 2.1 time: 0.300693 Oct 19 00:45:35.189668 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 255/553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:34 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:35.197913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.198783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.198904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03801a06-6ded-4405-86a6-57c8e332efe7 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1323 microversion: 2.1 time: 1.757176 Oct 19 00:45:35.201621 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 299/554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:33 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1323 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:35.214843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.215966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.216987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.217423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.218336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.219719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.221799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.224094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.233174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.234812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.237233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.239487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.241438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.243190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.935825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.945312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7439e7ce-e136-4f4a-842c-c238294a09b8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.753302 Oct 19 00:45:35.953041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 256/555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:35.956183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:35.962134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:35.966170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:35.980206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.981023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.981552 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df3f0a37-876f-4840-a0be-505121f98887 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1320 microversion: 2.1 time: 0.778347 Oct 19 00:45:35.982174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 300/556] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1320 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:35.983022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:35.984120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:35.989466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:35.990206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.017500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.026894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.046782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.049605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.053222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.057981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.061379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.062316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.217731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.224688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.226558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.228926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lazy-loading 'fault' on Instance uuid 30950612-d79c-473d-97eb-6827289302bd {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:36.242224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:36.252445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77b139b8-6493-4d92-902c-643d6b8d6d86 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1462 microversion: 2.1 time: 0.297793 Oct 19 00:45:36.253506 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 257/557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1462 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:36.259948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.261046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.290420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.291309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.292006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.293144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.294249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.294898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.408015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97fb5d3a021149d4a90bef39a518ada2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b553e8276e214de6b1fa6db1fb52e6a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:36.426094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-30e82495-0efc-48fd-a266-cdda46f76b7d tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 200 len: 1307 microversion: 2.1 time: 0.442837 Oct 19 00:45:36.426926 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 301/558] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:35 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 1307 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:36.432014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:36.444557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.445308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.446096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.462996 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] Creating event network-vif-plugged:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:45:36.469726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a0729f66-8c77-48d2-ba6c-013391a5a27d req-7d5c2d1f-9257-4796-9899-eb36eba1abb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041074 Oct 19 00:45:36.470980 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 302/559] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:36.478809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.479972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.487404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.488954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.489905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.490910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.491592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.492356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.791570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:36.807466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:36.809899 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:36.827170 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c39a68be-276a-48f2-8ea0-62498231a87f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.353724 Oct 19 00:45:36.828193 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 303/560] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:36 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:36.837142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:36.838264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:36.852237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.853575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.854473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:36.855471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:36.856205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:36.856961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.188343 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.197385 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c64e16a5-06fc-4a02-811a-5bdbaf39f7cf tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.942228 Oct 19 00:45:37.209470 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 258/561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:36 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:37.215179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:37.216126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:37.234629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.235420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.236006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.236956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.237580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.238191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.243876 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:37.578815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.587386 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d21907f6-ecc6-4619-b874-d91577ba811b tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.757424 Oct 19 00:45:37.604139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 304/562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:36 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:37.609150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:37.609960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:37.617605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.618453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.619108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.619929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.620459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.621115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.727959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:37.738505 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c539fa0-3870-4056-a405-289e2da0f6b5 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1473 microversion: 2.1 time: 0.527588 Oct 19 00:45:37.739366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 259/563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:37 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1473 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:37.744460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a124b96-1795-4584-92f9-201cb18838d9", "name": "network-vif-deleted", "tag": "f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:37.756059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.756856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.757517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.770967 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] Creating event network-vif-deleted:f8de2c7a-b8a5-43d1-8c4b-7a0e9ff35967 for instance 3a124b96-1795-4584-92f9-201cb18838d9 on n-h1-master-1 Oct 19 00:45:37.776723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-61b608a9-2677-414c-b06d-47db0f4b0bad req-70fd1630-da46-4943-b44c-fcdc83184e80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035869 Oct 19 00:45:37.777335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 260/564] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:37.783510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:37.784374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:37.792299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.793273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.794072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.794963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.795435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.795874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.984381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-603f8494-bd05-4083-892f-eaccaa095c51 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1613 microversion: 2.1 time: 0.378707 Oct 19 00:45:37.986458 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 305/565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:37 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1613 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:37.989810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:37.990417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:37.996503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.997420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.997862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:37.998560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:37.999010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:37.999454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.030056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.037832 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ee9860a-6ad6-477f-bca4-ac1877d96928 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.258932 Oct 19 00:45:38.038467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 261/566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:37 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:38.043793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.044607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] [instance: 30950612-d79c-473d-97eb-6827289302bd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.052909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.053638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.054312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.055047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.055521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.055958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.070667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] HTTP exception thrown: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Request method failure captured: Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd HTTP/1.1 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hpEkLMB8UZ-JUoUMwDXzD08MO0kpWvjR4IIj7e9ieZwYgOP_XMzAtHjN56eylAjbWKTs5OMFFIFJd8ei92lG4cf3xyZDqFl9wDxopUhNXKe5CSPKtUR4XiSfg-7tpfzWfXF8MYXBNR34ONTMedS6ruwyVv7iYlwZh2UiejD9BNQOQ Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b553e8276e214de6b1fa6db1fb52e6a9 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:38.072292 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b553e8276e214de6b1fa6db1fb52e6a9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b553e8276e214de6b1fa6db1fb52e6a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b553e8276e214de6b1fa6db1fb52e6a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b553e8276e214de6b1fa6db1fb52e6a9"}]}] Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b553e8276e214de6b1fa6db1fb52e6a9 Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1231196150 Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveMigrationNegativeTest-1231196150-project Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 97fb5d3a021149d4a90bef39a518ada2 Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveMigrationNegativeTest-1231196150-project Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. Oct 19 00:45:38.073732 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '30950612-d79c-473d-97eb-6827289302bd'} Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:38.074427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. Oct 19 00:45:38.075546 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.076531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] Returning 404 to user: Instance 30950612-d79c-473d-97eb-6827289302bd could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:38.076531 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7aac8c0-5b47-4225-a510-a5736b1f53a7 tempest-LiveMigrationNegativeTest-1231196150 tempest-LiveMigrationNegativeTest-1231196150-project] 10.222.0.27 "GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd" status: 404 len: 111 microversion: 2.1 time: 0.034316 Oct 19 00:45:38.076531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 262/567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/30950612-d79c-473d-97eb-6827289302bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:38.080792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.081071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.088552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.089073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.089517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.090238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.090703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.091137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.114820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Request method failure captured: Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6/diagnostics HTTP/1.1 Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0iYVRGftA6HBPeu6DvMs8oSh2Ki4_aLve95NJzJLudlRYgdjqownGwTB5Lsp7XvXFwvsPDHN0Do3zOgjDLZq19KoAOsw_SxRxznRS5j4ddG228j4RsOiaoSFBaTQoew_vsQQOncGlYDHa2VM8YN3AqEo3CQ7LOodcRt2FX7ZXsZT4M Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 517bd155a3d544e08fef047741fb70ce Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:38.116705 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_517bd155a3d544e08fef047741fb70ce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/517bd155a3d544e08fef047741fb70ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/517bd155a3d544e08fef047741fb70ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/517bd155a3d544e08fef047741fb70ce"}]}] Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 517bd155a3d544e08fef047741fb70ce Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiagnosticsNegativeTest-1332903105-project Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b2a833999fff49a8a3601a6ab56349e9 Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1332903105-project Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:38.118180 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '4fed03f7-ab7e-4114-b63d-fbefb0d37ff6'} Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:45:38.118901 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:38.120297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:38.121411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1f3b44e-c272-4246-a7f9-ed78682f2969 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.042952 Oct 19 00:45:38.121411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 263/568] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6/diagnostics => generated 117 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:38.128355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.129027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.135712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.136201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.136666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.137389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.137881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.138342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.167291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.175329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-429da17b-153d-4937-9fb0-27d6be448b18 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1470 microversion: 2.1 time: 0.189409 Oct 19 00:45:38.187969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 306/569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:37 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:38.187969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6c7b922-f777-4e0f-b2cf-83d207498fde tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '.version_select at 0x7f2af55ceaf0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.187969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6c7b922-f777-4e0f-b2cf-83d207498fde tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.187969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6c7b922-f777-4e0f-b2cf-83d207498fde tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.188478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6c7b922-f777-4e0f-b2cf-83d207498fde tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.200547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6c7b922-f777-4e0f-b2cf-83d207498fde tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.022788 Oct 19 00:45:38.209062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 307/570] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:38.217868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.218540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.228499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.230263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.231054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.232305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.233373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.234150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.269600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.286944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.289688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.298812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:38.298970 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:38.300668 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-21424c08-95ff-427b-8337-3f0132d649c2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.180994 Oct 19 00:45:38.307962 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 264/571] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:38.315673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:38.322637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.334259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.335192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.336397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.337474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.338100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.338807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.436669 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:38.501451 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-da808c79-b329-4bda-b317-fdf322a4c0e9 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 204 len: 0 microversion: 2.1 time: 0.298012 Oct 19 00:45:38.516721 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 308/572] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:38 2022] DELETE /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:38.531180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.532644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.533321 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2cfb9151-13b6-48dd-a95d-4e56b0945532 tempest-DeleteServersAdminTestJSON-1301140095 tempest-DeleteServersAdminTestJSON-1301140095-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901/action" status: 202 len: 0 microversion: 2.1 time: 0.223481 Oct 19 00:45:38.534661 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 265/573] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:45:38 2022] POST /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:45:38.541616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1937831848", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:38.542610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.543097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.543706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.544562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.545183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.545761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.627969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:38.824402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:38.834097 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7e4b11c-4fb4-40f6-87df-61de0a3ff26b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.310855 Oct 19 00:45:38.834691 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 309/574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:38.843248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0", "name": "network-vif-plugged", "status": "completed", "tag": "4ad823f3-226f-42e0-8c46-45c357270f6d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:38.855298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.856071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.856590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.887293 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] Creating event network-vif-plugged:4ad823f3-226f-42e0-8c46-45c357270f6d for instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 on n-h1-master-1 Oct 19 00:45:38.894406 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-954fe301-50bb-4a47-a48b-7b5a1604e9fd req-9b1c1fd1-0c22-41bc-9e53-4bb208c50d5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055437 Oct 19 00:45:38.895524 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 310/575] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:38.902525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:38.903447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:38.910189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.910675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.911133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.911842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:38.912304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:38.912823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:38.993638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:38.994066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:38.994548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:38.994957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:38.995374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:39.011110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.012072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.013271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.014098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.015054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.015955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.040462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:39.045704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:39.059527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:39.061894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:39.075301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.088936 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09240714-dedc-4773-9b52-c7eef7a0ae98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1479 microversion: 2.1 time: 0.192010 Oct 19 00:45:39.090266 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 311/576] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:38 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1479 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.095389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.096139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.105114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.105720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.106229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.107072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.107678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.108141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.124397 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02435d65-4a3c-4dc1-9a8e-1bf6b58e3998 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588125 Oct 19 00:45:39.125671 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 266/577] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:39.134407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.135812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.143089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.144607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.145121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.146088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.146604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.146986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.147359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.149776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.150679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.151172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:39.411756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.411934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.425989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d6d308e-e048-4bda-85cf-f0635c267bf7 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1453 microversion: 2.1 time: 0.333920 Oct 19 00:45:39.426730 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-efb51898-a589-4a1e-8546-8da9f45b2695 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.299860 Oct 19 00:45:39.445489 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 267/578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.448654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 312/579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1453 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.454704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.455634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.455745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b50a579c-3dad-4b42-aeeb-6185f597d7d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.457099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b50a579c-3dad-4b42-aeeb-6185f597d7d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.462884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.463816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.465402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.466344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.467018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.467678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.550585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b50a579c-3dad-4b42-aeeb-6185f597d7d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.562221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b50a579c-3dad-4b42-aeeb-6185f597d7d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1213 microversion: 2.1 time: 0.112325 Oct 19 00:45:39.565513 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 313/580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1213 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.571913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.573182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.620080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.622447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.624925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.626627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.628564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.630024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.683046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.684357 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:39.691716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce80b618-4390-4512-8e51-dee2f55db5c2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.244517 Oct 19 00:45:39.693443 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 268/581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:39.698878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.699383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.705892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.706796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.707388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.708257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.708908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.709533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.732677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.741019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:45:39.748482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.750622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:39.759250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-568ff25a-9d6b-4542-8e21-8492140a539e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.192201 Oct 19 00:45:39.774510 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 314/582] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:39.827153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db52e5e4-aff1-41b6-aadd-134edc28172a", "tag": "dd28523d-1e9b-43d8-a9f1-2857f4550de0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:39.840753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.864511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.865722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.889916 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] Creating event network-changed:dd28523d-1e9b-43d8-a9f1-2857f4550de0 for instance db52e5e4-aff1-41b6-aadd-134edc28172a on n-h2-master-1 Oct 19 00:45:39.893413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a54305d-8326-441e-9f79-9853378709c1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 204 len: 0 microversion: 2.1 time: 0.197811 Oct 19 00:45:39.894499 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 269/583] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:39 2022] DELETE /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:45:39.901372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.902352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.906193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1fdb8eab-2508-49c2-a0c5-7fa6b58ca519 req-0725af82-e366-43ee-97d0-d3a8c61e23c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082004 Oct 19 00:45:39.906824 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 315/584] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:39.910163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.910885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.911535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.912450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.913146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.913303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:39.913946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:39.914305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.931512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.932011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.932458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.933272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.933771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.934206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.970073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:39.970569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:39.971354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:39.971525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:40.164593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.173656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f58ad670-4c02-4fb9-a812-23d7f6b80e58 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1314 microversion: 2.1 time: 0.277558 Oct 19 00:45:40.174829 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 270/585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:40.188793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.196069 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2290e741-9c01-4f08-9e3a-0fbb87960283 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1459 microversion: 2.1 time: 0.285513 Oct 19 00:45:40.197922 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 316/586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:39 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1459 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:40.205505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.208116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.217185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.217942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.218588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.219301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.219930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.220376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.455084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.457975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.458732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.463912 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a4d381c-704a-4f9f-a1d0-f8eb25202291 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1479 microversion: 2.1 time: 0.262441 Oct 19 00:45:40.476433 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 271/587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1479 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:40.477701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.477701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.477701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.477701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.478093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.478093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.597937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.599026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.608978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.609505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.610354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.612227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.612911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.613519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.633342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.652576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-830d484c-b8d2-433f-87b8-eb2fcb21667d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.204672 Oct 19 00:45:40.669356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 317/588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:40.685968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.693726 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b5eaff3-bb12-4cc7-a3d1-c748a4f7a9f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1209 microversion: 2.1 time: 0.105975 Oct 19 00:45:40.694304 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 272/589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:40.716778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.717465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.724278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.724844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.725293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.726039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.726637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.727109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.789856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:40.790478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:40.796799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.797330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.797796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.798543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:40.799009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:40.800307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:40.892709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.902108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.903938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.909990 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15c30c4e-a5aa-47c8-97e5-9feaf69f5f60 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.124260 Oct 19 00:45:40.910808 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 273/590] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:45:40.924091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:40.934121 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f14cbf04-8c9c-45a3-933d-1eb50a0bda2e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.221421 Oct 19 00:45:40.934727 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 318/591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:40 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:41.201357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:41.202038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:41.208461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.208988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.209434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.210163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.210625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.211161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.223322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:41.223961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:41.230437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.230921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.231351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.232223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.232523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.233183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.266154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.266637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.267074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.267585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:41.409008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:41.412450 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:41.418388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-079a3aff-7fce-49fa-864a-b18e21bb0648 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1464 microversion: 2.1 time: 0.220893 Oct 19 00:45:41.419001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 274/592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:41 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:41.438735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:41.448278 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-161c67a0-023e-4167-b91c-6e663c39ebd1 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1459 microversion: 2.1 time: 0.229064 Oct 19 00:45:41.450405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 319/593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:41 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1459 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:41.455695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:41.456328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:41.464679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.465587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.466033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.466943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:41.467401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:41.467861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:41.592853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1a426b0-8f58-43c1-a72f-be339bf00a88 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] Calling method '.version_select at 0x7f2af5ac48b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.150379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.158225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f2a17c3-983c-45df-9f51-67f262e17e15 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1463 microversion: 2.1 time: 0.708816 Oct 19 00:45:42.172723 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 320/594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:41 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1463 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.172723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.172723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.173533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1a426b0-8f58-43c1-a72f-be339bf00a88 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 4684 microversion: 2.1 time: 0.746543 Oct 19 00:45:42.173533 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 275/595] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:45:41 2022] GET /compute/v2.1/os-networks => generated 4684 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.173679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.173679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.173679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.173919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.174297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.174723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.177050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.178224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.188951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.192417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.193112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.193848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.194482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.198780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.471505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.480389 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8ebe25db-a344-4006-8c49-8aca0d8a3bbc tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1479 microversion: 2.1 time: 0.320354 Oct 19 00:45:42.481008 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 321/596] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1479 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.481319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.485692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.486290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.490349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1e02ce8-a50e-4ea4-99f2-8d385d1f6013 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.320209 Oct 19 00:45:42.491082 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 276/597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.492453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.492981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.493422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.494120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.494572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.494992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.503931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.504581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.518804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.519320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.519764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.521591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.522213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.523603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.574777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.583136 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea0b3443-5a26-417a-8a4b-01eab39933dc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1209 microversion: 2.1 time: 0.100889 Oct 19 00:45:42.584009 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 322/598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.589531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.590506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.597105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.597757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.598268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.599133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.599602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.600101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.611569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.621038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.623071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.629058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a071cca-14e3-4ed1-a951-ea31ea00585b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.136662 Oct 19 00:45:42.629650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 277/599] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:42.641620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3c9c0ed-6dd7-4258-b2b2-833345002490 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] Calling method '.version_select at 0x7f2af5861e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.872293 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3c9c0ed-6dd7-4258-b2b2-833345002490 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/79a68d6c-c3c7-4c1d-b90f-315d553731ee" status: 200 len: 652 microversion: 2.1 time: 0.234175 Oct 19 00:45:42.875559 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 278/600] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/os-networks/79a68d6c-c3c7-4c1d-b90f-315d553731ee => generated 652 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:42.886184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-543361593", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b4ac136e-a80e-408b-a0d1-4afeea2d689a"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:42.887060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:42.903662 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44f9a9e3-f6ae-4282-b130-47f759ffa210 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1504 microversion: 2.1 time: 0.318241 Oct 19 00:45:42.916794 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 323/601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1504 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:42.923511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:42.924505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:42.935588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.936077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.936508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.937501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.937957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.938381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.973490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:42.991947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:42.992535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:42.993074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:42.993589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:43.242379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:43.253778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f911196-3308-4ce8-8e1e-ee5139adca42 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1459 microversion: 2.1 time: 0.335283 Oct 19 00:45:43.254928 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 324/602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:42 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1459 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:43.274116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fed03f7-ab7e-4114-b63d-fbefb0d37ff6", "name": "network-vif-deleted", "tag": "289f1ed9-785c-4807-8724-a7653e54edcd"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:43.289382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.289658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.290351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.311415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] Creating event network-vif-deleted:289f1ed9-785c-4807-8724-a7653e54edcd for instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 on n-h2-master-1 Oct 19 00:45:43.316718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bbb65079-b091-43ba-85b0-f6b265fb8fb8 req-7050476d-4600-49c5-9565-6898a4b8b072 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060318 Oct 19 00:45:43.317599 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 325/603] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:43.322772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02e30fbe-43f1-4d8b-aea5-d2c6873b3cc4 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] Calling method '.version_select at 0x7f2af55e7f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.413702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:43.414148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:43.414636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:43.415055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:43.415476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:43.424323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.424852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.425295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.426030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.426497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.426929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.446214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:43.451308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Getting quotas for user e94cc0780af240188e5024335e581dea and project e0ee493430f849718083118f0a4e61c0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:43.463904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:43.466449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:43.469678 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02e30fbe-43f1-4d8b-aea5-d2c6873b3cc4 tempest-NetworksTest-1391777650 tempest-NetworksTest-1391777650-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 4684 microversion: 2.1 time: 0.150868 Oct 19 00:45:43.470256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 326/604] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/os-networks => generated 4684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:43.506750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.507619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:43.514062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.514551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.514991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.515698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.516157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.516589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.521582 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f830add9-c721-4ab3-9659-66985b962e26 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643057 Oct 19 00:45:43.522247 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 279/605] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:43.541573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.542518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:43.551219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.552131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.552780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.553641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.554921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.555640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.567783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:43.568664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:43.569695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:43.570434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lazy-loading 'fault' on Instance uuid 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:43.574705 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:43.719591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:43.734597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6e8b175-88ce-44ca-844e-a081f69e3a98 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1313 microversion: 2.1 time: 0.231915 Oct 19 00:45:43.748723 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 327/606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:43.748723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cfdf7ace-c510-4245-ace9-5eb69d3c0166 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:43.748723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cfdf7ace-c510-4245-ace9-5eb69d3c0166 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.008022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cfdf7ace-c510-4245-ace9-5eb69d3c0166 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.035838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cfdf7ace-c510-4245-ace9-5eb69d3c0166 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1213 microversion: 2.1 time: 0.297818 Oct 19 00:45:44.039014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 328/607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1213 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.050301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.058494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.073343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.073990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.074520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.075566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.076353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.076668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.110036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.123643 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45c299b9-271d-4fe2-82e9-e4bbd5dad969 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.593637 Oct 19 00:45:44.124378 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 280/608] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:43 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.141509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.142123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.160207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.160660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.161120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.161824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.162292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.162728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.256276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.271009 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6f870c9-1678-4fdd-93bd-3dc88834c81a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1265 microversion: 2.1 time: 0.230553 Oct 19 00:45:44.274371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 329/609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.282370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.283318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.293742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.294580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.295231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.296546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.297346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.297927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.415757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.429328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.431517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.438098 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c499569e-d49f-4b39-9fe7-b09469f4e806 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1560 microversion: 2.91 time: 0.312629 Oct 19 00:45:44.455255 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 281/610] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1560 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:44.470169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.470987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.478251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.479139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.479579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.480602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.481307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.482040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.548109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.549185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.549916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.550671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:44.593067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.603094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0aeb906f-16ce-4559-8745-3d4cb8b93526 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1494 microversion: 2.1 time: 0.326803 Oct 19 00:45:44.633441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 330/611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1494 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.648701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7778fd5-a769-4bce-aff6-64b397710901", "name": "network-vif-deleted", "tag": "91bbe776-9443-4de4-a961-1676e440bd21"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:44.666346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.669271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.669835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.704760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] Creating event network-vif-deleted:91bbe776-9443-4de4-a961-1676e440bd21 for instance c7778fd5-a769-4bce-aff6-64b397710901 on n-h2-master-1 Oct 19 00:45:44.718367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-074389c8-e9d5-4c8b-8ec5-d906874a7aa2 req-d30aef14-5f0d-437d-b51a-551825b26f18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079494 Oct 19 00:45:44.719093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 331/612] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:44.732466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b71c281d-73c2-4d2d-9498-32d0f4c2a59f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '.version_select at 0x7f2af5522700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.733574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:44.736931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b71c281d-73c2-4d2d-9498-32d0f4c2a59f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.737613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b71c281d-73c2-4d2d-9498-32d0f4c2a59f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.738217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b71c281d-73c2-4d2d-9498-32d0f4c2a59f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.753549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9303e7f-c3c4-4d30-b03a-aafe34c6bf8a tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1417 microversion: 2.1 time: 0.296881 Oct 19 00:45:44.759336 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b71c281d-73c2-4d2d-9498-32d0f4c2a59f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.034149 Oct 19 00:45:44.769347 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 332/613] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:44.771329 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 282/614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1417 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:44.775836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.776811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.783228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:44.783858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:44.784283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.784963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.786102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.786888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.787874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.795267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.796784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.797293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.797745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.798470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.798935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.805090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.859488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:44.860103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:44.860649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:44.861328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lazy-loading 'fault' on Instance uuid 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:45.095186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2a833999fff49a8a3601a6ab56349e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517bd155a3d544e08fef047741fb70ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.115892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d076aca-59ef-4e1b-8b46-785324f7210f tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 200 len: 1313 microversion: 2.1 time: 0.344679 Oct 19 00:45:45.120389 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 333/615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.125562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.152561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.174634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.175522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.177598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.181278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.182146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.183287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.336811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.350521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-317d5e65-9041-4b65-9bff-197afb2c7244 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1209 microversion: 2.1 time: 0.228330 Oct 19 00:45:45.367084 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 334/616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:45 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1209 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.367084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.367084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.368423 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:45.395025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.397291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.397791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.401272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.401759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.402265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.455576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad604b40-ccd6-45e2-93ac-1a7b2b9d825c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1645 microversion: 2.1 time: 0.683059 Oct 19 00:45:45.456970 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 283/617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:44 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1645 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.464379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.466055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.488276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.488276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.489777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.491758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.493616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.495145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.624451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.645317 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6ce2e29-b0de-4fe6-9bff-eaf703a3e917 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1271 microversion: 2.1 time: 0.186899 Oct 19 00:45:45.645907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 284/618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:45 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.652366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:45.654171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:45.680875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.682055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.684612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.685660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:45.693042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:45.693677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:45.695577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:45.707393 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea9c8326-48ee-4b6b-bc60-f2e5fe822132 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.354012 Oct 19 00:45:45.723663 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 335/619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:45 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:45.730296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-588953506", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "696b9f21-afb6-4919-9bae-ea78136fef02"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:45.806985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] validate_networks() for [('696b9f21-afb6-4919-9bae-ea78136fef02', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:45.994163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.008825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.012836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.027176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9acbc115-c30e-498e-8080-a4434a6a0875 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.379600 Oct 19 00:45:46.033168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 285/620] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:45 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:46.049620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.051171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.066403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.081267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.081982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.082953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.083613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.084248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.146503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.147519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.148806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.149494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lazy-loading 'fault' on Instance uuid c7778fd5-a769-4bce-aff6-64b397710901 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:45:46.249864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ba955efddd645e8ada9987c22bc52ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec62e1fb72ba44da8443be083f172b90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.265940 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea6aa3a1-391b-4723-bcb6-7a6c622e5950 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 200 len: 1310 microversion: 2.1 time: 0.230067 Oct 19 00:45:46.267351 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 286/621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 1310 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:46.279659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.282405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] [instance: 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.298206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.298811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.299383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.305160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.305672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.306121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.322127 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] HTTP exception thrown: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Request method failure captured: Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 HTTP/1.1 Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0iYVRGftA6HBPeu6DvMs8oSh2Ki4_aLve95NJzJLudlRYgdjqownGwTB5Lsp7XvXFwvsPDHN0Do3zOgjDLZq19KoAOsw_SxRxznRS5j4ddG228j4RsOiaoSFBaTQoew_vsQQOncGlYDHa2VM8YN3AqEo3CQ7LOodcRt2FX7ZXsZT4M Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 517bd155a3d544e08fef047741fb70ce Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:46.324086 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_517bd155a3d544e08fef047741fb70ce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/517bd155a3d544e08fef047741fb70ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/517bd155a3d544e08fef047741fb70ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/517bd155a3d544e08fef047741fb70ce"}]}] Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 517bd155a3d544e08fef047741fb70ce Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1332903105 Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiagnosticsNegativeTest-1332903105-project Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b2a833999fff49a8a3601a6ab56349e9 Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1332903105-project Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. Oct 19 00:45:46.325820 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4fed03f7-ab7e-4114-b63d-fbefb0d37ff6'} Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:46.326660 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. Oct 19 00:45:46.327998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:46.342133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] Returning 404 to user: Instance 4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:46.345121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b74e90b-a134-4293-8eaa-70678ca21bb1 tempest-ServerDiagnosticsNegativeTest-1332903105 tempest-ServerDiagnosticsNegativeTest-1332903105-project] 10.222.0.27 "GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6" status: 404 len: 111 microversion: 2.1 time: 0.075516 Oct 19 00:45:46.347022 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 287/622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/4fed03f7-ab7e-4114-b63d-fbefb0d37ff6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:46.387103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.388158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.398223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.398223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.399624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.400668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.406623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.407214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.610427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:46.639225 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5ef473a-b22a-4a54-a5be-4314ab8ca3c9 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1265 microversion: 2.1 time: 0.263685 Oct 19 00:45:46.648773 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 288/623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:45:46.692152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:46.695490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:46.707609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.708736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.710305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:46.711804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:46.712428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:46.713097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.304810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:47.317587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ec755f3-5f74-457d-a9b8-12e3b73340e6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 0.648308 Oct 19 00:45:47.318767 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 289/624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:46 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:47.330753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:47.347103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:47.364759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.373833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.374588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.375776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.385636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.386533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.476965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:47.478115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:47.478780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:47.479663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:47.480254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:47.499731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.501205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.507358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.511607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.512380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.515921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.581732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:47.589918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for user a24b98f6af634c61af828bb20ce1e945 and project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:47.613070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:47.619334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:47.744676 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e02ef05-fc9e-41c4-92cd-0633b68afd07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.019434 Oct 19 00:45:47.747755 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 336/625] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:47.762659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:47.774434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:47.814130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.818563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.819969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:47.822092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:47.826729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:47.827309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.198759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.211959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53368e18-68f0-46a7-955d-184b9be520eb tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.891241 Oct 19 00:45:48.222721 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 290/626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:47 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:48.224257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.246109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.247870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.249565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.254194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.262030 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-394219a2-0ca3-41f8-b51c-b519fae11939 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.513067 Oct 19 00:45:48.265230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 337/627] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:47 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:48.270406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.274625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.278083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.287627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.289738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.293626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.294773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.297041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.297871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.302671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.303276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.305932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.306965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.310526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.360998 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 HTTP/1.1 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:48.365856 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.367941 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c7778fd5-a769-4bce-aff6-64b397710901'} Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:48.368824 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.370047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.372846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:48.373977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd0832ad-f03b-4aaf-a64c-aaa8a5126c1c tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 404 len: 111 microversion: 2.1 time: 0.149820 Oct 19 00:45:48.383380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 291/628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:48 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:48.405793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d71c8529-1c32-4454-9508-7d3dfe1856f4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.406738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d71c8529-1c32-4454-9508-7d3dfe1856f4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.428799 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:48.549948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.559149 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b078678b-fffb-47ab-b349-abc754796760 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1271 microversion: 2.1 time: 0.292563 Oct 19 00:45:48.572720 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 338/629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:48 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:48.580914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db52e5e4-aff1-41b6-aadd-134edc28172a", "name": "network-vif-plugged", "status": "completed", "tag": "dd28523d-1e9b-43d8-a9f1-2857f4550de0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:48.611965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.625457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.626775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.674575 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] Creating event network-vif-plugged:dd28523d-1e9b-43d8-a9f1-2857f4550de0 for instance db52e5e4-aff1-41b6-aadd-134edc28172a on n-h2-master-1 Oct 19 00:45:48.694776 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d7ecdacf-799e-4cf0-9b3b-0872a9c3e3b5 req-c767d7a9-1a9b-4ea5-bda5-e2e8d42f242a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118766 Oct 19 00:45:48.707099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d71c8529-1c32-4454-9508-7d3dfe1856f4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:48.717876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d71c8529-1c32-4454-9508-7d3dfe1856f4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1210 microversion: 2.1 time: 0.332727 Oct 19 00:45:48.719095 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 339/630] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:48.728647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 292/631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:48 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1210 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:48.733700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.735936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:48.746264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.749066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:48.779675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.790979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.791613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.793421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.794262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.806230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.807247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.808241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.809020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.809699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.810458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.817110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:48.880057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 HTTP/1.1 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:48.883898 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.885229 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c7778fd5-a769-4bce-aff6-64b397710901'} Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:48.885952 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:48.887398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:48.909523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:48.910825 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea7f43d3-5a00-4db7-9d4f-b187f9825e43 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 404 len: 111 microversion: 2.1 time: 0.180927 Oct 19 00:45:48.923774 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 293/632] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:48 2022] DELETE /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:48.947804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:48.970921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:48.971597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:48.975056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.019782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] Creating event network-changed:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h2-master-1 Oct 19 00:45:49.027289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6900f232-6608-4fd6-bbb5-bf3ea3dc438f req-bd324c7f-1c53-4253-9d56-11311d7cc51d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101547 Oct 19 00:45:49.028614 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 294/633] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:49.034786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.035812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: c7778fd5-a769-4bce-aff6-64b397710901] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.044558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.045345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.046124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.047770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.048589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.049211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.077047 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 HTTP/1.1 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:49.080974 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:49.083840 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c7778fd5-a769-4bce-aff6-64b397710901'} Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:49.087083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. Oct 19 00:45:49.091715 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.096191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance c7778fd5-a769-4bce-aff6-64b397710901 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:49.097387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-667b3111-de74-4d5a-ae3f-f31798ff2793 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901" status: 404 len: 111 microversion: 2.1 time: 0.067208 Oct 19 00:45:49.098253 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 295/634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/c7778fd5-a769-4bce-aff6-64b397710901 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:49.110282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.111297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.140489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.141685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.144857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.148613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.149922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.150932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.170476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 HTTP/1.1 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:49.173198 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: exception: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.174696 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f953527c-2b73-4559-ac8f-fbe7a36358f2'} Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:49.175580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.177120 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.181082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:49.182182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb7964b6-5d62-49d3-8efe-b0cdaca56945 tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 404 len: 111 microversion: 2.1 time: 0.079176 Oct 19 00:45:49.183243 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 296/635] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:45:49 2022] DELETE /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:45:49.213305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.214099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] [instance: f953527c-2b73-4559-ac8f-fbe7a36358f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.232151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.241804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.242898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.252400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:49.252834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.253467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.253936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.266751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3000e59f-78d0-4569-b19c-5b3919381f55 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 0.545932 Oct 19 00:45:49.270883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 340/636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:48 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:49.288402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.292554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.306409 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] HTTP exception thrown: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.315168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.317186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.317751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Request method failure captured: Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 HTTP/1.1 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h_DqDgSVpRrgURk9qBbtZGCvKPYysv8sHJ4jjZTyBkJnQ758_bhZnUZhYjzhcNR17X5rWgx2kXariwbuWVmgC5SHfiUw7bFXE1aj_5ze2sCP6Sx8r7f7F2dptpz_7bQdHXAhASQ9VGP8xX-kKlBSt-_p22H9HWimgyc98zoPJgr8c Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:45:49.318321 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ec62e1fb72ba44da8443be083f172b90", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ec62e1fb72ba44da8443be083f172b90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ec62e1fb72ba44da8443be083f172b90"}]}] Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ec62e1fb72ba44da8443be083f172b90 Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1432862086 Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0ba955efddd645e8ada9987c22bc52ee Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersAdminTestJSON-1432862086-project Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: exception: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.320568 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f953527c-2b73-4559-ac8f-fbe7a36358f2'} Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:45:49.321485 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. Oct 19 00:45:49.322999 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:45:49.324272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] Returning 404 to user: Instance f953527c-2b73-4559-ac8f-fbe7a36358f2 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:45:49.325275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.328067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef9fe383-e5cf-423b-a3ae-74903f597c1f tempest-DeleteServersAdminTestJSON-1432862086 tempest-DeleteServersAdminTestJSON-1432862086-project] 10.222.0.27 "GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2" status: 404 len: 111 microversion: 2.1 time: 0.124526 Oct 19 00:45:49.328708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.329560 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 297/637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/f953527c-2b73-4559-ac8f-fbe7a36358f2 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:45:49.337538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:49.338035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.338334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:49.352406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.352957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.353407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:49.354131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:49.360317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:49.361165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.035648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:50.060911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:50.072182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:50.120806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6afa58c-b0f7-436a-99c6-17a1e8a911ba tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.789395 Oct 19 00:45:50.123930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 298/638] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:50.131821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:50.133144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:50.158666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.160109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.160814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.164114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.166653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.167315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.174248 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:50.814159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:50.835522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-94119b85-ac68-4dc5-98b2-769cecdf6429 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1271 microversion: 2.1 time: 0.708652 Oct 19 00:45:50.853346 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 299/639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:50 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1271 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:50.872469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:50.874147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:50.908285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.917184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.926052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:50.926884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:50.928513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:50.930854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:51.048800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:51.060399 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37786c5a-d2cb-4dfb-827d-daa23cd5663f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 1.788067 Oct 19 00:45:51.083355 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 341/640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:49 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:51.090419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:51.091499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:51.098430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:51.099318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:51.099954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:51.101029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:51.101854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:51.102451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:51.213562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:51.232716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-437da337-3ae5-4167-aaa9-ad4635312db6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1268 microversion: 2.1 time: 0.377954 Oct 19 00:45:51.233625 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 300/641] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:50 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1268 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:51.822635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:51.842710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-895a3583-36c4-4e27-af15-a412e5c609fe tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 0.756306 Oct 19 00:45:51.843337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 342/642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:51 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:51.882684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:51.891965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:51.924506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:51.928133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:51.930959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:51.932211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:51.933099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:51.933894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.111414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b09b5b03-f556-4ed7-a118-8d10bf2723c2 tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] Calling method '.version_select at 0x7f2af580b040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:52.149743 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b09b5b03-f556-4ed7-a118-8d10bf2723c2 tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.914812 Oct 19 00:45:52.153838 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 301/643] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:45:51 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:52.165089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:52.166211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:52.175238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.176114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.177412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.178966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.179841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.180442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.202773 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.221718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.227295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.246116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-652fd52f-c40c-46a6-85c5-2db8e627b119 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.393269 Oct 19 00:45:52.249743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 343/644] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:51 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:52.262185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:52.271964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:52.286302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.289176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.289908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.291020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:52.294395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:52.295136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:52.980803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:52.994015 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5667e9d6-1fc2-4c3e-b4e6-0dd5091abe2a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 0.838683 Oct 19 00:45:52.994608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 302/645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:52 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:53.011997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6ddd4b9-128c-490c-8f49-86bfe58ef172 tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5861ee0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:53.025433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:53.039738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-98b93f87-7f90-4e74-b9c7-29bd3c89710f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1389 microversion: 2.1 time: 0.787517 Oct 19 00:45:53.042269 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 344/646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:52 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1389 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:53.069722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.074360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.093067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.094102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.095903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.097981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.098689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.100737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.320204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:53.381380 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-afff3f74-f197-47d2-b97b-e1114f11fca9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1268 microversion: 2.1 time: 0.326066 Oct 19 00:45:53.384856 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 345/647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1268 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:53.432600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.435288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.436811 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:53.444990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.446339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.447004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.447925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.448649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.449314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.708962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a6ddd4b9-128c-490c-8f49-86bfe58ef172 tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.712391 Oct 19 00:45:53.710606 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 303/648] 10.222.0.27 () {60 vars in 1206 bytes} [Wed Oct 19 00:45:52 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:53.720803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:53.728849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:53.748010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.748514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.748992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.749717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:53.750180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:53.750633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:53.990430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.005751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.008851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.030081 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e4df915-3d54-4d11-ae4d-234871f40b9c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.318308 Oct 19 00:45:54.047661 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 304/649] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:54.067715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c702af6-5a99-46d0-8d65-8bd6b844c5fd tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] Calling method '.version_select at 0x7f2af5778ee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.098359 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c702af6-5a99-46d0-8d65-8bd6b844c5fd tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.048847 Oct 19 00:45:54.103496 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 305/650] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:54.114456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.115088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:54.129703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.131114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.131754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.133504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.134058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.135814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.177947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.194547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a351ebd1-5bca-4617-89a8-81a41f379188 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 0.802001 Oct 19 00:45:54.197867 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 346/651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:53 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:54.208231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.210343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:54.227137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.228692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.231839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.233172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.233934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.235725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.267096 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:54.563746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:54.589707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8fb39202-26e7-46e2-80c7-dd68f90bfc6d tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1589 microversion: 2.1 time: 0.375634 Oct 19 00:45:54.613050 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 347/652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1589 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:54.619369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9318b601-2073-4bd2-90ea-2c25ad9ccdda tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] Action: 'update', calling method: .version_select at 0x7f2af56f4310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:54.855211 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9318b601-2073-4bd2-90ea-2c25ad9ccdda tempest-QuotaClassesAdminTestJSON-612534739 tempest-QuotaClassesAdminTestJSON-612534739-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.236785 Oct 19 00:45:54.860753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 348/653] 10.222.0.27 () {60 vars in 1206 bytes} [Wed Oct 19 00:45:54 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:54.876531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbda252-08e1-428a-92d8-b6703607f790", "tag": "f28635c9-1b32-4e8a-af3a-3ca7952c962f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:54.907224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:54.910092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:54.912264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:54.943168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] Creating event network-changed:f28635c9-1b32-4e8a-af3a-3ca7952c962f for instance ebbda252-08e1-428a-92d8-b6703607f790 on n-h1-master-1 Oct 19 00:45:54.962241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bcd13029-c2e1-4060-a722-e8725c4cc1b8 req-02dc8b6c-9089-4f7f-b909-4b9f28df8b83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099255 Oct 19 00:45:54.965020 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 349/654] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:54.982432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:54.984861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:54.999263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.003473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.005749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.007141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.010943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.013672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.111143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:55.124413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-949f5dc8-27f6-4814-a5b4-e2df8c78b848 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 1.019762 Oct 19 00:45:55.126655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 306/655] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:55.138318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:55.139230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:55.152517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.156298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.157079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.158413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:55.159031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:55.161058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:55.432514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2b6690b-bb5a-4cec-b9f9-30bc923849a9 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.303987 Oct 19 00:45:55.433641 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 307/656] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:45:55 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a/os-interface => generated 285 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:55.955179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-651247115", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:56.062677 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:45:56.419178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:56.427300 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37071e7f-d0c6-4f27-891f-eda8f8fc8859 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 1.460397 Oct 19 00:45:56.453577 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 350/657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:54 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:56.463666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:56.464726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:56.473906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.476510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.479872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.480831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.481387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.482118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.707075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:56.721402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:56.729527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:56.742709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92c2136f-5c60-463d-a838-e5d43de9b451 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.287723 Oct 19 00:45:56.743311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 351/658] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:56 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:56.757133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:56.758230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:56.768598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.769465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.770057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.770937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.771543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.772822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.913281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:45:56.913802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:45:56.914314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:45:56.914818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:45:56.915818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:45:56.947659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.953597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.956772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:56.960954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:56.967093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:56.968221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.024787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Getting quotas for project e62838577e3e4c8189e936f3453b2fa4. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:45:57.042639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Getting quotas for user f268dddf034d43ed9d679dd7396836cc and project e62838577e3e4c8189e936f3453b2fa4. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:45:57.077679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:45:57.083985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:45:57.207704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d027aaf4-492b-42ca-a8cd-523a39986a3f tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.772689 Oct 19 00:45:57.208681 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 308/659] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:45:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:45:57.222355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:57.223360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:57.237358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:57.250968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9470570b-a704-445b-be73-fa237c4d5179 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 0.506571 Oct 19 00:45:57.251601 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 352/660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:56 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:57.255497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.257411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.261335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.265040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.266274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.266962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.564594 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:57.650696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9299a2f-daea-433a-90cb-9e489b821930 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-398289483", "id": 1580991783, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:57.701918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9299a2f-daea-433a-90cb-9e489b821930 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.447587 Oct 19 00:45:57.706648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 353/661] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:45:57 2022] POST /compute/v2.1/flavors => generated 467 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:57.717757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "name": "network-vif-plugged", "status": "completed", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:57.749320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.752085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.752599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.769060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] Creating event network-vif-plugged:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h2-master-1 Oct 19 00:45:57.775290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f6159768-8ec1-41f9-8f97-ad2ffc76cad8 req-495bfb9b-96e1-4817-9811-04ffa70046a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066642 Oct 19 00:45:57.781063 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 354/662] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:57.789483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6be4cf6a-2f42-4d52-92b0-3bb5be534ef0 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:57.790456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6be4cf6a-2f42-4d52-92b0-3bb5be534ef0 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:57.873312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:57.882455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ef1220a-1bfe-4448-89c9-412ea49bb7d2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 0.671756 Oct 19 00:45:57.883143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 309/663] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:57 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:57.907859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:57.909404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:57.912606 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:45:57.932074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.933132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.933132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:57.933990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:57.934484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:57.934964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.188414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6be4cf6a-2f42-4d52-92b0-3bb5be534ef0 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.207531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6be4cf6a-2f42-4d52-92b0-3bb5be534ef0 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1213 microversion: 2.1 time: 0.424439 Oct 19 00:45:58.208127 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 355/664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:57 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1213 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:58.213762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8420be42-a346-400b-8016-036059e86fe6", "tag": "d8b53f91-19b7-464e-b0d7-2b6774f8a872"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:58.252383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.252987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.253499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.282527 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] Creating event network-changed:d8b53f91-19b7-464e-b0d7-2b6774f8a872 for instance 8420be42-a346-400b-8016-036059e86fe6 on n-h1-master-1 Oct 19 00:45:58.295979 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-33a30bec-3936-4e1c-aa1e-302e852ef190 req-aaa184b4-219a-4ff3-ad94-3cd3821f54d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086367 Oct 19 00:45:58.297332 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 356/665] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:58.732932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.747089 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3cfbfc3f-edc3-433e-a8a7-57ecd53e3da4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 0.844173 Oct 19 00:45:58.754269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 310/666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:57 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:45:58.772746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:58.782319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:58.804856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.805776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.806459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.807422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.808219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.808898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.903846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-93934f5c-0481-4ba9-bccc-53bb7f9c0ce8 tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:58.918080 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-93934f5c-0481-4ba9-bccc-53bb7f9c0ce8 tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] 10.222.0.27 "GET /compute/v2.1/flavors/1580991783" status: 200 len: 467 microversion: 2.61 time: 0.619283 Oct 19 00:45:58.921231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 357/667] 10.222.0.27 () {60 vars in 1199 bytes} [Wed Oct 19 00:45:58 2022] GET /compute/v2.1/flavors/1580991783 => generated 467 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:45:58.945605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:58.946386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:58.971665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.984005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.984866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.985490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.988568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:58.989648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:58.990453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:58.991144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:45:58.993350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:59.008447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cc2b5a1a-54c6-4918-8a30-f3f3cdf31c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.252776 Oct 19 00:45:59.009838 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 311/668] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:45:58 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:45:59.018786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db52e5e4-aff1-41b6-aadd-134edc28172a", "tag": "dd28523d-1e9b-43d8-a9f1-2857f4550de0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:45:59.043592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:59.044371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:59.045079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:59.074481 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] Creating event network-changed:dd28523d-1e9b-43d8-a9f1-2857f4550de0 for instance db52e5e4-aff1-41b6-aadd-134edc28172a on n-h2-master-1 Oct 19 00:45:59.089473 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-910083e1-e53f-4135-8b77-935aa3808f63 req-02cf04ed-d60f-4944-8067-2134b976bef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076896 Oct 19 00:45:59.091230 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 312/669] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:45:59.103045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:45:59.104121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:45:59.119701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:59.122102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:59.125508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:45:59.126880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:45:59.127749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:45:59.129269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.029969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:00.040586 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77a52ccc-fc87-494d-a8dc-7bb44d075ae5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1589 microversion: 2.1 time: 1.113714 Oct 19 00:46:00.041215 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 358/670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:58 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1589 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:00.075089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:00.096191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:00.114391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.120710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.126991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.134300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.135499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.137722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.292415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:00.327064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04110369-5804-4962-9b68-1e36a9a18511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1313 microversion: 2.1 time: 1.232881 Oct 19 00:46:00.327692 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 313/671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:45:59 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1313 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:00.354097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-23abdec5-52ac-463e-816b-4fb7e69911af tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:00.436461 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-23abdec5-52ac-463e-816b-4fb7e69911af tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1580991783" status: 200 len: 468 microversion: 2.61 time: 0.104199 Oct 19 00:46:00.437087 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 314/672] 10.222.0.27 () {62 vars in 1219 bytes} [Wed Oct 19 00:46:00 2022] PUT /compute/v2.1/flavors/1580991783 => generated 468 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:46:00.445469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:00.450753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:00.470871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.474170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.475446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.477723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.478450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.480511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.743384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:00.770179 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8713b342-592e-48d7-b69a-aa516b87502d tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1273 microversion: 2.1 time: 0.331618 Oct 19 00:46:00.776320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 315/673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:00 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:00.785740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:00.797872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:00.819767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.825875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.827274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.829176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:00.830045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:00.845739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:00.997393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.015849 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36f1503a-1e38-4ed1-97eb-264330462b36 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 0.946685 Oct 19 00:46:01.016725 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 359/674] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:00 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:01.028779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.029634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:01.046065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.046976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.046976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.050078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.054284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.054835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.199806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.215726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.217484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.232171 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:01.234590 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2550d832-d583-4bfc-8b98-983713f9f783 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.216638 Oct 19 00:46:01.251700 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 360/675] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:01.263704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d54f698c-13f0-4faf-a188-ea37fdc290ed tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.292931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d54f698c-13f0-4faf-a188-ea37fdc290ed tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.039965 Oct 19 00:46:01.293870 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 361/676] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:01.332599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0bc94d16-ae69-46d8-b524-9e54556f62ea tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.376449 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0bc94d16-ae69-46d8-b524-9e54556f62ea tempest-FlavorsV261TestJSON-802803188 tempest-FlavorsV261TestJSON-802803188-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.057291 Oct 19 00:46:01.377409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 362/677] 10.222.0.27 () {60 vars in 1166 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:46:01.382909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.383758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:01.391334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.400454 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45c9c94d-b773-47d8-b61a-f3b54f4877d2 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 0.622152 Oct 19 00:46:01.414124 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 316/678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:00 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:01.420308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.420308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.420308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.429233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.430464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.430803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.436194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1df945da-f4b3-47d4-b2ce-847629ac4d02 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.498496 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1df945da-f4b3-47d4-b2ce-847629ac4d02 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1580991783" status: 202 len: 0 microversion: 2.61 time: 0.078230 Oct 19 00:46:01.499434 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 317/679] 10.222.0.27 () {60 vars in 1202 bytes} [Wed Oct 19 00:46:01 2022] DELETE /compute/v2.1/flavors/1580991783 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:01.513051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4e7dc6e-9ecd-488b-92a2-d193f99b2527 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.590734 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4e7dc6e-9ecd-488b-92a2-d193f99b2527 tempest-FlavorsV261TestJSON-1085616508 tempest-FlavorsV261TestJSON-1085616508-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6694 microversion: 2.61 time: 0.085302 Oct 19 00:46:01.592017 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 318/680] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/flavors/detail => generated 6694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:01.822404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:01.823027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:01.859895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.864345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.868727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.873052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:01.874041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:01.876135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:01.970104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:01.993487 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-122dcbce-3b92-48de-8e0e-08e62567329d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1462 microversion: 2.1 time: 0.601983 Oct 19 00:46:01.994766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 363/681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1462 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:02.025031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:02.027917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:02.045608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:02.046377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:02.048195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:02.050768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:02.051775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:02.055704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:02.613364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:02.621372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Old instance type m1.heat2, new instance type m1.heat {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 00:46:02.642902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:02.643983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:02.647301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:02.647923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:02.650937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:02.651373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:02.665087 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3dc7d76-b1ec-4b16-9724-b53a119e4ffa tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1271 microversion: 2.1 time: 0.836150 Oct 19 00:46:02.680040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 319/682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:01 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1271 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:02.688866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:02.689503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:02.698581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:02.699357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:02.700017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:02.701009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:02.701696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:02.702329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:02.891102 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c999cdf-640a-4481-b8d8-c4148cf53053 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8/action" status: 202 len: 0 microversion: 2.1 time: 0.870560 Oct 19 00:46:02.895976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 364/683] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:02 2022] POST /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:02.915625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbda252-08e1-428a-92d8-b6703607f790", "name": "network-vif-plugged", "status": "completed", "tag": "f28635c9-1b32-4e8a-af3a-3ca7952c962f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:02.952946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:02.958546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:02.960067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.002518 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] Creating event network-vif-plugged:f28635c9-1b32-4e8a-af3a-3ca7952c962f for instance ebbda252-08e1-428a-92d8-b6703607f790 on n-h1-master-1 Oct 19 00:46:03.028912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-31d859ff-21da-48dd-85a8-d78b75fabe80 req-fdcc9149-2a1c-4a5e-8a4e-fd5e7828bbac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128697 Oct 19 00:46:03.031823 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 365/684] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:03.045959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:03.048805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:03.066395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.070207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.070979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.088720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.093275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.094220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.466755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:03.480114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:03.486844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:03.498876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10f077f1-ad52-4c53-a19c-2142be5f412f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.464137 Oct 19 00:46:03.511665 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 366/685] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:03 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:03.520521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:03.522870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:03.534411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.535313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.536157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.538179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.538988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.539714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.738315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:03.775034 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3c368698-eac6-4518-a122-24666aefa74a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 1.093648 Oct 19 00:46:03.775703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 320/686] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:02 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:03.802814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:03.804077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:03.848036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.848563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.849024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.850304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:03.850924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:03.878178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:03.986306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:03.994583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2533806e-0861-4c57-8e50-86474809da1a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 0.481521 Oct 19 00:46:04.005166 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 367/687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:03 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:04.011886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:04.012982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:04.027159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.028054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.028728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.029656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.031027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.035294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.396761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:04.442596 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-007f6e14-4bf3-483a-8268-ec7788467a23 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1471 microversion: 2.1 time: 0.660434 Oct 19 00:46:04.452675 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 321/688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:03 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1471 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:04.543574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:04.545034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:04.591564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.592054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.592514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.593262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.593812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.594623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.681601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:04.691500 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e5fe62a-bd5d-49bd-8972-3a17006589ce tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.684616 Oct 19 00:46:04.694662 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 368/689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:04 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:04.802101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:04.803035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:04.811649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.814551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.816717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.819783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:04.822333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:04.823123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:04.832688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:04.852765 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:04.862711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:04.888276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab27a1ef-e5d2-4e72-b0ea-5c9fc1040f70 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.350882 Oct 19 00:46:04.905043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 322/690] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:04 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:05.036023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:05.044830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:05.075051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.076586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.077363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:05.078627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.079390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.080773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:05.141495 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:05.612666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:05.623039 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad636477-c14c-4b66-a802-58d00fd8c50d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 0.595566 Oct 19 00:46:05.644770 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 323/691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:05 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:05.650093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:05.653488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:05.666933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.667747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.673296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:05.674398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.675079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.675715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:05.724015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:05.732773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5861ab2-2d2e-493f-9978-0c553f6361e0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1313 microversion: 2.1 time: 0.935185 Oct 19 00:46:05.736165 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 369/692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:04 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1313 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:05.752645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:05.753573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:05.772911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.773732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.774464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:05.779812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:05.780557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:05.781285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.238645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:06.247645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3e58653-f075-4cd3-a149-6dcd34b9ca74 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1471 microversion: 2.1 time: 0.601370 Oct 19 00:46:06.248248 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 324/693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:05 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1471 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:06.282522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:06.282522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:06.305550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.306447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.309295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.310338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.311170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.315341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.371537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:06.385995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-89be3d70-a953-44fd-8a9c-a8957e6f7057 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.648447 Oct 19 00:46:06.387243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 370/694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:05 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:06.410798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8420be42-a346-400b-8016-036059e86fe6", "name": "network-vif-plugged", "status": "completed", "tag": "d8b53f91-19b7-464e-b0d7-2b6774f8a872"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:06.433881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.434558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.435171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.470520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] Creating event network-vif-plugged:d8b53f91-19b7-464e-b0d7-2b6774f8a872 for instance 8420be42-a346-400b-8016-036059e86fe6 on n-h1-master-1 Oct 19 00:46:06.484553 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5ba954ff-0caf-4af0-9d94-8fe648723289 req-fbf5750b-4ce2-4e2f-8e66-f5760fc8cdbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078915 Oct 19 00:46:06.489017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 371/695] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:06.528895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:06.544659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:06.551098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:06.566866 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cef2e435-b12f-4c1e-9a2d-31adf4dec2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.314004 Oct 19 00:46:06.592803 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 325/696] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:06 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:06.653626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:06.654682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:06.668469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.669020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.670411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.671405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.672248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.674503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.698293 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:06.765585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:06.766214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:06.784584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.785227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.785690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.786503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:06.787191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:06.787691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:06.991558 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:07.061285 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=47,nova_cell0:UPDATE=7 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:07.429185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:07.439249 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc02d5f6-8be8-4b4e-8fbd-ee998f93d7d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1310 microversion: 2.1 time: 0.791285 Oct 19 00:46:07.461561 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 372/697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:06 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1310 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:07.466953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:07.468147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:07.474861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:07.475735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:07.476390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:07.477397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:07.478141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:07.478840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:07.494653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:07.511864 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80c8bebf-dd1e-4eaa-8154-69f41c363a5a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1463 microversion: 2.1 time: 0.748259 Oct 19 00:46:07.526053 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 326/698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:06 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1463 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:07.543177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:07.543851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:07.554879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:07.555383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:07.556337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:07.557310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:07.557841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:07.558436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:08.031841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:08.051890 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f990a1f-4eba-4444-8823-d46718d34ac2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1471 microversion: 2.1 time: 0.588640 Oct 19 00:46:08.072712 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 373/699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:07 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1471 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:08.132350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:08.167623 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01a3cf49-7873-4d71-ae0b-b31aad8061c7 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.639277 Oct 19 00:46:08.179203 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 327/700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:07 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:08.192825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:08.196694 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=21 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:08.202140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:08.219766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:08.222218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:08.222906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:08.228423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:08.229973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:08.230633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:08.840544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:08.848087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'deleted': False, 'project_id': '3f086c8824d84edd98b3c5ca4f6b7f72'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:08.866120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:08.866615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:08.867052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:08.867785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:08.875834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:08.876649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:08.915920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:08.935686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:08.938349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:08.952106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6875556e-0e22-4d1f-ad5d-41f3edf4d3b9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.771327 Oct 19 00:46:08.955773 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 328/701] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:08 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:08.962431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c83557ff-b5e5-463b-a1da-432368096eb9", "tag": "78805b5e-ad42-427c-b833-5b36b8323325"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:08.977904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:08.978806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:08.979634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.020781 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] Creating event network-changed:78805b5e-ad42-427c-b833-5b36b8323325 for instance c83557ff-b5e5-463b-a1da-432368096eb9 on n-h2-master-1 Oct 19 00:46:09.035411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a999b770-e46e-4e36-aac2-9ced30e1f078 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.961136 Oct 19 00:46:09.040872 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1f21fc78-9ad9-4969-82b6-f5f563c13af2 req-721750f0-8cc5-4f86-aa0a-7aa0f0833fab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083089 Oct 19 00:46:09.044698 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 329/702] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:09.053907 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 374/703] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:46:08 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:09.060544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:09.062541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:09.067412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:09.081619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'deleted': False} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:09.085475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.086695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.088824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.091612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.092902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.093912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.098280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.100051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.101205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.102964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.104219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.106801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.349038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:09.361719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b461d05-a65c-448e-93fd-3e3cf87d99e4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1493 microversion: 2.1 time: 0.314207 Oct 19 00:46:09.368250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:46:09.387127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 330/704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:09 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:09.393673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:09.394553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:09.407287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.408602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.409196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.410222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.410795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.411324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.534288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.534796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.535251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.639994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:09.654085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d03520e-875e-448d-906a-16c17f00f4bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.265496 Oct 19 00:46:09.655376 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 331/705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:09 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:09.661746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:09.663507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:09.673014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.675725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.677625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:09.680357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:09.681700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:09.682967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.104429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:10.117567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd2a4fb2-7c82-46f1-a813-a1c8e3fcf844 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.460232 Oct 19 00:46:10.119575 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 332/706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:09 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:10.161343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5fc0244-6103-4671-8f2a-fa42edcafd4b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 16082 microversion: 2.1 time: 1.100340 Oct 19 00:46:10.162203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 375/707] 10.222.0.27 () {58 vars in 1171 bytes} [Wed Oct 19 00:46:09 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 16082 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:46:10.169267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.170638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:10.211491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.213030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.214433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.215748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.218262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.220182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.267422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Calling method '.version_select at 0x7f2af5861790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.275344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.279107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.279819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.280970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.282580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.283250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.335279 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83e8633f-75b1-4b9f-938e-887adf0b3480 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.204553 Oct 19 00:46:10.343060 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 333/708] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:10.364516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.366401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:10.375154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.375662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.376120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.376877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.377759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.378201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.584060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:10.595502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:10.597949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-379706c7-38a5-47b4-acbc-02d66d7ed4fe tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1644 microversion: 2.1 time: 0.433217 Oct 19 00:46:10.601186 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 376/709] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1644 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:10.605972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:10.609125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.615722 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9073fc2a-cbcf-43a3-973f-a0678f4bf3ab tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.271897 Oct 19 00:46:10.617214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'deleted': False, 'project_id': '3f086c8824d84edd98b3c5ca4f6b7f72'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:10.624269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.625089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.625717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.626655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.627131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.627546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.631651 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 334/710] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:10.698122 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aadeb83d-9d9b-467c-8bab-1d2a23b31edc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=e0ee493430f849718083118f0a4e61c0" status: 200 len: 15 microversion: 2.1 time: 0.095407 Oct 19 00:46:10.698707 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 377/711] 10.222.0.27 () {58 vars in 1231 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/servers/detail?tenant_id=e0ee493430f849718083118f0a4e61c0 => generated 15 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:10.720492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.720492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:10.742549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.747152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.748635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.749779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.752324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.753889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.904802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3e226d4-05ed-4adf-82a2-a8f82af05a31 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Calling method '.version_select at 0x7f2af5778f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.914747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3e226d4-05ed-4adf-82a2-a8f82af05a31 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3e226d4-05ed-4adf-82a2-a8f82af05a31 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:10.917872 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:46:10.920677 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:10.922553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 19 00:46:10.924968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:10.926968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3e226d4-05ed-4adf-82a2-a8f82af05a31 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:10.926968 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3e226d4-05ed-4adf-82a2-a8f82af05a31 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.286741 Oct 19 00:46:10.926968 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 335/712] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 294 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:10.932026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:10.932942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:10.947501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.948028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.948651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:10.949487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:10.949966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:10.950395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:11.405556 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9052e405-5c76-440e-a213-e0ed5d16d212 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1644 microversion: 2.1 time: 0.688864 Oct 19 00:46:11.406679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 378/713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1644 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:11.417202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:11.428323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'tenant_id': 'e0ee493430f849718083118f0a4e61c0', 'deleted': False} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:11.436039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:11.437415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:11.438131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:11.438334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:11.439437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:11.441284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:11.441893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:11.454225 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc4bd255-1367-4bee-8a61-03314e99dc56 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.527020 Oct 19 00:46:11.457557 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 336/714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:10 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:11.469023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-daf26571-601d-4485-b6ac-705e9fe4742e tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Calling method '.version_select at 0x7f2af578dee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:11.475715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-daf26571-601d-4485-b6ac-705e9fe4742e tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-daf26571-601d-4485-b6ac-705e9fe4742e tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hosts/n-d-master-1/reboot HTTP/1.1 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:11.480115 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'n-d-master-1'} Oct 19 00:46:11.481849 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:11.482788 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 19 00:46:11.484116 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:11.486603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-daf26571-601d-4485-b6ac-705e9fe4742e tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:11.488979 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-daf26571-601d-4485-b6ac-705e9fe4742e tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027895 Oct 19 00:46:11.491079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 337/715] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Oct 19 00:46:11 2022] GET /compute/v2.1/os-hosts/n-d-master-1/reboot => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:11.499040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:46:11.548601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:11.558597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:11.569836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:11.570445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:11.571027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:11.572461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:11.573049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:11.573558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:11.614315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:11.615441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:11.615948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.037371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.050494 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c43f7b0a-aee0-4346-b5d8-dd22468d7889 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e0ee493430f849718083118f0a4e61c0" status: 200 len: 4826 microversion: 2.1 time: 0.637092 Oct 19 00:46:12.051211 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 379/716] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 00:46:11 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=e0ee493430f849718083118f0a4e61c0 => generated 4826 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:12.057032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.060973 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c522ec4-4ca3-4fc8-9675-89ad70c75576 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.568063 Oct 19 00:46:12.061471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.061595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 338/717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:11 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:12.062770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.064010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.065015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.065650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.066328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.094202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be760d11-10cf-4c23-b066-f3fce132399f tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Calling method '.version_select at 0x7f2af5ac4c10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.097968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b99c0821-058b-4773-bb10-301a2f69d23a tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045244 Oct 19 00:46:12.100243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 380/718] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:12.105644 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-be760d11-10cf-4c23-b066-f3fce132399f tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.106097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.106899 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be760d11-10cf-4c23-b066-f3fce132399f tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:46:12.111450 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'nonexistent_hostname'} Oct 19 00:46:12.114907 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:46:12.116252 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 00:46:12.118345 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.120330 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.123969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be760d11-10cf-4c23-b066-f3fce132399f tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:12.125560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.125866 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be760d11-10cf-4c23-b066-f3fce132399f tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.048548 Oct 19 00:46:12.126409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.126709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 339/719] 10.222.0.27 () {58 vars in 1212 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:46:12.127625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.129106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.130328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.131833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.146795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.159884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'tenant_id': '3f086c8824d84edd98b3c5ca4f6b7f72', 'deleted': False} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:12.180038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.181077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.181966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.183502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.184603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.185491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.344064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1998b7be-0d08-4091-a30e-75752f6d6fa9 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f086c8824d84edd98b3c5ca4f6b7f72" status: 200 len: 15 microversion: 2.1 time: 0.208864 Oct 19 00:46:12.344656 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 340/720] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3f086c8824d84edd98b3c5ca4f6b7f72 => generated 15 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:12.349584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:12.350616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:12.376975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.376975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.377478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.377938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.377938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.377938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.377938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.382970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.386099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.391879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fdca1926-f7d5-4a93-9fcd-4a55f1444c31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1537 microversion: 2.91 time: 0.289940 Oct 19 00:46:12.392474 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 381/721] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:12.398424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c55ac4c-2536-432a-b83b-0e6db6d17465 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Calling method '.version_select at 0x7f2af5522a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.400757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c55ac4c-2536-432a-b83b-0e6db6d17465 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c55ac4c-2536-432a-b83b-0e6db6d17465 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:46:12.403030 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1'} Oct 19 00:46:12.404420 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:12.405261 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 19 00:46:12.406910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.410083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c55ac4c-2536-432a-b83b-0e6db6d17465 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:12.411189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c55ac4c-2536-432a-b83b-0e6db6d17465 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017363 Oct 19 00:46:12.412169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 382/722] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/os-hosts/n-d-master-1 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:12.417034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0494a429-b39c-41dc-9200-50074d428bed tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.423274 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0494a429-b39c-41dc-9200-50074d428bed tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009815 Oct 19 00:46:12.436695 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 383/723] 10.222.0.27 () {58 vars in 1189 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:12.439417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c40be24a-818f-4e73-8825-bb120c7c9b62 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Calling method '.version_select at 0x7f2af55ec040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.458867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c40be24a-818f-4e73-8825-bb120c7c9b62 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c40be24a-818f-4e73-8825-bb120c7c9b62 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:12.465254 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'nonexistent_hostname'} Oct 19 00:46:12.466661 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.467431 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:12.468610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.469829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c40be24a-818f-4e73-8825-bb120c7c9b62 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:12.469829 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c40be24a-818f-4e73-8825-bb120c7c9b62 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035748 Oct 19 00:46:12.471760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 384/724] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:46:12.478562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:12.481746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:12.489033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.490527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.491279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.492131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.492773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.493282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.565123 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f407e727-27a5-4706-b3ba-a3937559dd82 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6/action" status: 202 len: 0 microversion: 2.1 time: 0.217883 Oct 19 00:46:12.566965 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 341/725] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:12 2022] POST /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:12.577679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.579020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:12.586040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.586934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.587548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.588478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.589163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.589762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.696975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fed74b83-c27f-414e-8ed5-8533b2238f5e tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 0 microversion: 2.1 time: 0.222093 Oct 19 00:46:12.700977 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 385/726] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:12 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:12.706886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3de808a-0841-4c3c-a808-1f05b187f160 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Calling method '.version_select at 0x7f2af71d0e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.708929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d3de808a-0841-4c3c-a808-1f05b187f160 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3de808a-0841-4c3c-a808-1f05b187f160 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hosts/n-d-master-1/shutdown HTTP/1.1 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:46:12.710629 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1'} Oct 19 00:46:12.712316 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:12.714512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 19 00:46:12.715999 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:12.717299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3de808a-0841-4c3c-a808-1f05b187f160 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:12.717299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3de808a-0841-4c3c-a808-1f05b187f160 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009709 Oct 19 00:46:12.717299 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 386/727] 10.222.0.27 () {58 vars in 1194 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/os-hosts/n-d-master-1/shutdown => generated 113 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:12.717925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:12.719890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:12.726500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.727015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.727525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:12.728191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:12.728705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:12.729156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.359870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.380416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a132fd8-ce50-4e48-8d99-48fbfcf2b818 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1649 microversion: 2.1 time: 0.665704 Oct 19 00:46:13.382880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 387/728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1649 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:13.402194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3608a36-efdc-4165-84f0-0f24ee0d7c24 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.832969 Oct 19 00:46:13.406882 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 342/729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:12 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:13.416024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-faadf273-92a8-4247-9342-9f4dbe5cc8f7 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Calling method '.version_select at 0x7f2af6a86940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.429255 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-faadf273-92a8-4247-9342-9f4dbe5cc8f7 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-faadf273-92a8-4247-9342-9f4dbe5cc8f7 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:46:13.431764 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'nonexistent_hostname'} Oct 19 00:46:13.433227 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:46:13.434035 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 00:46:13.435125 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.436251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.438318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-faadf273-92a8-4247-9342-9f4dbe5cc8f7 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.440243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-faadf273-92a8-4247-9342-9f4dbe5cc8f7 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.032140 Oct 19 00:46:13.441377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 343/730] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:46:13.448709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.450159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:13.454331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.460751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.461093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.461784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'e0ee493430f849718083118f0a4e61c0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:13.461945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.462555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.464155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.464999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.465609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.469932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.470647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.471289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.472273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.473233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.473926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.572346 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:46:13.649268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b24142d2-8f6d-45c1-90df-05063532ad35 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.263036 Oct 19 00:46:13.650425 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 388/731] 10.222.0.27 () {58 vars in 1150 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:13.668673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.670318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:13.681417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.682666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.683742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.684712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.686772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.688358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.756419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.767744 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-92531435-a4b6-48cf-99b5-5f3cda3dba61 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.324998 Oct 19 00:46:13.768389 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 344/732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:13.774697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e131a19-09d6-4f7e-9acf-3caa3eea8451 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Calling method '.version_select at 0x7f2af6a86940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.776770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e131a19-09d6-4f7e-9acf-3caa3eea8451 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e131a19-09d6-4f7e-9acf-3caa3eea8451 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-hosts/n-d-master-1/startup HTTP/1.1 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:13.778443 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'n-d-master-1'} Oct 19 00:46:13.780357 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:13.781496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 19 00:46:13.782979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.785259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e131a19-09d6-4f7e-9acf-3caa3eea8451 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.785259 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e131a19-09d6-4f7e-9acf-3caa3eea8451 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.010257 Oct 19 00:46:13.791576 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 345/733] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/os-hosts/n-d-master-1/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:13.803062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.804782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.807488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:13.813284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.814895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.820335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.820968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.821464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.822311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.822818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.823486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.824163 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a44fb1a-fc5b-432f-bfdf-b16a12e34e47 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1537 microversion: 2.91 time: 0.161683 Oct 19 00:46:13.825245 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 389/734] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:13.830665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d93557e2-b5ef-4159-9a8d-1cd8b5ef52ed tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Calling method '.version_select at 0x7f2af55ecd30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.841450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d93557e2-b5ef-4159-9a8d-1cd8b5ef52ed tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d93557e2-b5ef-4159-9a8d-1cd8b5ef52ed tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:13.844273 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'nonexistent_hostname'} Oct 19 00:46:13.845667 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:46:13.846436 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 19 00:46:13.847572 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.850274 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.851789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d93557e2-b5ef-4159-9a8d-1cd8b5ef52ed tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.852657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d93557e2-b5ef-4159-9a8d-1cd8b5ef52ed tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.026197 Oct 19 00:46:13.857721 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 390/735] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:46:13.858049 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:13.867662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3377099-3e3e-4659-a51c-c501f72009b0 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5674c10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3377099-3e3e-4659-a51c-c501f72009b0 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 51 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:13.878087 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: {"status": "enable", "maintenance_mode": "invalid"} Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.881620 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance: Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.882427 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.884369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3377099-3e3e-4659-a51c-c501f72009b0 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3377099-3e3e-4659-a51c-c501f72009b0 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 199 microversion: 2.1 time: 0.019792 Oct 19 00:46:13.885656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 391/736] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 199 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:46:13.900012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc9b5dc7-dcf3-4c1f-b298-b5b87d862b03 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Action: 'update', calling method: .version_select at 0x7f2af55e75e0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc9b5dc7-dcf3-4c1f-b298-b5b87d862b03 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 51 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:13.903988 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: {"status": "invalid", "maintenance_mode": "enable"} Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.905708 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance: Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.906604 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.908549 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc9b5dc7-dcf3-4c1f-b298-b5b87d862b03 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc9b5dc7-dcf3-4c1f-b298-b5b87d862b03 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 189 microversion: 2.1 time: 0.009782 Oct 19 00:46:13.911407 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 392/737] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 189 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:46:13.915975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2632197-6778-4271-9a9e-6826d7a867e5 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Action: 'update', calling method: .version_select at 0x7f2af5563a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.919650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c2632197-6778-4271-9a9e-6826d7a867e5 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'cdd7ac4e5a1a4a7aa1108dd96b345253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ea5b720ddab4e6d9cd381dc755b6f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2632197-6778-4271-9a9e-6826d7a867e5 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Request method failure captured: Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 50 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jOdx9q0M62NpidJoCEyrYDbG8VFTpnNU8bxpHGf0FJfmc8GVbLmObz3gvMuqyBmG6fz4mL7oTfWU3koq7ZbHiw56Q6AnY0RDxH7RJSLWbx6Ck7bgPgNUHxoF78rINKlN9_NShuTO7e24G11yR1nCofMRfC8SnZXiHhUwr9hTUWRC8 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:46:13.922162 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9ea5b720ddab4e6d9cd381dc755b6f26", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9ea5b720ddab4e6d9cd381dc755b6f26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9ea5b720ddab4e6d9cd381dc755b6f26"}]}] Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9ea5b720ddab4e6d9cd381dc755b6f26 Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-839522209 Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cdd7ac4e5a1a4a7aa1108dd96b345253 Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-839522209-project Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 00:46:13.923754 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:13.924802 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 19 00:46:13.926381 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.929329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2632197-6778-4271-9a9e-6826d7a867e5 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.930240 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c2632197-6778-4271-9a9e-6826d7a867e5 tempest-HostsAdminNegativeTestJSON-839522209 tempest-HostsAdminNegativeTestJSON-839522209-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 403 len: 111 microversion: 2.1 time: 0.018890 Oct 19 00:46:13.935308 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 393/738] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:13.940082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d4ac256-e036-479c-bf88-d2f60d90b1f9 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Action: 'update', calling method: .version_select at 0x7f2af56f4ca0>, body: {"status": null, "maintenance_mode": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d4ac256-e036-479c-bf88-d2f60d90b1f9 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-hosts/n-d-master-1 HTTP/1.1 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 42 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:13.945515 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: {"status": null, "maintenance_mode": null} Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 00:46:13.947464 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'n-d-master-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'disable', Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Enable', Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'Disable', Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance: Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi None Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.948655 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.950866 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d4ac256-e036-479c-bf88-d2f60d90b1f9 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d4ac256-e036-479c-bf88-d2f60d90b1f9 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-master-1" status: 400 len: 127 microversion: 2.1 time: 0.010931 Oct 19 00:46:13.955947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 394/739] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:46:13 2022] PUT /compute/v2.1/os-hosts/n-d-master-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:46:13.956784 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29707ef3-cf99-4444-abab-100f0ce185fc tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 0 microversion: 2.1 time: 0.151326 Oct 19 00:46:13.956784 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 346/740] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:13 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:13.961113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:13.961496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:13.968126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Action: 'update', calling method: .version_select at 0x7f2af70d4f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:13.971043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.hosts [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Enabling host nonexistent_hostname. Oct 19 00:46:13.975882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.976384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.976892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.977621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:13.978086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:13.978523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:13.989267 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Request method failure captured: Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 50 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jQh-Zi87rOEIGOvoG2d_TUluXVRkSra14ae5fxeELW6B2ZQVFj8u313SPnCKj5raGjJJRuNUulp6dlyvPEl8NCiJrMrF4gCc4Fs1rCG4jBHlEhd5q_xsVgxuDhqAgXb1ebfvrBWXEUhodmQOGGdfikLbfUfHMlE0uCJ3JA-jQTa10 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:46:13.993087 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_209ec766e42844a0bd50c06d4ae3e43e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/209ec766e42844a0bd50c06d4ae3e43e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/209ec766e42844a0bd50c06d4ae3e43e"}]}] Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 209ec766e42844a0bd50c06d4ae3e43e Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-375578345 Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d40e09d984e648c3999404ee621ae60a Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-HostsAdminNegativeTestJSON-375578345-project-admin Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: {"status": "enable", "maintenance_mode": "enable"} Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.994698 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 19 00:46:13.995669 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:13.996764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:13.997913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:14.000174 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b83ba457-356b-4166-bb01-21f72e52bd24 tempest-HostsAdminNegativeTestJSON-375578345 tempest-HostsAdminNegativeTestJSON-375578345-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.039929 Oct 19 00:46:14.000174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 395/741] 10.222.0.27 () {60 vars in 1211 bytes} [Wed Oct 19 00:46:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:46:14.314860 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fbe84bf-d1f4-4b4e-843d-125515ed307f tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1614 microversion: 2.1 time: 0.358051 Oct 19 00:46:14.315442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 347/742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:13 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1614 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:14.341432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:14.341946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:14.348894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.349732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.350450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:14.351256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.351802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.352307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:14.436367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:14.437017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:14.444555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.445097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.445540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:14.446286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.446816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.447312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:14.662273 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2c97ef39-cd51-4afd-a961-e0ffba17a300 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1614 microversion: 2.1 time: 0.324407 Oct 19 00:46:14.663176 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 396/743] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:14 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1614 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:14.668761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:14.669715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:14.681581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.682241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.683183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:14.683618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:14.684272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:14.684808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.118603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:15.122807 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:15.162449 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8373c0a8-ed56-47e1-ae73-8d000336f53d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.492461 Oct 19 00:46:15.169083 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 397/744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:14 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:15.174261 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:15.197060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'host': 'n-h1-master-1', 'deleted': False} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:15.202022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd474a5f-0385-44e0-bf34-ed7f2873471f tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1629 microversion: 2.1 time: 0.768898 Oct 19 00:46:15.203143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.203563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.204009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.206724 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 348/745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:14 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1629 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:15.231597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:15.232417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.233026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.233525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.236056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:15.265176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.266466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.269076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.271888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.277968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.279894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.459610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:46:15.680371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:15.695692 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bad082ab-dd2b-4430-ac11-722c1038e131 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.483109 Oct 19 00:46:15.715299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69d29ef5-7c44-4e75-8f4b-2cf499771774 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1" status: 200 len: 1646 microversion: 2.1 time: 0.544983 Oct 19 00:46:15.715850 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 349/746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:15 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:15.717093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 398/747] 10.222.0.27 () {58 vars in 1190 bytes} [Wed Oct 19 00:46:15 2022] GET /compute/v2.1/servers?host=n-h1-master-1&all_tenants=1 => generated 1646 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:15.721162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:15.722254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:15.725079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:15.728909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:15.733601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.734524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.736083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.737327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.737558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.738246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.738848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.741915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.742487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.744132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.744970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.749497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.817625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lazy-loading 'flavor' on Instance uuid 8420be42-a346-400b-8016-036059e86fe6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:15.853547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Going to try to live migrate instance to n-h2-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:46:15.887173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:15.899649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:15.907206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:15.920170 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:15.930344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b808cb7a-a7ec-409f-99d7-11fc544bdc43 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1540 microversion: 2.91 time: 0.213417 Oct 19 00:46:15.933290 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 350/748] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:15 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1540 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:15.941254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83557ff-b5e5-463b-a1da-432368096eb9", "name": "network-vif-plugged", "status": "completed", "tag": "78805b5e-ad42-427c-b833-5b36b8323325"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:15.955409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:15.956249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:15.956692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:15.976990 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] Creating event network-vif-plugged:78805b5e-ad42-427c-b833-5b36b8323325 for instance c83557ff-b5e5-463b-a1da-432368096eb9 on n-h2-master-1 Oct 19 00:46:15.983908 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-db6c3925-48d6-468b-91d3-83eeb9dd663b req-4652cf68-dc18-4c44-932c-e8c873c9be90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048202 Oct 19 00:46:15.988948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 351/749] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:15.994797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:16.004232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:46:16.011968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.012457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.012999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.013749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.014211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.014657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.171519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-89ed7727-d4a4-42f4-8e2f-12187ea4cbf2 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.181185 Oct 19 00:46:16.185186 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 352/750] 10.222.0.27 () {58 vars in 1196 bytes} [Wed Oct 19 00:46:15 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:46:16.192443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:16.196604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:16.208000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.210124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.210124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.210495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.211141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.211945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.313876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-master-1". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 00:46:16.508899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9b1bb3f-f8b9-4f20-9885-ee379bf3625b tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action" status: 202 len: 0 microversion: 2.91 time: 0.322323 Oct 19 00:46:16.513052 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 353/751] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:46:16 2022] POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:16.518759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:16.521296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:16.530183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.530928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.531577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.532695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.549550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.550677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.724036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07d6a04c-f29f-404e-8979-2946bde6885b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 0 microversion: 2.1 time: 0.209527 Oct 19 00:46:16.725426 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 354/752] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:16 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:16.735828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:16.736448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:16.771318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.772245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.772929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.773783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:16.774342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:16.775145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:16.999394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:17.011565 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b61b937-f55c-432f-bfeb-206ac5c4d0bb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.283787 Oct 19 00:46:17.022011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 355/753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:16 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:17.032911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:17.035012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:17.047487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.048770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.049180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:17.050295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.050795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.051644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:17.244552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:17.262701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:17.266291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:17.272570 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0cecb7e9-53bc-4beb-b2b7-f35cc5180f6d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1488 microversion: 2.91 time: 0.249591 Oct 19 00:46:17.273951 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 356/754] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:17 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1488 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:17.304254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:17.306962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:17.315128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.315855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.316463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:17.317242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.317698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.318156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:17.639220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:17.713287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d89ed27-5b02-4bed-8c0c-0bad31169020 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1313 microversion: 2.1 time: 0.419446 Oct 19 00:46:17.714375 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 357/755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:17 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1313 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:17.731764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:17.750695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:17.819931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.820873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.821689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:17.830231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:17.831451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:17.836756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.059605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:18.060149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:18.060770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:18.061424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:18.062050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:18.160397 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:18.274545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:18.303189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.306492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.310314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.323258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.328931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.330230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.507882 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd277188-371c-4bb6-82e0-de499449bd17 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 1067 microversion: 2.1 time: 0.786339 Oct 19 00:46:18.510420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 358/756] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:17 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 1067 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 00:46:18.530723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:18.544921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:18.563368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.564814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.565650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.567523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.569385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.571794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.912899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:18.938299 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6aa6a7cd-5560-4679-9e23-96ab5d719b06 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.425136 Oct 19 00:46:18.938930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 359/757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:18 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:18.960389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:18.964890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:18.983785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.984423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.986363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:18.987282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:18.988803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:18.989268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:19.289888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:19.355409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:19.359369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:19.394592 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3475b0df-8a71-4a57-af61-3fd07ea792c6 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.442133 Oct 19 00:46:19.397847 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 360/758] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:18 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:19.420468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:19.420468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:19.440685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:19.441599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:19.445172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:19.446010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:19.447589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:19.448405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:19.834443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14f3d363-b93b-4884-98d9-9567d2af47d0 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6/action" status: 202 len: 0 microversion: 2.1 time: 4.114561 Oct 19 00:46:19.836484 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 399/759] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:15 2022] POST /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6/action => generated 0 bytes in 4119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:19.853397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:19.860262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:19.862243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:19.867944 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e216677f-a38c-4bcb-bcad-672968fd1cb3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.470205 Oct 19 00:46:19.869919 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 361/760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:19 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:19.913910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:19.915270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:19.917433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:19.919127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:19.920299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:19.921424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.215355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2097808377", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ca85acb5-6954-40d3-8e06-800b0100320c"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:20.330097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] validate_networks() for [('ca85acb5-6954-40d3-8e06-800b0100320c', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:46:20.371208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:20.388463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3c9e4d7-aca4-4a55-bcd3-4dcab966c1cd tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1463 microversion: 2.1 time: 0.537727 Oct 19 00:46:20.421104 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 400/761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:19 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1463 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:20.428905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:20.429977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:20.438693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.439204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.439644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:20.440396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:20.440938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:20.441555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.011606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:21.032290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f515716f-befe-4743-aaf4-7a53ae197a69 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.609631 Oct 19 00:46:21.033370 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 401/762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:20 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:21.056086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:21.057148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:21.065343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.066292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.066979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.068573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.069410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.070089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.603650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:21.635199 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:21.641126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5abe5e88-7360-4ef0-a137-7a242893828c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.598515 Oct 19 00:46:21.643127 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 402/763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:21 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:21.932689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:21.933261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:21.934030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:21.934030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:21.934454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:21.952607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.959944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.964705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:21.966108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:21.966777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:21.970420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.027274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Getting quotas for project 796e6e3631804c6db3fae3e40e4702fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:22.046335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Getting quotas for user c68fb32e68194933b6c69383572c27b6 and project 796e6e3631804c6db3fae3e40e4702fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:22.075941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:46:22.079289 n-d-master-1 devstack@n-api.service[131450]: WARNING nova.utils [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2097808377 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-209780837 Oct 19 00:46:22.080447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:46:22.191200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Calling method '.version_select at 0x7f2af5869430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.234320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62e899b2-0ddf-4a40-bae5-1717075278c6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.361859 Oct 19 00:46:22.245025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.253621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 362/764] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:46:22.261520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.262011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.280388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.293528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:22.309473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.318012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.318748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.322599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.323497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.327073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.333719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.334591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.335393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.366836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6febc97f-1809-43e7-a48a-920307b60e26 tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/e62838577e3e4c8189e936f3453b2fa4?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993" status: 200 len: 693 microversion: 2.1 time: 0.721298 Oct 19 00:46:22.368801 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 403/765] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Oct 19 00:46:21 2022] GET /compute/v2.1/os-simple-tenant-usage/e62838577e3e4c8189e936f3453b2fa4?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993 => generated 693 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:22.496584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Calling method '.version_select at 0x7f2af58c1430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.501297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.502684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.503305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.522779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.523621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.524258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.563752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.564442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.565080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.574561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:22.581375 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:22.585495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.586332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.586941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.599340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:22.603584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:22.625641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd7e53d3-6b1a-4f3b-940a-d95a4f7ecd74 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.369572 Oct 19 00:46:22.633005 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 363/766] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:22 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:22.653194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.654686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.655296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.667213 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fda46b8f-5055-4ec7-9384-ff3c87f4ae66 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2389 microversion: 2.53 time: 0.288552 Oct 19 00:46:22.667931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.668559 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 404/767] 10.222.0.27 () {60 vars in 1243 bytes} [Wed Oct 19 00:46:22 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2389 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:22.668707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:22.675287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:22.676225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:22.684794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.685944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.686605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.687637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.688399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.689492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.729832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.736483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.736995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:22.738981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:22.740806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:22.748543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.261695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:23.277779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-600196fb-3237-45b9-8ea8-3b0636f56ef3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.607495 Oct 19 00:46:23.291774 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 405/768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:22 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:23.310192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:23.311273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8a39085-90d3-44f7-b4a8-40dbb9aefa10 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.312170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8a39085-90d3-44f7-b4a8-40dbb9aefa10 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:23.325377 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96d24276-226c-4bef-8c31-75dafeea6fff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.689695 Oct 19 00:46:23.335925 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 364/769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:22 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:23.360067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '.version_select at 0x7f2af572aca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.416683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8a39085-90d3-44f7-b4a8-40dbb9aefa10 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:23.424851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8a39085-90d3-44f7-b4a8-40dbb9aefa10 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1232 microversion: 2.1 time: 0.121156 Oct 19 00:46:23.443118 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 406/770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:23 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1232 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:23.443118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.443118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:23.443677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.443677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.443677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.452529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.458880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.459936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.461498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.462338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.466248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.515229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.519499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.522501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.595975 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0acc0dd3-098a-4f17-af14-13562ce42c3b tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/e62838577e3e4c8189e936f3453b2fa4?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993" status: 200 len: 694 microversion: 2.1 time: 0.265792 Oct 19 00:46:23.599933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 365/771] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Oct 19 00:46:23 2022] GET /compute/v2.1/os-simple-tenant-usage/e62838577e3e4c8189e936f3453b2fa4?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:23.616852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Calling method '.version_select at 0x7f2af5a69790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.632344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.633240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.636162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.692686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.693531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.694309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.791507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.792190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.793072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.821181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.825298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.825907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.893431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.893956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.894394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.907663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6174f5bc-f9e8-4437-93fa-df442cd4bf9c tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1081 microversion: 2.53 time: 0.306104 Oct 19 00:46:23.917133 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 366/772] 10.222.0.27 () {60 vars in 1222 bytes} [Wed Oct 19 00:46:23 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1081 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:23.923476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Calling method '.version_select at 0x7f2af5ab2820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:23.939421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.940572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.941237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:23.968215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:23.968215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:23.970637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.063981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:24.069328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-061389d9-7d1b-4923-9f85-907de26cd32a tempest-TenantUsagesTestJSON-1159557887 tempest-TenantUsagesTestJSON-1159557887-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993&detailed=1" status: 200 len: 9520 microversion: 2.1 time: 0.150756 Oct 19 00:46:24.070680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 367/773] 10.222.0.27 () {58 vars in 1335 bytes} [Wed Oct 19 00:46:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T00%3A46%3A20.407993&end=2022-10-20T00%3A46%3A20.407993&detailed=1 => generated 9520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:24.077353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8420be42-a346-400b-8016-036059e86fe6", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b53f91-19b7-464e-b0d7-2b6774f8a872"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:24.091246 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4f6e3fb-a78f-4d12-820d-fa136cc6b495 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.661043 Oct 19 00:46:24.097003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.097922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.098702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.116338 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 407/774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:23 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:24.121697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.127966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.131135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] Creating event network-vif-unplugged:d8b53f91-19b7-464e-b0d7-2b6774f8a872 for instance 8420be42-a346-400b-8016-036059e86fe6 on n-h1-master-1 Oct 19 00:46:24.139731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-de5ccc3f-a3f1-4b82-80bc-ee507c916611 req-3f7d6bca-6624-420c-839b-2e111e09cb8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067475 Oct 19 00:46:24.145106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 368/775] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:24.149582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.150130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.154640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Calling method '.version_select at 0x7f2af59f4550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.164657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.165158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.182465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.182590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.182590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.182590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.182590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.212582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.213505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.214212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.231339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68f84f36-5221-49e4-9fc2-06954b98dc22 tempest-HypervisorAdminV253TestBase-1119696193 tempest-HypervisorAdminV253TestBase-1119696193-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2a4218a3-7dc8-4456-8712-48d6dca541d5" status: 200 len: 792 microversion: 2.53 time: 0.084023 Oct 19 00:46:24.244440 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 369/776] 10.222.0.27 () {60 vars in 1298 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/os-hypervisors/2a4218a3-7dc8-4456-8712-48d6dca541d5 => generated 792 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:46:24.250531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.251562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.259910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.260715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.261419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.262452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.263189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.263863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.314346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:46:24.370755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:24.387659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:24.391341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:24.410619 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b92f075-6941-4ee1-b066-e48f57747c1b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.306729 Oct 19 00:46:24.425093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 408/777] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:24.440086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.445690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.457036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.458167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.459192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.461553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.462532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.463434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.555900 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce73f60d-eaf1-453a-b1ef-4ca007e3f9e4 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 204 len: 0 microversion: 2.1 time: 0.304716 Oct 19 00:46:24.561401 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 370/778] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:24 2022] DELETE /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:24.575741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:24.576669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:24.600480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.601638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.604564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:24.606842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:24.607671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:24.608324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.353866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:25.366103 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb455010-29ac-440c-a16b-0608022c0ca3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.802078 Oct 19 00:46:25.383356 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 371/779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:25.420941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:25.423408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:25.441842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.443034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.443844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.444765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.445243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.445689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.517033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:25.538660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f78876c1-6341-4162-9f56-35fd5878da18 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 1.107589 Oct 19 00:46:25.539336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 409/780] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:24 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:25.559602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:25.560679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:25.574777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.575861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.576317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.577101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.593976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.594473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.636772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:25.654852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-14ba1925-c8b6-429c-abec-cbc4490db47e tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1284 microversion: 2.1 time: 0.269829 Oct 19 00:46:25.656441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 372/781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:25 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:25.677066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:25.680164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:25.699024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.699581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.700593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:25.702182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:25.706427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:25.706936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.123766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.149471 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e035d2ea-35d4-4f84-a523-8d15e752f852 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1469 microversion: 2.1 time: 0.606734 Oct 19 00:46:26.150389 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 410/782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:25 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1469 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:26.160137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:26.161831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:26.179937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.181344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.182075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.184182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.185174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.186092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.401850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.411923 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-084fa27f-0afe-4111-bb52-dc496e2eb164 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.753540 Oct 19 00:46:26.418445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.440695 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 373/783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:25 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:26.440916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.446804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8420be42-a346-400b-8016-036059e86fe6", "tag": "d8b53f91-19b7-464e-b0d7-2b6774f8a872"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:26.450576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:26.466942 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1dcee118-00fd-4300-a528-cda742548321 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.315264 Oct 19 00:46:26.467719 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 411/784] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:26 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:26.503798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.504758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.506515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.520300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:26.525660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:26.534302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] Creating event network-changed:d8b53f91-19b7-464e-b0d7-2b6774f8a872 for instance 8420be42-a346-400b-8016-036059e86fe6 on n-h1-master-1 Oct 19 00:46:26.552771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c2bf422c-b895-4fac-85d9-f434e9ff68d1 req-7384c942-f411-4ecb-813a-becb6f2a95cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124096 Oct 19 00:46:26.554113 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 374/785] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:26.578277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.578861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.579314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.580079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.580539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.580995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.582253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:26.583856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:26.596730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.597346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.597778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.599151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:26.599876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:26.600312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:26.625661 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:26.649503 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:27.184756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.193677 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37317d0b-30d8-409b-97b8-e6ab12e79875 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.724809 Oct 19 00:46:27.206223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 412/786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:26 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:27.230461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.231373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.238403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.239643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.240371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.241489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.242141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.243242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.288367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.302479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-326841ba-c746-4398-bf92-1bc000f2001e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.726838 Oct 19 00:46:27.317605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 375/787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:26 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:27.352681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.353327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.377016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.377446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.377899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.378637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.379114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.379547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.401903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.416587 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa992b43-d2ae-4a1f-9da3-044803463cf4 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1302 microversion: 2.1 time: 0.197378 Oct 19 00:46:27.418242 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 413/788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:27.463392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.469290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.498568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.499192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.499690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.503512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.504253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.505499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.763621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:27.773663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7e727c7-a738-4e7d-b071-5d448c00282c tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1469 microversion: 2.1 time: 0.436978 Oct 19 00:46:27.774262 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 376/789] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:27.806220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:27.808002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:27.826378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.828238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.830050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:27.831287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:27.832036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:27.832732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.076895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.120504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.131511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.164977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76a22865-7daf-444b-ba32-1cb4635c5cfb tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.382955 Oct 19 00:46:28.176685 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 377/790] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:28.221302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.237149 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8cc5162c-2838-4ce0-b9d9-57bfe6ed62b0 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.783852 Oct 19 00:46:28.238734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 414/791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:27 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:28.243061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.251378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.309148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.311173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.314277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.315135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.319641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.322008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.347728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.348755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.369291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.370134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.370791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.373735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.374446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.377442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.703299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.717641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82ae9d45-a3f5-4d4f-906c-059546036bda tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.486207 Oct 19 00:46:28.723543 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 378/792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:28.730172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.734337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.736398 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:28.751377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.751377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.751377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.751967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.752204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.752316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.752316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.759466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb730cca-fdcb-4904-bdf1-1e73959c9ebf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.416499 Oct 19 00:46:28.765334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 415/793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:28.775460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c83557ff-b5e5-463b-a1da-432368096eb9", "name": "network-vif-deleted", "tag": "78805b5e-ad42-427c-b833-5b36b8323325"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:28.797553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.805443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.806634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.836066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] Creating event network-vif-deleted:78805b5e-ad42-427c-b833-5b36b8323325 for instance c83557ff-b5e5-463b-a1da-432368096eb9 on n-h2-master-1 Oct 19 00:46:28.861919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2a1cdfba-362e-4008-a7ab-1fca828b6b15 req-6ce855b5-1aca-4776-8372-4ded00d02d17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094707 Oct 19 00:46:28.862935 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 416/794] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:28.869282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:28.871289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:28.887983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.888786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.889383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.890277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.890897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.892598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.913157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:28.937050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-923f9e9c-6f4c-4b40-bfe2-272639956885 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1290 microversion: 2.1 time: 0.211519 Oct 19 00:46:28.943421 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 379/795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1290 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:28.991666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:28.992467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:28.993442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:28.994404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lazy-loading 'fault' on Instance uuid c83557ff-b5e5-463b-a1da-432368096eb9 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:29.117057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.127127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf48427c-5b7c-4437-b6e6-786fc7878b17 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1303 microversion: 2.1 time: 0.262766 Oct 19 00:46:29.130603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 417/796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:28 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1303 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:29.204494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:29.205457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:29.221827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.222338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.222792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.223562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.224041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.224476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.271793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:29.272514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:29.281208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.281640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.282079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.282834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.286189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.286682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.330470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.345643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.347264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.354495 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d67b818-e9d8-4910-a148-e475579d406a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.155776 Oct 19 00:46:29.373988 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 380/797] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:29 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:29.629141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:29.638371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c147c047-2c37-44fd-a340-a1cb08fcc501 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.375511 Oct 19 00:46:29.639387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 418/798] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:29 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:29.772524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:29.773224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:29.784655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.785526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.786769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.787571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.788063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.791014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.797612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:29.798509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:29.807053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.807945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.808763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:29.809925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:29.810617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:29.811294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.410053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.421310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.424572 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85d84a7a-9d43-4048-a349-a403b9106539 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.632054 Oct 19 00:46:30.425630 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 419/799] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:29 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.441574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.443074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.447377 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6190fdef-8329-42c8-9157-463a86340bce tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.682459 Oct 19 00:46:30.448306 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 381/800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:29 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.453784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.456574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.457405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.457556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.458915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.459871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.461922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.462616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.470014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.470520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.473043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.475595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.476075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.476537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.524592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.525154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.525614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.526084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lazy-loading 'fault' on Instance uuid c83557ff-b5e5-463b-a1da-432368096eb9 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:30.611924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f268dddf034d43ed9d679dd7396836cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e62838577e3e4c8189e936f3453b2fa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.625439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d24a620-469e-45f8-9e27-58647ae36980 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 200 len: 1303 microversion: 2.1 time: 0.175514 Oct 19 00:46:30.626021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 382/801] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 1303 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.641671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.641671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.649269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.649769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.650212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.650937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.651397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.651828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.660322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.678296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a5ac637-06fe-42fd-8396-76c19cce458b tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1290 microversion: 2.1 time: 0.251322 Oct 19 00:46:30.693685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 420/802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1290 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:30.699289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:30.699929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:30.713731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.714303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.714749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.715481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:30.715940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:30.716421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:30.774126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.787954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.793904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.810993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08c3c2ec-17f7-4794-9495-58c3c6597048 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.179816 Oct 19 00:46:30.817191 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 383/803] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:30.966346 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:30.978820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95e6628a-b1cb-4f5a-b6c5-28478cd354be tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1476 microversion: 2.1 time: 0.283692 Oct 19 00:46:30.980675 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 421/804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:31.118135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8651cc7-62fc-4cbf-88b3-96f95f19d2ab tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.122302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d8651cc7-62fc-4cbf-88b3-96f95f19d2ab tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8651cc7-62fc-4cbf-88b3-96f95f19d2ab tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin] Request method failure captured: Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jmSmkh5QsstcNEZOSVk3NcA8E0KqmctipHRAG12MxZ7qFsg_-gUnPe0AuZlEVWjMtTLG3X6O84pOY9gs7Zlw7BJv5KdsKW9g7pkSyooUaLPFENe427zIG8HAsNOtnzlQdDQELNKgmEZMLTV0Vv0CeGXkIW97xC_NxAGuDGYqys7vs Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 09b3bc0b6f32439892fda7e2a97ac59a Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:46:31.131959 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_09b3bc0b6f32439892fda7e2a97ac59a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09b3bc0b6f32439892fda7e2a97ac59a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/09b3bc0b6f32439892fda7e2a97ac59a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/09b3bc0b6f32439892fda7e2a97ac59a"}]}] Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 09b3bc0b6f32439892fda7e2a97ac59a Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9839aa44186a45858cf1a9be99435cc2 Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:31.133872 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid timestamp for date invalid_time Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'invalid_time'} Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:31.134861 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8651cc7-62fc-4cbf-88b3-96f95f19d2ab tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:31.138716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8651cc7-62fc-4cbf-88b3-96f95f19d2ab tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394 tempest-InstanceUsageAuditLogNegativeTestJSON-1057774394-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.315050 Oct 19 00:46:31.143099 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 384/805] 10.222.0.27 () {58 vars in 1224 bytes} [Wed Oct 19 00:46:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 316 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:46:31.143905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.143905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.146828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.147341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.147877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.148770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.149239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.150182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.193783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:46:31.279551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d11162bf-7267-4df2-8704-b69ccc70fdd7 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.281978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d11162bf-7267-4df2-8704-b69ccc70fdd7 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '366f85a9ef434089a62008580c0b38b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fc999da7a34c55a9dedc87ae05088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d11162bf-7267-4df2-8704-b69ccc70fdd7 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Request method failure captured: Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jlJ41Hf-2XZV0dyWyy0kd3vbCREaLh9ZkcdudWTi-2_qpqjTKEvRNA9mzNhMlrW4dzqIJhYU4TdHN65xhwa9FAR72fyUqcuiAVVQpkTUy9IKBh_0UVkATsmfkcJ00EeRyDPfPdtbOJHdxUcJgkO08e-bugyEvEAA8lWB8UcdtMw6M Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d6fc999da7a34c55a9dedc87ae05088c Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:31.283684 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6fc999da7a34c55a9dedc87ae05088c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6fc999da7a34c55a9dedc87ae05088c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6fc999da7a34c55a9dedc87ae05088c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6fc999da7a34c55a9dedc87ae05088c"}]}] Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d6fc999da7a34c55a9dedc87ae05088c Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 366f85a9ef434089a62008580c0b38b5 Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project Oct 19 00:46:31.285343 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:31.286558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 19 00:46:31.287956 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.289060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d11162bf-7267-4df2-8704-b69ccc70fdd7 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:31.289060 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d11162bf-7267-4df2-8704-b69ccc70fdd7 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.142785 Oct 19 00:46:31.290542 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 385/806] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:31.295661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99e05079-6480-43af-bd5d-f3a9b200596c tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.307150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-99e05079-6480-43af-bd5d-f3a9b200596c tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '366f85a9ef434089a62008580c0b38b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6fc999da7a34c55a9dedc87ae05088c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99e05079-6480-43af-bd5d-f3a9b200596c tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Request method failure captured: Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2000:46:31 HTTP/1.1 Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jlJ41Hf-2XZV0dyWyy0kd3vbCREaLh9ZkcdudWTi-2_qpqjTKEvRNA9mzNhMlrW4dzqIJhYU4TdHN65xhwa9FAR72fyUqcuiAVVQpkTUy9IKBh_0UVkATsmfkcJ00EeRyDPfPdtbOJHdxUcJgkO08e-bugyEvEAA8lWB8UcdtMw6M Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d6fc999da7a34c55a9dedc87ae05088c Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:31.308991 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6fc999da7a34c55a9dedc87ae05088c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6fc999da7a34c55a9dedc87ae05088c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6fc999da7a34c55a9dedc87ae05088c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6fc999da7a34c55a9dedc87ae05088c"}]}] Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d6fc999da7a34c55a9dedc87ae05088c Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 366f85a9ef434089a62008580c0b38b5 Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project Oct 19 00:46:31.310645 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2022-10-19 00:46:31'} Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:31.311390 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 19 00:46:31.312876 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.314128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99e05079-6480-43af-bd5d-f3a9b200596c tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:31.314128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99e05079-6480-43af-bd5d-f3a9b200596c tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424 tempest-InstanceUsageAuditLogNegativeTestJSON-1247046424-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19 00:46:31" status: 403 len: 128 microversion: 2.1 time: 0.019741 Oct 19 00:46:31.315309 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a66d29a-2d96-46ae-abdd-165dd3487889 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 204 len: 0 microversion: 2.1 time: 0.185441 Oct 19 00:46:31.315733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 386/807] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-19%2000%3A46%3A31 => generated 128 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:31.317053 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 422/808] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:31 2022] DELETE /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:46:31.325143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.325744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.332021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.332505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.333023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.333742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.334197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.334621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.460083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.461563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.468766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.469823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.470495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.471414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.472089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.472610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.547835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:31.569249 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d49c3222-3d63-4a95-aacb-dc0d1a438fda tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1714 microversion: 2.1 time: 0.247664 Oct 19 00:46:31.570037 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 387/809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1714 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:31.580673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.581183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.588130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.588978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.589411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.590295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.590928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.591603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.868882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:31.879632 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e2858fc-5e5e-42c8-a03f-c46ab273b327 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.425600 Oct 19 00:46:31.880295 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 423/810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:31.886145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.886778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] [instance: c83557ff-b5e5-463b-a1da-432368096eb9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.893242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.894612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.895957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.896749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.897221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.897659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.913281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] HTTP exception thrown: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Request method failure captured: Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 HTTP/1.1 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jBLx0AM-93XtqHQH0ssnW1wYgJ-NDwB8tpjtgssh3E69Pb3--nTy-ro-H_rzn6eDNDItNnB_toKhZzQft_uyEvT6PTRuIb-_grcGpephZOiRtb0TVOeYhLu0bXbdMTgiXLD4PlCRwRJCXNv9NHPUPwzbVNFiQtd5LDaKxf88puERI Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e62838577e3e4c8189e936f3453b2fa4 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TenantUsagesTestJSON-2108150248 Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:46:31.914998 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e62838577e3e4c8189e936f3453b2fa4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e62838577e3e4c8189e936f3453b2fa4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e62838577e3e4c8189e936f3453b2fa4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e62838577e3e4c8189e936f3453b2fa4"}]}] Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TenantUsagesTestJSON-2108150248 Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e62838577e3e4c8189e936f3453b2fa4 Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2108150248 Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TenantUsagesTestJSON-2108150248-project Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: f268dddf034d43ed9d679dd7396836cc Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TenantUsagesTestJSON-2108150248-project Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. Oct 19 00:46:31.917131 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c83557ff-b5e5-463b-a1da-432368096eb9'} Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:31.918808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. Oct 19 00:46:31.920787 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:31.923622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] Returning 404 to user: Instance c83557ff-b5e5-463b-a1da-432368096eb9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:31.923622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-afba8a2f-79bb-4765-859a-0fd2099ff929 tempest-TenantUsagesTestJSON-2108150248 tempest-TenantUsagesTestJSON-2108150248-project] 10.222.0.27 "GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9" status: 404 len: 111 microversion: 2.1 time: 0.034843 Oct 19 00:46:31.923622 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 424/811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/c83557ff-b5e5-463b-a1da-432368096eb9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:31.923622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:31.923622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:31.930140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.930632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.931082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.931798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:31.932262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:31.932735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:31.986225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.000906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a631dadf-eab5-42b3-8205-11f9a512a043 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1471 microversion: 2.1 time: 0.429516 Oct 19 00:46:32.002517 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 388/812] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1471 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:32.007516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:32.008237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:32.017996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.018590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.019347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.021551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.022478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.023202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.046921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.055245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b3ed9dd-8763-45a6-8cb3-fd2f9b4d005c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1290 microversion: 2.1 time: 0.136281 Oct 19 00:46:32.056548 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 425/813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:31 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1290 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:32.061774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:32.062750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:32.072764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.073924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.074624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.075709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.076345 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.076705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.077378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.174037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.184259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.186430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.192569 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15b01c23-7f5b-4979-8fb6-ad4647eab4f4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.189690 Oct 19 00:46:32.193630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 389/814] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:32 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:32.309748 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:32.450709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:32.464676 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fea38adc-1cfe-4fbc-be2e-aa99744fa315 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1475 microversion: 2.1 time: 0.406686 Oct 19 00:46:32.465848 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 426/815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:32 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:32.599661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:32.600854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:32.611940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.613259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.619714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.621187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.621961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.622818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.910020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:32.913033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:32.923836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.924669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.925340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:32.927000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:32.927674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:32.928408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:33.425726 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:33.547369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:33.568530 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4e7b9d5-bbd1-48ba-b694-6cc6f926b675 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1714 microversion: 2.1 time: 0.975245 Oct 19 00:46:33.570259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 390/816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:32 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1714 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:33.581319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:33.585703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:33.596752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:33.597883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:33.600702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:33.602969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:33.603873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:33.605008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:33.922526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:33.962920 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40ff1e8a-c7e8-4c87-9d5d-505899359178 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 1.061588 Oct 19 00:46:33.968499 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:33.977943 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 427/817] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:32 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:33.992456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:33.993109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:34.010615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.011121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.011770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.012723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.017512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.018204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.074190 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:34.429553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.449744 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b563d3d8-c5c9-47cf-aeb2-8b3c0feb4862 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1489 microversion: 2.1 time: 0.878062 Oct 19 00:46:34.455765 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 391/818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:33 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1489 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:34.467894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:34.470920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:34.485990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.486812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.487443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.488456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.489942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.490567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.780391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.812693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.813937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.819410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:34.822454 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-801cd8a9-4c02-4116-97c4-ac3a97535427 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.843616 Oct 19 00:46:34.827335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 428/819] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:33 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:34.835930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:34.836553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:34.841045 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20f08c81-7f68-4b66-9dba-e8f8637121b2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.382887 Oct 19 00:46:34.855175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.855519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.856979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.858103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.859493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.860295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.869564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 392/820] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:34 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:34.886608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:34.889658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:34.910905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.914084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.917337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:34.918531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:34.923338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:34.923338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:35.999405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:36.017989 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6437fac0-b53a-4af6-a897-818d708d90b6 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1714 microversion: 2.1 time: 1.144523 Oct 19 00:46:36.018599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 393/821] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:34 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1714 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:36.024189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "name": "network-vif-unplugged", "status": "completed", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:36.061390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.062136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.062769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.090617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Creating event network-vif-unplugged:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h1-master-1 Oct 19 00:46:36.093839 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:36.105155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:46:36.126787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:36.129869 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4abfb74a-c659-47cc-9330-e1edaebab964 req-06c9eaeb-6a5d-4b5e-bf2c-510b9ac82ce1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109054 Oct 19 00:46:36.137566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 394/822] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:36.142982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:36.143702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:36.148905 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6779825c-7f77-41ae-9167-02a8b8e71284 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1475 microversion: 2.1 time: 1.315045 Oct 19 00:46:36.149582 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 429/823] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:34 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1475 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:36.166262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.166779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.167235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.167996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.168277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:36.168465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.169122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.169272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:36.199728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.204042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.205578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.206632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:36.208893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:36.210492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:36.989920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.030757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.034153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41541a3e-c89c-452a-98ff-394eba21ade1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1477 microversion: 2.1 time: 0.871830 Oct 19 00:46:37.034862 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 430/824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:36 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1477 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:37.055814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:37.056465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:37.089665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.096679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.099321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.100464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.101064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.105116 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16f7e9a1-a755-4678-bcc6-fde69622bd82 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1503 microversion: 2.1 time: 0.966599 Oct 19 00:46:37.105700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.114817 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 395/825] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:36 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1503 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:37.114817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:37.134168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:37.157082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.157621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.158077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.158820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.159294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.159736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.643346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.662764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.666593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.686004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cdc2ee43-e4ae-4e11-9420-1115a62b2195 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.569325 Oct 19 00:46:37.694672 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 396/826] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:37 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:37.713474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-unplugged", "status": "completed", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:37.750600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.752846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.753656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.792855 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] Creating event network-vif-unplugged:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:46:37.798906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-162635ae-e0a9-4580-a0f9-42bab4741630 req-bc068aeb-23d5-4763-99e2-28287e7b05f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102459 Oct 19 00:46:37.800323 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 397/827] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:37.806638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:37.812197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:37.820288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:37.835405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-678e4106-ef1c-4402-be72-f11c639edd30 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.798775 Oct 19 00:46:37.856245 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 431/828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:37 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:37.859060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.859060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.859060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.859060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.859859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.859859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.864465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:37.867644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:37.901646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.902814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.903749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:37.905828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:37.906825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:37.915185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:38.945534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:38.956144 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-487f8f5b-c950-4785-b334-a52b04c4c095 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1646 microversion: 2.1 time: 1.154034 Oct 19 00:46:38.957186 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 398/829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:37 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1646 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:38.963420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:38.964299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:38.972182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:38.973355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:38.974017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:38.974931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:38.975752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:38.976359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.527343 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.536567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f48de58a-1629-4474-a871-f95820b659a2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1477 microversion: 2.1 time: 0.577572 Oct 19 00:46:39.545336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 399/830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:38 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:39.556825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.565153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f87e840-ccd9-4e96-a953-0ba84956d332 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1475 microversion: 2.1 time: 1.714977 Oct 19 00:46:39.565153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 432/831] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:37 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1475 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:39.567559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:39.569022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:39.571343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:39.579849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.580715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.581336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.582426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.583082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.583690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.593107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.593749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.594194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.638805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Creating event network-changed:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h1-master-1 Oct 19 00:46:39.652303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:46:39.685154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d5d75076-0d05-459e-a654-a20d4dab5b7d req-cf22bd73-a46f-4804-b02e-b4b713162089 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118201 Oct 19 00:46:39.686132 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 433/832] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:39.692389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:39.693129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:39.700070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.700741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.701189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.701904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.702362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.703046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.884711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.896872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.901814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.927534 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5f4608b-0989-4e43-aba1-cfeb81cd1df7 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1533 microversion: 2.91 time: 0.237565 Oct 19 00:46:39.928505 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 434/833] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:39 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1533 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:39.937375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:39.942900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:39.968133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.971888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.972331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.977459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:39.978132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:39.979254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:39.979501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:39.999447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa2557c7-2fff-44eb-8879-e5f30a9c2f21 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1478 microversion: 2.1 time: 0.440824 Oct 19 00:46:40.000038 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 400/834] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:39 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1478 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:40.006457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f8e65c-8f36-4120-a7f6-543d95099881", "tag": "e44eccba-5e0c-435b-9854-374820b759d9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:40.030856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.031674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.032233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.065102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] Creating event network-changed:e44eccba-5e0c-435b-9854-374820b759d9 for instance 15f8e65c-8f36-4120-a7f6-543d95099881 on n-h1-master-1 Oct 19 00:46:40.073717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7640cd11-2077-439a-98ca-a69720159f8b req-1c2ad167-bcaf-44ff-adaa-64852f2fd356 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071569 Oct 19 00:46:40.074851 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 401/835] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:40.088428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:40.089662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:40.105566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.106096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.107010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.107820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.108306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.108791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.272610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lazy-loading 'services' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:40.313734 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3162cac4-3de8-4ecc-8d1f-5a0333fb0c0f tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1938 microversion: 2.91 time: 0.237361 Oct 19 00:46:40.322204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 402/836] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:40 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1938 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:40.337519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:40.342412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:40.353015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.354494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.355536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.358466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.359030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.359562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.401205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.401820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.402345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.402885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lazy-loading 'fault' on Instance uuid db52e5e4-aff1-41b6-aadd-134edc28172a {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:40.556487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '729379ca02904136b0d5c96d6b28c490', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6be4ac47d8094dd2854afeadbfae9c96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:40.570148 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d739f20-8e08-401a-9af0-a8b660b3bb01 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 200 len: 1353 microversion: 2.1 time: 0.244125 Oct 19 00:46:40.571901 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 403/837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:40 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 1353 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:40.576489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51cf1765-3b4d-4cfd-9dc5-2e3fa25df342 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '.version_select at 0x7f2af57821f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:40.580342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51cf1765-3b4d-4cfd-9dc5-2e3fa25df342 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.591429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51cf1765-3b4d-4cfd-9dc5-2e3fa25df342 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.591936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51cf1765-3b4d-4cfd-9dc5-2e3fa25df342 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.634645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51cf1765-3b4d-4cfd-9dc5-2e3fa25df342 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1573 microversion: 2.1 time: 0.055812 Oct 19 00:46:40.635477 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 404/838] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:46:40 2022] GET /compute/v2.1/os-migrations => generated 1573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:40.643795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:40.644408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:40.658818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:40.668430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.670759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.672885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.674639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:40.678785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:40.680100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:40.728980 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9c1cdb4-1fe0-4b42-b53d-38c6f4ed71ae tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.792401 Oct 19 00:46:40.733864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 435/839] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:39 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:40.869767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lazy-loading 'flavor' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:46:41.033735 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-88b055c5-4a8b-4084-a1e9-f163bb350334 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T00%3A46%3A40.359791&end=2022-10-20T00%3A46%3A40.359791" status: 404 len: 112 microversion: - time: 0.297554 Oct 19 00:46:41.035034 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 436/840] 10.222.0.27 () {58 vars in 1316 bytes} [Wed Oct 19 00:46:40 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-18T00%3A46%3A40.359791&end=2022-10-20T00%3A46%3A40.359791 => generated 112 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 00:46:41.043405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:41.065462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:41.090210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.092698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.093501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.097273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.099730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.100479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.344231 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5717024-bfb9-449c-830e-54d890f9c862 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action" status: 202 len: 0 microversion: 2.91 time: 0.707385 Oct 19 00:46:41.351592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 405/841] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:46:40 2022] POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:41.374754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:41.377715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:41.392229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.396467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.398477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.400408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.406274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.409408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.736198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:41.761566 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbc8e4b0-be33-47f1-a66e-e9efe4ca3000 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1477 microversion: 2.1 time: 0.722337 Oct 19 00:46:41.764230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 437/842] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:41 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1477 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:41.773637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:41.775860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:41.783083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:41.792733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.794129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.795191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.796858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.798432 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70b34c1f-85bc-4317-a559-a1882237fbf9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1473 microversion: 2.1 time: 0.444059 Oct 19 00:46:41.799031 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 406/843] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:41 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1473 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:41.799765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.801731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.804361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0602c63-5f03-4fef-adfd-7a5e86dff880 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] Calling method '.version_select at 0x7f2af59f4280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:41.822405 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c0602c63-5f03-4fef-adfd-7a5e86dff880 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0602c63-5f03-4fef-adfd-7a5e86dff880 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] Request method failure captured: Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-simple-tenant-usage/d419271a0cd74caf8d4b073f35fa860e?start=2022-10-20T00%3A46%3A40.359791&end=2022-10-18T00%3A46%3A40.359791 HTTP/1.1 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jww63LOHmZ41my0Zab9dTivTsgDEMvGq_YvgVP7KmuWQUjp7M-9WJ31G0N6BVg75V9jUiSpN2AFI806X1QND6hBcDrJo4lXvx8ZVT6abI7wc8vVC24J7bTcdMpu1jHyrRpTQMQXcMd4_U0fZ8aGgZmdz19hcY26hN2I5NmEMdphE8 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f1c3fe0ddce24ae0a6b8257dd5a02d66 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-856825249 Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:46:41.824215 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1c3fe0ddce24ae0a6b8257dd5a02d66", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3fe0ddce24ae0a6b8257dd5a02d66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1c3fe0ddce24ae0a6b8257dd5a02d66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3fe0ddce24ae0a6b8257dd5a02d66"}]}] Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-856825249 Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f1c3fe0ddce24ae0a6b8257dd5a02d66 Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-856825249 Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TenantUsagesNegativeTestJSON-856825249-project-admin Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5ce3031d22044e17969f1230296b0e15 Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-856825249-project-admin Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid start time. The start time cannot occur after the end time. Oct 19 00:46:41.826076 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'd419271a0cd74caf8d4b073f35fa860e'} Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 00:46:41.826937 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0602c63-5f03-4fef-adfd-7a5e86dff880 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:41.828444 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0602c63-5f03-4fef-adfd-7a5e86dff880 tempest-TenantUsagesNegativeTestJSON-856825249 tempest-TenantUsagesNegativeTestJSON-856825249-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/d419271a0cd74caf8d4b073f35fa860e?start=2022-10-20T00%3A46%3A40.359791&end=2022-10-18T00%3A46%3A40.359791" status: 400 len: 111 microversion: 2.1 time: 0.025762 Oct 19 00:46:41.832896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 407/844] 10.222.0.27 () {58 vars in 1412 bytes} [Wed Oct 19 00:46:41 2022] GET /compute/v2.1/os-simple-tenant-usage/d419271a0cd74caf8d4b073f35fa860e?start=2022-10-20T00%3A46%3A40.359791&end=2022-10-18T00%3A46%3A40.359791 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:46:41.843498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:41.864885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.866557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.867677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.885678 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] Creating event network-vif-plugged:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:46:41.894534 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e0928140-4d4f-47bf-821c-5db7018248be req-c1346da6-af38-4155-acb1-bd67ac1ac7f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055210 Oct 19 00:46:41.897437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 408/845] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:41.905659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:41.907401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:41.918110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.919419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.920145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:41.921272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:41.922734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:41.923472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.056862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:42.071817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:42.074625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:42.082236 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8f192dd-7ec9-41fa-acb4-007e3c56962c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.182839 Oct 19 00:46:42.096973 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 409/846] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:41 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:42.112033 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ab27208-58d4-425f-9f93-a119793f29fc tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1629 microversion: 2.1 time: 0.344976 Oct 19 00:46:42.115658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 438/847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:41 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1629 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:42.116560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.118815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.133258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.134878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.136955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.153664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.155485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.158639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.159904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.160391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.161624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.162198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.163029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.164257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.164770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.165382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.201554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a HTTP/1.1 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:42.204884 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: exception: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:42.206549 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'db52e5e4-aff1-41b6-aadd-134edc28172a'} Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:42.208163 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:42.210470 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.214640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:42.217067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e857af40-9faf-4430-8518-ad1a2b8ac274 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 404 len: 111 microversion: 2.1 time: 0.120693 Oct 19 00:46:42.218506 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 410/848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:42.464366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:42.480485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396a8cd1-64bf-4249-9c2d-114dd32eee5a tempest-TenantUsagesNegativeTestJSON-1287410873 tempest-TenantUsagesNegativeTestJSON-1287410873-project] Calling method '.version_select at 0x7f2af5639670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.482508 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f79fdd62-551b-4aa6-9da9-118d38599375 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.361182 Oct 19 00:46:42.485711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-396a8cd1-64bf-4249-9c2d-114dd32eee5a tempest-TenantUsagesNegativeTestJSON-1287410873 tempest-TenantUsagesNegativeTestJSON-1287410873-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7722e1af42d345a6b3c7d09fb77af0bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd419271a0cd74caf8d4b073f35fa860e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396a8cd1-64bf-4249-9c2d-114dd32eee5a tempest-TenantUsagesNegativeTestJSON-1287410873 tempest-TenantUsagesNegativeTestJSON-1287410873-project] Request method failure captured: Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T00%3A46%3A40.359791&end=2022-10-20T00%3A46%3A40.359791&detailed=1 HTTP/1.1 Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0juwszZsCVxYZTKt4TxkeXFQGJJDGEfb87xtpNF41dznubfzMMEmW8fLjvCmm2i_LxhEKq3wOSEt7OGRhUdGBmYB4WJNEvY0d3fyYDXxSDj81dkWvr2W2LkwKO7rQvG63Be_OS-dFgzVgt49moVZsziH4eKgeR-lgxs1tr07jkK19U Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d419271a0cd74caf8d4b073f35fa860e Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1287410873 Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:42.493170 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d419271a0cd74caf8d4b073f35fa860e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d419271a0cd74caf8d4b073f35fa860e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d419271a0cd74caf8d4b073f35fa860e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d419271a0cd74caf8d4b073f35fa860e"}]}] Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1287410873 Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d419271a0cd74caf8d4b073f35fa860e Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1287410873 Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TenantUsagesNegativeTestJSON-1287410873-project Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 7722e1af42d345a6b3c7d09fb77af0bf Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1287410873-project Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:46:42.494649 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:46:42.495617 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:46:42.496817 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:46:42.499795 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 19 00:46:42.499795 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.500104 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 439/849] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:42.508017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396a8cd1-64bf-4249-9c2d-114dd32eee5a tempest-TenantUsagesNegativeTestJSON-1287410873 tempest-TenantUsagesNegativeTestJSON-1287410873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:42.508271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db52e5e4-aff1-41b6-aadd-134edc28172a", "name": "network-vif-deleted", "tag": "dd28523d-1e9b-43d8-a9f1-2857f4550de0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:42.512148 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-396a8cd1-64bf-4249-9c2d-114dd32eee5a tempest-TenantUsagesNegativeTestJSON-1287410873 tempest-TenantUsagesNegativeTestJSON-1287410873-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T00%3A46%3A40.359791&end=2022-10-20T00%3A46%3A40.359791&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.291494 Oct 19 00:46:42.528600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 411/850] 10.222.0.27 () {58 vars in 1335 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-18T00%3A46%3A40.359791&end=2022-10-20T00%3A46%3A40.359791&detailed=1 => generated 123 bytes in 309 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:42.552516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.553405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.554170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.567772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b0bea3e0-ff53-416d-86dc-c741ec873165 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: .version_select at 0x7f2af572af70>, body: {"keypair": {"name": "tempest-keypair-1232955563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMoRlCU/PWIqqyUR0xKTQconnloVjQWAY/LoTUvOzkW6r6tmk3BitdqdTcaMqrtk+svhaki5IARkb74btjFQr7rkBjNU25FNezzKJjy418YeBP5ZgNtYqKZFmAwYEfG8Q=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:42.600037 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] Creating event network-vif-deleted:dd28523d-1e9b-43d8-a9f1-2857f4550de0 for instance db52e5e4-aff1-41b6-aadd-134edc28172a on n-h2-master-1 Oct 19 00:46:42.626125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b0bea3e0-ff53-416d-86dc-c741ec873165 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for project a0676f376817483389300f03ed99cced. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:42.627834 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d8d3036d-e57d-472e-8aaf-b7e787fc9239 req-db0a5cd1-d26e-44bb-8f51-e2439f0c145f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128983 Oct 19 00:46:42.629303 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 440/851] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:42.639062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.641957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b0bea3e0-ff53-416d-86dc-c741ec873165 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for user a24b98f6af634c61af828bb20ce1e945 and project a0676f376817483389300f03ed99cced. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:42.658045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.677324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.685717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.686524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.687835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.688687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.689727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.715030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b0bea3e0-ff53-416d-86dc-c741ec873165 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184796 Oct 19 00:46:42.715953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 412/852] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:46:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:42.747060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 HTTP/1.1 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:46:42.759946 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.762555 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3a124b96-1795-4584-92f9-201cb18838d9'} Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:42.764105 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.766579 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.772951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:42.777381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-749a6a52-5a28-4334-9ef9-114e8397a03a tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 404 len: 111 microversion: 2.1 time: 0.143102 Oct 19 00:46:42.783184 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 441/853] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:42 2022] DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:42.790930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.791572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.793369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.794504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.801956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.806795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.807335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.811712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.812251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.814568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.815252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.816102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.822418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.823771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.824610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.829554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.854084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 HTTP/1.1 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:42.855686 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.858757 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3a124b96-1795-4584-92f9-201cb18838d9'} Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:42.860385 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:42.863071 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:42.868276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:42.868276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-850fc9e4-f298-454f-a26b-3bebeb51010f tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 404 len: 111 microversion: 2.1 time: 0.075263 Oct 19 00:46:42.868276 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 413/854] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:42.875400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:42.878846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:42.894115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.895792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.896269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:42.897065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:42.897542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:42.898317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.319050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:43.332858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98a3cfdc-916d-4209-b0d5-5c242283f411 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1470 microversion: 2.1 time: 0.466401 Oct 19 00:46:43.337949 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 414/855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1470 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:43.344858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97f64d88-4e36-48b0-8b13-9942931e9024 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '.version_select at 0x7f2af5639d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:43.353590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:43.365409 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b53cfc6-e942-48ca-9c69-ed949edaae03 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1477 microversion: 2.1 time: 0.579322 Oct 19 00:46:43.366727 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 442/856] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:42 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:43.391211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:43.392149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:43.406594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.408001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.409582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.419298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.421501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.422744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.437969 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97f64d88-4e36-48b0-8b13-9942931e9024 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596044564" status: 202 len: 0 microversion: 2.1 time: 0.098118 Oct 19 00:46:43.439882 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 415/857] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:46:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596044564 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:43.469938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:43.470715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:43.482229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.483761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.484474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.485835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.486578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.487343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.584294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:43.603702 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:43.608150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:43.612500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:43.625546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3e5ae05-a226-46e8-b18d-84d7d5b722b3 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.257248 Oct 19 00:46:43.633998 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 443/858] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:43 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:43.649362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:43.657322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:43.667202 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1ba98f2-4dae-4641-bf8a-6a47d88f5972 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8/action" status: 204 len: 0 microversion: 2.1 time: 0.220592 Oct 19 00:46:43.673858 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 416/859] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:43 2022] POST /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8/action => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:46:43.676046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.678609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.680676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.684717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.685920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.687127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.696670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:43.698200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:43.708043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.709186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.709838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:43.711323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:43.712011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:43.713008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:44.607712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:44.618742 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3bc75537-f923-408e-81fc-d94ddd57c918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1470 microversion: 2.1 time: 0.940789 Oct 19 00:46:44.619335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 417/860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:43 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1470 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:44.624676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:44.641548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:44.657734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:44.661562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:44.664885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:44.665871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:44.668989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:44.669934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:44.670756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:44.681676 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c251786-6784-45a2-8b52-4ab5bd3fceaa tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 1.044871 Oct 19 00:46:44.698037 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 444/861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:43 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:44.704547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:44.705213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:44.714515 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:44.732389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:44.733153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:44.733756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:44.734678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:44.735305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:44.735925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:45.073348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:45.084743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:45.086360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:45.107071 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d7f14977-4c8c-48c0-8c86-3cbcf1e763dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.405468 Oct 19 00:46:45.107933 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 445/862] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:44 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:45.130567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "name": "network-vif-plugged", "status": "completed", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:45.141800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:45.142617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:45.143535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:45.161997 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Creating event network-vif-plugged:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h1-master-1 Oct 19 00:46:45.187309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:46:45.208111 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ed4993f2-0d4d-4cb1-80eb-ac0c0fb0e55a req-ebc708b8-00c6-4c82-a212-8e9cd3fcce13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081053 Oct 19 00:46:45.210588 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 446/863] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:46:45.646296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:45.656696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:45.681840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:45.682920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:45.694339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:45.700797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:45.710531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:45.712748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:45.715423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:45.730695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65ce9594-2d17-4442-aebf-851d56029a75 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1477 microversion: 2.1 time: 1.104147 Oct 19 00:46:45.731412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 418/864] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:44 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1477 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:45.758180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:45.762866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:45.798325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:45.798841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:45.799291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:45.800043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:45.800464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:45.801589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:46.683044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:46.691934 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9f4f3bb-4905-46af-927c-7908b8e45900 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.959150 Oct 19 00:46:46.696955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 419/865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:45 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:46.704541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4a42dcf3-4a2a-49a5-97ef-098e3c497039 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:46.719201 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:46.753193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:46.773155 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c173cec-b3eb-479c-9c6b-364307f509b9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1470 microversion: 2.1 time: 1.132669 Oct 19 00:46:46.775254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4a42dcf3-4a2a-49a5-97ef-098e3c497039 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/415488716" status: 202 len: 0 microversion: 2.1 time: 0.074710 Oct 19 00:46:46.776119 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 420/866] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:46:46 2022] DELETE /compute/v2.1/flavors/415488716 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:46.776746 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 447/867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:45 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1470 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:46.786122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:46.787020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:46.796581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:46.797260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:46.801280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:46.802579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:46.805363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:46.806361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:46.806990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:46.808906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:46.812075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:46.815877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:46.816489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:46.817337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:46.817929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:46.818454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:46.840828 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:47.014818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:47.029637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:47.031566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:47.045602 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4dcde519-8302-43c3-880f-1639c7403224 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.267861 Oct 19 00:46:47.071922 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 421/868] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:46 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:47.077085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-131c2bcf-3c5e-4e2b-a311-9ecd678e82b3 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.140273 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-131c2bcf-3c5e-4e2b-a311-9ecd678e82b3 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.066615 Oct 19 00:46:47.142171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 422/869] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:47.163559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73c35841-3357-491c-8249-1a53619a7e8c tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.195724 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73c35841-3357-491c-8249-1a53619a7e8c tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/205429470" status: 202 len: 0 microversion: 2.1 time: 0.036939 Oct 19 00:46:47.199372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 423/870] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:46:47 2022] DELETE /compute/v2.1/flavors/205429470 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:46:47.206997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1a9f751-b1f4-475d-a599-4e08b0d700a1 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.255361 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1a9f751-b1f4-475d-a599-4e08b0d700a1 tempest-ServersWithSpecificFlavorTestJSON-1539145495 tempest-ServersWithSpecificFlavorTestJSON-1539145495-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050764 Oct 19 00:46:47.256408 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 424/871] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:47.284824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.286722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.297406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.298997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.299745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.305041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.305626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.306156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.335764 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a HTTP/1.1 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:47.338969 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: exception: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.340347 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'db52e5e4-aff1-41b6-aadd-134edc28172a'} Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:47.341121 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.342317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.346124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:47.346124 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e57414bb-ae8d-4e17-a698-db072606f4e0 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 404 len: 111 microversion: 2.1 time: 0.061275 Oct 19 00:46:47.346124 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 425/872] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:47 2022] DELETE /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:47.357832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.358466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: db52e5e4-aff1-41b6-aadd-134edc28172a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.376415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.376953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.377400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.378143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.378609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.379266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.406854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a HTTP/1.1 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:47.408434 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: exception: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.409795 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'db52e5e4-aff1-41b6-aadd-134edc28172a'} Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:47.412540 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. Oct 19 00:46:47.413775 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.415728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance db52e5e4-aff1-41b6-aadd-134edc28172a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:47.415728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e1f4359-ecee-48b2-9bb0-8bae336d8e46 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a" status: 404 len: 111 microversion: 2.1 time: 0.056081 Oct 19 00:46:47.415728 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 426/873] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/servers/db52e5e4-aff1-41b6-aadd-134edc28172a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:47.424168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f8e65c-8f36-4120-a7f6-543d95099881", "name": "network-vif-plugged", "status": "completed", "tag": "e44eccba-5e0c-435b-9854-374820b759d9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:47.455051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.455445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.455881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.481723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] Creating event network-vif-plugged:e44eccba-5e0c-435b-9854-374820b759d9 for instance 15f8e65c-8f36-4120-a7f6-543d95099881 on n-h1-master-1 Oct 19 00:46:47.486761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:47.488447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9e161eee-839d-4e7b-9e6f-c08322c68246 req-a05811e3-11aa-4aff-b999-dbfe4c1a5bba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075995 Oct 19 00:46:47.490114 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 427/874] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:47.497564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.498514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.501871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1f86ce0-f8d9-4788-9412-44a36f93d458 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1463 microversion: 2.1 time: 0.723985 Oct 19 00:46:47.502620 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 448/875] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:46 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1463 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:47.509359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.510908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.512161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.513573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.514783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.515508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.532504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.533549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.545673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.561241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.562147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.563631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.564961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.565647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.588728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 HTTP/1.1 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:47.604210 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.605709 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3a124b96-1795-4584-92f9-201cb18838d9'} Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:47.606448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.607616 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.610664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:47.612002 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53c4cebb-e558-436b-91b8-b70838e34ec5 tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 404 len: 111 microversion: 2.1 time: 0.120373 Oct 19 00:46:47.612829 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 428/876] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:46:47 2022] DELETE /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:46:47.621714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.622546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] [instance: 3a124b96-1795-4584-92f9-201cb18838d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.645238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.645755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.646291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.647190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.647694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.648233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.664829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] HTTP exception thrown: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Request method failure captured: Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 HTTP/1.1 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hIFpQKsnGYw44ag0fg67vtE3erxaduYXfTdC4v27oklZLqdPFr_MQd9_zJL6-AX3Z0xeRDS6TwYtw2BVAk5b7lBxqjtIz2SSA5RyW5ePFnxzpab3QlUFWoE2KdT7EYGoxRWbcQagb-yOl0hpwmRkrFyA6XTlu9ixuxoQyZZ5OHVpg Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:46:47.666531 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6be4ac47d8094dd2854afeadbfae9c96", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6be4ac47d8094dd2854afeadbfae9c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6be4ac47d8094dd2854afeadbfae9c96"}]}] Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6be4ac47d8094dd2854afeadbfae9c96 Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612 Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 729379ca02904136b0d5c96d6b28c490 Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2099605612-project Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.668138 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3a124b96-1795-4584-92f9-201cb18838d9'} Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:46:47.669159 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. Oct 19 00:46:47.670615 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:46:47.671887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] Returning 404 to user: Instance 3a124b96-1795-4584-92f9-201cb18838d9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:46:47.672861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-664bc9a9-9084-4fea-a361-6f2f2bb8f70e tempest-ServersWithSpecificFlavorTestJSON-2099605612 tempest-ServersWithSpecificFlavorTestJSON-2099605612-project] 10.222.0.27 "GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9" status: 404 len: 111 microversion: 2.1 time: 0.055742 Oct 19 00:46:47.674095 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 429/877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/servers/3a124b96-1795-4584-92f9-201cb18838d9 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:46:47.731418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:47.732077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:47.739290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.739828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.740524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:47.741485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:47.742105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:47.742707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.169187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.188029 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74435fd8-abdc-4fc2-bf3b-00c9ec200b71 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1463 microversion: 2.1 time: 0.659593 Oct 19 00:46:48.188848 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 449/878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1463 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:48.211723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:48.221646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:48.238889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.239649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.242984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.244231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.244894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.246551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.282046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.291848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28ec88c5-087e-48db-8c7d-9209b891281d tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1332 microversion: 2.1 time: 0.564242 Oct 19 00:46:48.297436 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 430/879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:47 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1332 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:48.312538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:48.313646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:48.321520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.329418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.329889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.330654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.331138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.331567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.516807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.539955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.541854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.558847 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c2bb9350-e503-47b4-8b62-094be98f4525 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.259982 Oct 19 00:46:48.563558 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 431/880] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:48 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:48.593403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:48.598280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:48.619602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.620189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.623321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.625904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:48.627487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:48.631204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:48.791386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:48.800428 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4f36365-a762-427c-af85-0ce092f4fc1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1470 microversion: 2.1 time: 0.593097 Oct 19 00:46:48.810900 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 450/881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:48 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1470 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:48.892973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:48.893557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:48.897264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:48.899681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:48.900473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:49.054036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:49.064571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.071966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.072542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.073418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.073805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.074233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.139537 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-641a8ecc-67bf-4a50-952c-ad4c2ea23585 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 1067 microversion: 2.1 time: 0.574568 Oct 19 00:46:49.161299 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 432/882] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:48 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 1067 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 00:46:49.165339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:49.165993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:49.174775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.179563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.181333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.184301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.193643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.197150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.331232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:49.332394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:49.354688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.360232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.361023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.363816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:49.368161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:49.369310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:49.992911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.010457 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-540b2162-b95c-4a1f-981c-6a5679a3330a tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1537 microversion: 2.1 time: 0.689933 Oct 19 00:46:50.011419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.025041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 433/883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:49 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1537 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:46:50.026397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a99d287c-75d2-4b9f-9b03-7ac8ec6e077a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.864237 Oct 19 00:46:50.030678 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 451/884] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:49 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:50.044764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:50.047039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:50.061024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:50.062187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:50.069761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:50.070385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:50.071394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:50.075488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:50.075885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:50.076348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:50.076594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:50.077542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:50.078152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:50.078798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:50.079496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:50.080442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:50.258129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.269120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.272094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.283641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28e0cd82-2f1c-4bdd-abec-f31c10cb0609 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.256956 Oct 19 00:46:50.298226 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 434/885] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:50 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:50.321807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-156260036", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "696b9f21-afb6-4919-9bae-ea78136fef02"}], "security_groups": [{"name": "tempest-securitygroup--193244675"}], "key_name": "tempest-keypair-1232955563", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:50.373630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:50.381662 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df71a4c3-9095-4cd1-b34d-ba0613f53fab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1462 microversion: 2.1 time: 0.349537 Oct 19 00:46:50.384948 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 452/886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:50 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1462 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:50.397745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2b67d3f-7c23-46c2-b512-2355200e69ff tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'create', calling method: .version_select at 0x7f2af50c3a60>, body: {"pool": "79a68d6c-c3c7-4c1d-b90f-315d553731ee"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:50.654930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] validate_networks() for [('696b9f21-afb6-4919-9bae-ea78136fef02', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:46:52.233044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:46:52.234347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:46:52.235102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:46:52.235750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:46:52.236412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:46:52.259392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.259970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.260491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.261370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.261918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.262403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.303818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:52.320562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for user a24b98f6af634c61af828bb20ce1e945 and project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:52.349016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:46:52.352009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:46:52.445850 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58818c7b-9356-42e5-bb3f-8b12cee55b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.146555 Oct 19 00:46:52.461885 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 435/887] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:46:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 2163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:46:52.467111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:52.467972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:52.485965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.486874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.487510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.489111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:52.489828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:52.490446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:52.961227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:52.970696 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b08f192-fd46-43bd-a063-26695711d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1462 microversion: 2.1 time: 0.507412 Oct 19 00:46:52.976709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 436/888] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:52 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1462 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:52.990406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:52.991354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:53.007552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.008325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.009293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.010354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.011004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.011550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.641900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:53.669653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7916da2e-fd9d-4f2e-9995-37311b655b4f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.681326 Oct 19 00:46:53.675979 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 437/889] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:52 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:53.688074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:53.689061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:53.718677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.719367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.719885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.721784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:53.725233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:53.725800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:53.771986 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:46:53.982236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:53.995965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:53.998356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:54.008163 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b664a84-b27e-4ab8-8ab0-1c756f196c09 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.328819 Oct 19 00:46:54.009718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 438/890] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:53 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:54.016728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:54.018106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:54.029278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.031205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.031678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.032543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.033058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.034031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.263586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:54.288374 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e063c00-19ca-4fb5-82f9-2d718cf3364e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1286 microversion: 2.1 time: 0.274913 Oct 19 00:46:54.289066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 439/891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:54 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1286 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:54.303579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77864a28-3be9-47a0-ab85-3cd8370c95a1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'create', calling method: .version_select at 0x7f2af57821f0>, body: {"keypair": {"name": "tempest-keypair-564590760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8siCavVX0ndYK6VCJcS/dVawfS44qweGKkjgvPwaEZ341HzwGjfBaK7i1uC9p5mfFHK/YCncLp5j6mFDZMNNCZ2dvsUf5K7m5yAbSPJ5u2WhQtNV18xvfDRki2Uf3pWQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:54.325746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-77864a28-3be9-47a0-ab85-3cd8370c95a1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:46:54.336580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-77864a28-3be9-47a0-ab85-3cd8370c95a1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:46:54.411954 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77864a28-3be9-47a0-ab85-3cd8370c95a1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121461 Oct 19 00:46:54.424269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 440/892] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:46:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:54.604770 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2b67d3f-7c23-46c2-b512-2355200e69ff tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.218602 Oct 19 00:46:54.605512 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 453/893] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:46:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:46:54.620125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: .version_select at 0x7f2af6ddc160>, body: {"addFloatingIp": {"address": "172.35.1.188"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:46:54.623341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:54.643012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.644656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.644656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.646110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.649412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.649999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.701883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:54.703312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:54.744729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.745681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.746312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.751932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:54.752441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:54.752996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:54.761050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:46:54.761868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquired lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:46:56.185780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.196712 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-341f7395-487a-40c8-bbce-4f125f85c8e6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 1.500977 Oct 19 00:46:56.198252 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 454/894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:54 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:56.205049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:56.206004 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:56.223424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.224393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.225145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.226197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.226920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.227651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.559429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.576458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.578314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.591036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2aa7825-9471-4806-90b4-59bd4d20e763 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.391081 Oct 19 00:46:56.607905 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 455/895] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:56 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:56.613933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:56.621726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:56.639016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.639768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.640416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.642694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:56.643400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:56.646027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:56.860189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:56.911661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-514df111-fd07-4c72-b066-fb48b4f41019 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1292 microversion: 2.1 time: 0.298200 Oct 19 00:46:56.924989 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 456/896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:56 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1292 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:57.224021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:57.225382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:57.237701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.238649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.239256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:57.240829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:57.243097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:57.243729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:58.651984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:58.665753 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83aa395c-6684-4b5f-b8c4-fab8b9854b0f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 1.445843 Oct 19 00:46:58.683440 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 457/897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:57 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:58.691529 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:58.693926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:58.706825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:58.708970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:58.709928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:58.711499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:58.712329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:58.713085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:58.945464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:58.957174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:58.960488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:58.971264 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-edec8277-b417-4c3c-ba0e-1c312c492371 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.283590 Oct 19 00:46:58.973088 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 458/898] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:46:58 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:46:58.995465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:58.996313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:59.022600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:59.025025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:59.026760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:59.028229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:59.029445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:59.030423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:59.548779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:46:59.562174 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee7712c6-a511-4c09-a9fb-53e20e2f5aca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1292 microversion: 2.1 time: 0.587681 Oct 19 00:46:59.563103 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 459/899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:58 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1292 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:46:59.693248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:46:59.693890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:46:59.713105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:59.713621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:59.714070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:46:59.714811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:46:59.715311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:46:59.715703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:00.259070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:00.273761 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e25cf069-f47a-4943-92df-90ebf36048b6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.585635 Oct 19 00:47:00.274698 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 460/900] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:46:59 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:00.287517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:00.288306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:00.309620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:00.311124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:00.312300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:00.317047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:00.318476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:00.319615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:00.933851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:00.950293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:00.952665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:00.960881 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20768034-9096-4509-9eea-1c56563a621d tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.684566 Oct 19 00:47:00.985092 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 461/901] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:00 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:00.994711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:00.996125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:01.003506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:01.004649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:01.005539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:01.006481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:01.007180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:01.007833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:01.613582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:47:01.930158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:01.939351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15e5fe4c-66ad-459c-b119-4f8359a8578f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 0.949612 Oct 19 00:47:01.947179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 462/902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:00 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:01.969251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e08be97-2cd5-4fca-a445-ca42a83e1cb9 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '.version_select at 0x7f2af5c0f670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:01.983261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e08be97-2cd5-4fca-a445-ca42a83e1cb9 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:01.984093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e08be97-2cd5-4fca-a445-ca42a83e1cb9 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:01.984734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e08be97-2cd5-4fca-a445-ca42a83e1cb9 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.010165 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e08be97-2cd5-4fca-a445-ca42a83e1cb9 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.046694 Oct 19 00:47:02.011117 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 463/903] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:47:01 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:02.029880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:02.036071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:02.051316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.055170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.056929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.057885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.062227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.062958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.286470 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:02.840160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:02.866188 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-557898da-a7f4-481e-98db-db2cbbed9ede tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.852716 Oct 19 00:47:02.889313 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 464/904] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:02 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:02.896761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f8e65c-8f36-4120-a7f6-543d95099881", "tag": "e44eccba-5e0c-435b-9854-374820b759d9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:02.907572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.908312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.908942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.929746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] Creating event network-changed:e44eccba-5e0c-435b-9854-374820b759d9 for instance 15f8e65c-8f36-4120-a7f6-543d95099881 on n-h1-master-1 Oct 19 00:47:02.940184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3dc189d8-191c-4141-ae12-871b4a79557a req-9ca2249e-331e-4675-96a6-f0b21872bb99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049067 Oct 19 00:47:02.942525 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 465/905] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:02.951522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:02.953140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:02.969823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.970772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.971344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:02.972362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:02.973446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:02.973994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:03.421096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:03.431042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:03.432519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:03.447865 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a1b7d16-d1f7-47af-b371-e8828a66d9de tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.503843 Oct 19 00:47:03.453455 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 466/906] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:02 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:03.458186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a18d4364-a6bc-4712-9c08-48bd858b5f6d tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:03.471176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a18d4364-a6bc-4712-9c08-48bd858b5f6d tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016546 Oct 19 00:47:03.479901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 467/907] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:47:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:03.485351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:03.489428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:03.506158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:03.506665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:03.507104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:03.507855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:03.508359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:03.508849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:03.512058 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:04.122446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.133528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3fa2bc6-6ebf-4a1e-b14d-d94f9ae56ab4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 0.652122 Oct 19 00:47:04.144977 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 468/908] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:03 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:04.144977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d536d52a-224d-4b4f-b075-716a02904d54 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1930696987", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:04.178295 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d536d52a-224d-4b4f-b075-716a02904d54 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.042668 Oct 19 00:47:04.178908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 469/909] 10.222.0.27 () {60 vars in 1146 bytes} [Wed Oct 19 00:47:04 2022] POST /compute/v2.1/flavors => generated 499 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:04.189771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:04.201567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:04.209780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:04.210472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:04.211103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.211989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:04.212611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:04.213220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.358264 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=14 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:04.507779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Updating instance_info_cache with network_info: [{"id": "e44eccba-5e0c-435b-9854-374820b759d9", "address": "fa:16:3e:47:d9:55", "network": {"id": "ca85acb5-6954-40d3-8e06-800b0100320c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1327939308-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "796e6e3631804c6db3fae3e40e4702fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape44eccba-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:47:04.520331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Releasing lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:47:04.523895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0954bddf-71a1-4095-b777-25fb4180d5fe tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 202 len: 0 microversion: 2.1 time: 9.907809 Oct 19 00:47:04.524926 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 441/910] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:46:54 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 0 bytes in 9910 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:47:04.530197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-057b1ea4-1f79-4877-8c13-c1db2f05867d tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:04.552337 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-057b1ea4-1f79-4877-8c13-c1db2f05867d tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025860 Oct 19 00:47:04.554464 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 442/911] 10.222.0.27 () {58 vars in 1182 bytes} [Wed Oct 19 00:47:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:47:04.562367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:04.563375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:04.575497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:04.583449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:04.584252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.585056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:04.585538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:04.586000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:04.708864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.726448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38fa62bc-8972-4d64-8562-ea4214497bac tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.546447 Oct 19 00:47:04.729237 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 470/912] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:04 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:04.743937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b442fc8-deff-4ec8-854d-74bbcff037dc tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'create', calling method: .version_select at 0x7f2af50faf70>, body: {"pool": "79a68d6c-c3c7-4c1d-b90f-315d553731ee"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:04.744805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.756598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.759028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:04.774429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35ef0f4d-a5d2-4ca4-83bd-34f94c861ed9 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.217562 Oct 19 00:47:04.777644 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 443/913] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:04 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:04.785058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1409023732", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "2a5d21cb-5608-497f-9479-7e2368bb183b"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:04.885182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:47:06.729393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:47:06.730747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:47:06.731389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:47:06.731976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:47:06.732686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:47:06.740291 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:06.778870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.780495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.781188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:06.782325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.782977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.783567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:06.808197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:47:06.816464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:47:06.864261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:47:06.885957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:47:06.955611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c026ceeb-cd7e-4ff7-a194-8fa67fa20bac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.176530 Oct 19 00:47:06.956863 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 444/914] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:47:06.962257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:06.963403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:06.971020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.972157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.973072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:06.974416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:06.975229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:06.975849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.133290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:08.149246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-544c98ec-2383-4e83-b97c-7f4fb4758c07 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 1.191073 Oct 19 00:47:08.150600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 445/915] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:06 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:08.166132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:08.191698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.192375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.192851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.218702 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] Creating event network-changed:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h2-master-1 Oct 19 00:47:08.230548 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d5f3ff9b-9989-4c30-909f-2266641dfe74 req-22543ae7-44c8-4c16-989b-785731e88bc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078460 Oct 19 00:47:08.234080 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 446/916] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:08.247133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:08.249340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:08.266053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.266560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.267008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.267727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.268188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.268722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.686854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:08.696505 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62a60d28-1884-4521-bf28-499ee80447b1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.459747 Oct 19 00:47:08.698066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 447/917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:08 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:08.704158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:08.704933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:08.712135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.712894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.713629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.714571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:08.715238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:08.715876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:08.912123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:08.976407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:08.991580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:09.011536 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20465dee-fb25-4a7e-9265-06888dc09108 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.312009 Oct 19 00:47:09.012572 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 448/918] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:08 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:09.039789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:09.040535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:09.061515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.062641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.063316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.065445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.066831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.088543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.336676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:09.361437 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ab0a4aa-5906-4629-af27-d6315de7596f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1331 microversion: 2.1 time: 0.341364 Oct 19 00:47:09.367332 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 449/919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:09 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1331 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:09.375998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:09.378699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:09.409479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.409792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.410365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.411880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:09.413105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:09.413919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:09.854382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b442fc8-deff-4ec8-854d-74bbcff037dc tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.120283 Oct 19 00:47:09.874433 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 471/920] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:47:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:10.274404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af5c0f4c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:10.279098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.279609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.280055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.281881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.282447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.283114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.318265 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8f731522-d735-4852-8419-e57cbef5c4b5 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.442407 Oct 19 00:47:10.320157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 472/921] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:47:09 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:10.326163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:10.327250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:10.340816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.342175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.342786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.343942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.344570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.345185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.396889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:10.410150 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17e7bf8e-1f7a-4a78-b40e-2ffbfd674aac tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 1.040666 Oct 19 00:47:10.432970 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 450/922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:09 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:10.438457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.156"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:10.452214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:10.466560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.467349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.467966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.468905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:10.469536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:10.470127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:10.526873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:47:10.531618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquired lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:47:11.060397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:11.079030 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cff85222-72e6-44f7-b3b2-9d985e52d9c1 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.753854 Oct 19 00:47:11.083398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 473/923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:10 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:11.107620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:11.111339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:11.135135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.137932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.143029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.146628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.147370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.148033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.491713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:11.510012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:11.511711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:11.540845 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ac903e5e-3a44-4209-aae5-0900db88d8e2 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.450963 Oct 19 00:47:11.541575 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 474/924] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:11 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:11.586770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af5067550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:11.597907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.599519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.599980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.600800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.607841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.609456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.702674 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-46fe3772-304b-4e16-a4f6-9ce1a6f45ebf tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.147495 Oct 19 00:47:11.703309 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 475/925] 10.222.0.27 () {58 vars in 1139 bytes} [Wed Oct 19 00:47:11 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:11.715099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:11.715731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:11.738441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.738961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.741779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:11.745280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:11.745775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:11.750299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.055238 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee.", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:47:12.057458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Releasing lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:47:12.058286 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.058286 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Request method failure captured: Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action HTTP/1.1 Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 46 Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0jbxSjk0Ye4xu-4naHC19uMDixFkc74LMNB-TX26phbyCy-sINSz_6iTENiNNPtBvVMaAfmIMFt217oJvOvslvhQRNgIAXGx6Nh-jy_4Y_jDOjyTCgo1AlUi5eL8CfWBPUm0k-O9cKKXw-v3FUToUUr1fCjMZxwejUClK1hb6cRH3g Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:47:12.071555 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_796e6e3631804c6db3fae3e40e4702fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}] Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c68fb32e68194933b6c69383572c27b6 Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: {"addFloatingIp": {"address": "172.35.1.156"}} Oct 19 00:47:12.073429 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '15f8e65c-8f36-4120-a7f6-543d95099881', 'body': {'addFloatingIp': {'address': '172.35.1.156'}}} Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.074347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:47:12.075953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.079924 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.085314 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] Oct 19 00:47:12.089426 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:12.094066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Returning 400 to user: Cannot associate floating IP 172.35.1.156 (ca7a9da3-c7d3-426e-af02-7ce1aca2fe46) with port e44eccba-5e0c-435b-9854-374820b759d9 using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 79a68d6c-c3c7-4c1d-b90f-315d553731ee. Oct 19 00:47:12.094066 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-cdfda9b3-592e-424e-bd64-4136712d81b5'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:12.097995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-184faadc-ec41-4302-97b7-6b79a20f338c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 400 len: 382 microversion: 2.1 time: 1.663139 Oct 19 00:47:12.104110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.106448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 451/926] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:10 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 382 bytes in 1672 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:47:12.112965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.113807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:12.115585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d98a754a-b83c-435a-8d94-7762b197ccde tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1337 microversion: 2.1 time: 0.411218 Oct 19 00:47:12.120849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.121505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.122062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.122333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 476/927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:11 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1337 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:12.123483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.124075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.124634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.133212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af50674c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.142089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.153341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.154141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.155769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:12.160606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:12.161441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:12.236281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-333629ca-8da5-4ea8-aabc-867c0de78b79 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.112613 Oct 19 00:47:12.237781 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 477/928] 10.222.0.27 () {58 vars in 1145 bytes} [Wed Oct 19 00:47:12 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:47:12.250193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f5cd400-5910-4236-a426-4e9245f6d135 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '.version_select at 0x7f2af586cc10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.931766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:12.943197 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f31e7d5b-f299-4f9f-84c8-dc2f75915c3c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 0.835247 Oct 19 00:47:12.951347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 452/929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:12 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:12.963997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:12.966500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:12.978881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.000961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.001857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.009236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.010452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.011292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.564395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.584905 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3da0cc5-54f1-4da1-b05f-13997703a248 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.631836 Oct 19 00:47:13.604070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 453/930] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:12 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:13.611204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af9494670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:13.619491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.620248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.621508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.624038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.624767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.625390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.672967 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3c494982-c824-4041-aaa4-1f88c07bad42 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.066295 Oct 19 00:47:13.675701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 454/931] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:47:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:13.683045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:13.684098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:13.692404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.693280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.694653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.696295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:13.697017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:13.697736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:13.930843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.945651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.948544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:13.965236 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7981150a-b608-481a-94c5-6d230450543e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1560 microversion: 2.91 time: 0.282227 Oct 19 00:47:13.976855 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 455/932] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:13 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1560 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:14.010299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.012991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.053198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.053198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.053198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.065835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.066781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.067668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.289297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f5cd400-5910-4236-a426-4e9245f6d135 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/ca7a9da3-c7d3-426e-af02-7ce1aca2fe46" status: 202 len: 0 microversion: 2.1 time: 2.043849 Oct 19 00:47:14.293363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 478/933] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:47:12 2022] DELETE /compute/v2.1/os-floating-ips/ca7a9da3-c7d3-426e-af02-7ce1aca2fe46 => generated 0 bytes in 2049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:47:14.298301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af50bd0d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.306790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.310551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.311276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.319116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.319974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.320442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.371556 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9768eed-3420-4447-bc8d-904bd9c0603b tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.076966 Oct 19 00:47:14.375197 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 479/934] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:14.382271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.383428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.396442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.397459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.398606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.399770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.400537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.401514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.430762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.441124 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e035172-b7d6-4773-b294-7c7572d1857f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 0.456360 Oct 19 00:47:14.441960 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 456/935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:13 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:14.451470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: .version_select at 0x7f2af6ddc280>, body: {"removeFloatingIp": {"address": "172.35.1.188"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:14.751221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:14.760823 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-268c74d1-48f4-42fc-8dde-5608c56a3054 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 0.384051 Oct 19 00:47:14.766001 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 480/936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:14.776378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af50bd5e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.789141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.796415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.797621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.798756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.800141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.801546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.806927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.817428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.818362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.819045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.820811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.824536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.826245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.866980 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:14.906352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92501a2b-e51e-4c71-b468-b3f2a15be774 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.138798 Oct 19 00:47:14.907332 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 481/937] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:14.923962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:14.933947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:14.941836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.945890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.946885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:14.947826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:14.949000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:14.952571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:15.582230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:47:15.582653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquired lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:47:15.638140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:15.648728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-674be774-5fb9-4881-8ded-e1ab708145b2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.740263 Oct 19 00:47:15.665323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 482/938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:14 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:15.679459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af56cb8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:15.699746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.703498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.704818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:15.749909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.753503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.754398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:15.819637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e2b9c84-6dc0-4fa9-9f1f-cadbe4317ee2 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.152242 Oct 19 00:47:15.820531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 483/939] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 00:47:15 2022] GET /compute/v2.1/os-hosts/n-h2-master-1 => generated 598 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:15.825774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:15.826760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:15.841779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.842688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.843400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:15.844389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:15.845206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:15.853958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:16.153467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.178980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.188880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:16.219629 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7fa9e088-7fcf-44ad-a9ef-b0e695c1b638 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.394475 Oct 19 00:47:16.237183 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 484/940] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:15 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:16.246048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:16.246048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:16.258843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:16.259464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:16.259994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:16.261281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:16.261893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:16.262532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:16.835194 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:17.134119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:17.149342 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b69bf1e3-fb38-4045-852c-a845feef6c96 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 0.922683 Oct 19 00:47:17.167033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 485/941] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:16 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:17.176493 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:17.177343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:17.193842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.194341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.194784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:17.195516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.195982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.196417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:17.909442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:17.922661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b298712d-09c8-49ce-9150-64aa6b8bab3f tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1359 microversion: 2.1 time: 0.767594 Oct 19 00:47:17.923594 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 486/942] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:17 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1359 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:17.935893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Calling method '.version_select at 0x7f2af5c0f280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:17.951309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.952023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.952464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:17.983814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:17.988350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:17.988938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.065108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68fc0acd-5670-4e0b-9033-b7a21017d748 tempest-HostsAdminTestJSON-523871587 tempest-HostsAdminTestJSON-523871587-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-master-1" status: 200 len: 859 microversion: 2.1 time: 0.140157 Oct 19 00:47:18.073015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 487/943] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 00:47:17 2022] GET /compute/v2.1/os-hosts/n-h1-master-1 => generated 859 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:18.084063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:18.120723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.128941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.129550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.170764 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] Creating event network-changed:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:47:18.186862 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bcda41de-5fb6-40df-a72f-1fd5b6a39f15 req-c4d8bf94-2ddc-47b2-a67e-4da35386754f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109247 Oct 19 00:47:18.188934 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 488/944] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:18.208559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "name": "network-vif-plugged", "status": "completed", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:18.243984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.249217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.249761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.292222 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] Creating event network-vif-plugged:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h2-master-1 Oct 19 00:47:18.298173 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8db0b589-ec9c-468c-a862-2c99817d50ea req-7725884e-f193-4d53-996a-4b98dff98bc0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107448 Oct 19 00:47:18.304761 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 489/945] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:18.312072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:18.313341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:18.333109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.333722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.334176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.334937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:18.335403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:18.340847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:18.534039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:47:19.055575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.065944 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-abad86c6-4e87-4630-8823-86dc72baa260 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1472 microversion: 2.1 time: 0.759492 Oct 19 00:47:19.088803 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 490/946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:18 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1472 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:19.104173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:19.105077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:19.121117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.121622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.122073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.122815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.123283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.123720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.381501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.395999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.398010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:19.421465 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eed7d25a-45cd-4393-a64b-2f8c9b7d51e1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.327950 Oct 19 00:47:19.425084 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 491/947] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:19 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:19.462802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:19.462802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:19.505639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.506491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.507187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.508110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:19.508792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:19.509392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:19.578321 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:21.334880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:21.343199 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1e1f8f1-4d74-4397-bcd9-1820b7a58738 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 1.916636 Oct 19 00:47:21.347161 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 492/948] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:19 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:21.358182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f8e65c-8f36-4120-a7f6-543d95099881", "tag": "e44eccba-5e0c-435b-9854-374820b759d9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:21.384556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:21.385250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:21.390603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:21.417722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] Creating event network-changed:e44eccba-5e0c-435b-9854-374820b759d9 for instance 15f8e65c-8f36-4120-a7f6-543d95099881 on n-h1-master-1 Oct 19 00:47:21.446494 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d1d8efe7-c212-42c6-9f8d-be54f580f4bc req-959d8db9-5aaa-4303-96e5-cb4f81815a1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096435 Oct 19 00:47:21.447109 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 493/949] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:21.454492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:21.464964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:21.487110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:21.488038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:21.489196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:21.490120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:21.491868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:21.497384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:22.299721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:22.317876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c9493ec-9c33-4a2a-aadb-7f184b94ffd6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1543 microversion: 2.1 time: 0.860046 Oct 19 00:47:22.318888 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 494/950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:21 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1543 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:22.336659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:22.337996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:22.359276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:22.369807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:22.376146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:22.378473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:22.385535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:22.393398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:22.829615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Updating instance_info_cache with network_info: [{"id": "e44eccba-5e0c-435b-9854-374820b759d9", "address": "fa:16:3e:47:d9:55", "network": {"id": "ca85acb5-6954-40d3-8e06-800b0100320c", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1327939308-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "796e6e3631804c6db3fae3e40e4702fb", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape44eccba-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:47:22.843633 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:22.858643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Releasing lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:47:22.859533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac281017-14fd-4a8e-9deb-c5aad9078704 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 202 len: 0 microversion: 2.1 time: 8.416444 Oct 19 00:47:22.868841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 457/951] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:14 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 0 bytes in 8426 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:47:22.894123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:22.896573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:22.915887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:22.917100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:22.917817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:22.919021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:22.921557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:22.922319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.180189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.197929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.199632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.219735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5c82e61-17ad-475f-a542-40ac38c398ea tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.348307 Oct 19 00:47:23.222329 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 458/952] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:22 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:23.242348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:23.243457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:23.260070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.261519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.264664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.265738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.268195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.269365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.385162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:23.410898 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df232410-d2fe-4306-91fb-fcc2216435a6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.076693 Oct 19 00:47:23.412664 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 495/953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:22 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:23.417419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:23.418038 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:23.430261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.430753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.431194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.431905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:23.432357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:23.432848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:23.614280 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9331dd80-fd70-4f8a-aa16-cbc19fd047e9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.389548 Oct 19 00:47:23.615345 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 459/954] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:47:23 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-interface => generated 285 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:23.620114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c167c431-a86a-4c7e-a7ac-a2eddb46bf72 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '.version_select at 0x7f2af9494820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:23.651016 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:24.473912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.500293 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-534b82bc-81f9-49ea-a7c6-52756de6e9d5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 1.085410 Oct 19 00:47:24.509299 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 496/955] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:23 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:24.520670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:24.522352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:24.539378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.540809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.541954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.543519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.544464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.545555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.730749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.741492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.743446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:24.749937 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee5f0c86-29d2-4b29-8b26-cab99741e06f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.238654 Oct 19 00:47:24.762711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 497/956] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:24 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:24.785529 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:24.786156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:24.793001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.793857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.794717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.795733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:24.796459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:24.797182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:24.863628 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:26.024935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:26.041327 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-48aa0e2f-1740-4243-a899-834a0b8f84cc tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.274726 Oct 19 00:47:26.041915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 498/957] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:24 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:26.061431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:26.063433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:26.078713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:26.079574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:26.081928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:26.084169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:26.089383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:26.090072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.149816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:27.170580 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d433ef22-2923-4a90-b09b-dd6fdc2fd29c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 1.127329 Oct 19 00:47:27.171507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 499/958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:26 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:27.181122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:27.181749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:27.214639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.221737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.224259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.225950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.229734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.246455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.359107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c167c431-a86a-4c7e-a7ac-a2eddb46bf72 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b55ee735-e9cf-4f5e-a65c-b59b04371989" status: 202 len: 0 microversion: 2.1 time: 3.742161 Oct 19 00:47:27.360543 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 460/959] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:47:23 2022] DELETE /compute/v2.1/os-floating-ips/b55ee735-e9cf-4f5e-a65c-b59b04371989 => generated 0 bytes in 3744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:47:27.369089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-unplugged", "status": "completed", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:27.432754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.434869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.439231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.489558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] Creating event network-vif-unplugged:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:47:27.511898 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5ad0cab7-a4cf-4a89-986a-032f92e51437 req-8cca89d9-321b-4c31-a636-5fd36526cad6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148849 Oct 19 00:47:27.513151 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 461/960] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:27.527583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:27.544512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:27.565112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.567746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.568416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.569360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:27.569978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:27.570576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:27.831788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:27.866882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:27.868439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:27.903106 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-798f2f9b-508c-4e0a-b376-ceff4463acec tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.727401 Oct 19 00:47:27.907249 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 500/961] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:27 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:27.914235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3ac45-ee7d-4e9f-8fa1-32a393d90c63 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: .version_select at 0x7f2af6ec0ca0>, body: {"addFloatingIp": {"address": ""}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3ac45-ee7d-4e9f-8fa1-32a393d90c63 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Request method failure captured: Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action HTTP/1.1 Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 34 Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jbxSjk0Ye4xu-4naHC19uMDixFkc74LMNB-TX26phbyCy-sINSz_6iTENiNNPtBvVMaAfmIMFt217oJvOvslvhQRNgIAXGx6Nh-jy_4Y_jDOjyTCgo1AlUi5eL8CfWBPUm0k-O9cKKXw-v3FUToUUr1fCjMZxwejUClK1hb6cRH3g Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:27.933216 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_796e6e3631804c6db3fae3e40e4702fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}] Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c68fb32e68194933b6c69383572c27b6 Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: {"addFloatingIp": {"address": ""}} Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:47:27.934713 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '15f8e65c-8f36-4120-a7f6-543d95099881', 'body': {'addFloatingIp': {'address': ''}}} Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '' Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:27.935605 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:47:27.938043 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:47:27.942750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 19 00:47:27.942750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:27.945159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3ac45-ee7d-4e9f-8fa1-32a393d90c63 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:27.946245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39d3ac45-ee7d-4e9f-8fa1-32a393d90c63 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 400 len: 142 microversion: 2.1 time: 0.037317 Oct 19 00:47:27.947327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 501/962] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:27 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 142 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:47:28.423637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Calling method '.version_select at 0x7f2af50faa60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:28.426611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:28.427182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:28.427630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.467950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:28.469349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:28.470219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.485655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:28.487230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:28.488082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.500108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e984059c-5f7b-4d00-841a-08d141b704dc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.551544 Oct 19 00:47:28.501392 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 502/963] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 00:47:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:47:28.510733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:28.514293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:28.525154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:28.526285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:28.526959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.528157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:28.528881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:28.529535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:28.642009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:47:28.645442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquired lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:47:29.176723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:29.194266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f767bd0-9e48-462e-8d0a-d0ca3d365a5f tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.679586 Oct 19 00:47:29.217737 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 462/964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:27 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:29.258923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:29.260029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:29.273393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.274408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.277320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.279062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.279854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.280563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.368952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Releasing lock "refresh_cache-15f8e65c-8f36-4120-a7f6-543d95099881" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:47:29.369934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] HTTP exception thrown: floating IP not found Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Request method failure captured: Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action HTTP/1.1 Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 41 Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jbxSjk0Ye4xu-4naHC19uMDixFkc74LMNB-TX26phbyCy-sINSz_6iTENiNNPtBvVMaAfmIMFt217oJvOvslvhQRNgIAXGx6Nh-jy_4Y_jDOjyTCgo1AlUi5eL8CfWBPUm0k-O9cKKXw-v3FUToUUr1fCjMZxwejUClK1hb6cRH3g Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:29.373819 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_796e6e3631804c6db3fae3e40e4702fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}] Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c68fb32e68194933b6c69383572c27b6 Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:47:29.375256 n-d-master-1 devstack@n-api.service[131449]: exception: floating IP not found Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '15f8e65c-8f36-4120-a7f6-543d95099881', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:29.376094 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 19 00:47:29.377847 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:29.380028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Returning 404 to user: floating IP not found {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:29.381162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2def03a-b7df-416f-be35-045cc1834258 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 404 len: 67 microversion: 2.1 time: 0.877890 Oct 19 00:47:29.381761 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 503/965] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:28 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 67 bytes in 880 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:47:29.417853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Calling method '.version_select at 0x7f2af4fb9040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:29.419769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.436990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.437606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.521575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.527849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.528404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.605489 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ce65df6-c75f-48e7-9a3f-37ac08bf09fc tempest-HypervisorAdminV228Test-401429335 tempest-HypervisorAdminV228Test-401429335-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.220026 Oct 19 00:47:29.612919 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 504/966] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 00:47:29 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:47:29.664424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:29.669528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:29.685887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.688983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.690330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:29.691337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:29.712779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:29.713501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:30.605495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.618228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.638523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:30.653929 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eefe0ac3-2102-4a88-a2a5-019a789a89ef tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 1.009277 Oct 19 00:47:30.682759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 505/967] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:29 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:30.687778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c86236bd-d843-44ac-8ff4-b4f7aaf5c4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Action: 'action', calling method: .version_select at 0x7f2af6ec0ee0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:30.999387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c86236bd-d843-44ac-8ff4-b4f7aaf5c4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c86236bd-d843-44ac-8ff4-b4f7aaf5c4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Request method failure captured: Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action HTTP/1.1 Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 44 Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jbxSjk0Ye4xu-4naHC19uMDixFkc74LMNB-TX26phbyCy-sINSz_6iTENiNNPtBvVMaAfmIMFt217oJvOvslvhQRNgIAXGx6Nh-jy_4Y_jDOjyTCgo1AlUi5eL8CfWBPUm0k-O9cKKXw-v3FUToUUr1fCjMZxwejUClK1hb6cRH3g Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:31.001156 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_796e6e3631804c6db3fae3e40e4702fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}] Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c68fb32e68194933b6c69383572c27b6 Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:47:31.003182 n-d-master-1 devstack@n-api.service[131449]: exception: Floating IP not found for address 0.0.0.0. Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '15f8e65c-8f36-4120-a7f6-543d95099881', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:31.003987 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 19 00:47:31.005170 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:31.008184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c86236bd-d843-44ac-8ff4-b4f7aaf5c4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:31.009343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c86236bd-d843-44ac-8ff4-b4f7aaf5c4d0 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action" status: 404 len: 88 microversion: 2.1 time: 0.325454 Oct 19 00:47:31.010469 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 506/968] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:30 2022] POST /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881/action => generated 88 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:47:31.020337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-plugged", "status": "completed", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:31.109069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.114470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.120301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.169722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] Creating event network-vif-plugged:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:47:31.197498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-590ef315-caee-4240-9438-44539ef6ecb9 req-70a9b578-e944-426b-88ba-cc65b1a7d7d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176670 Oct 19 00:47:31.198353 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 507/969] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:31.226904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:31.239743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:31.265068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.266802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.271100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.272504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.277451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.278124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.407664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:31.434343 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ece9ec4-bd6d-481b-a065-055820d58288 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 2.214740 Oct 19 00:47:31.457595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 463/970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:29 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:31.468308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:31.487609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:31.524990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.526024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.528058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.533967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:31.535636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:31.539046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:31.679985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:47:32.021183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8bedc27-cc49-49e4-b90e-538b0b252707 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "DELETE /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 204 len: 0 microversion: 2.1 time: 0.561883 Oct 19 00:47:32.040187 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 464/971] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:47:31 2022] DELETE /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:32.057481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:32.112236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.119929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.121787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.183438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] Creating event network-changed:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h2-master-1 Oct 19 00:47:32.207698 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7b581a50-7bc5-4dc6-b14f-2845fe9e434b req-78f50338-2731-4be6-b469-8ffdaef357ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165010 Oct 19 00:47:32.210674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 465/972] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:32.229505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:32.235852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:32.278115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.283218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.283704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.284482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.284998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.285447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.335318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.353357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a862562d-41a2-4ea0-a1d6-dec275ee732e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.138882 Oct 19 00:47:32.354141 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 508/973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:31 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:32.370926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:32.375804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:32.418218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.423917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.433972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.437772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.440346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.442092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.553716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.569703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.587106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:32.604690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-640a9167-c7b1-4a40-b1b2-052f36f54ca4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.390202 Oct 19 00:47:32.605948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 466/974] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:32 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:32.620276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:32.621204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:32.645159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.649087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.651825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:32.656283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:32.657451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:32.659686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.432961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:33.442411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8f352e6-6ddb-44d2-adeb-d18e9298eed6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1379 microversion: 2.1 time: 0.834361 Oct 19 00:47:33.443015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 467/975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:32 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1379 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:33.481275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:33.485062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:33.510098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.510637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.511135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.511949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.512459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.512924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.735956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:33.759187 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2f58630-6f20-40fe-ac26-62af4ba6e32f tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1543 microversion: 2.1 time: 1.398795 Oct 19 00:47:33.778778 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 509/976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:32 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1543 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:33.796500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:33.818644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.821587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.822284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.844151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] Creating event network-vif-plugged:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:47:33.866765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cd3c0f78-9d17-4305-87c3-2c23f4b529f4 req-472c3f67-eb74-424f-9c78-f2f867edaa1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085066 Oct 19 00:47:33.878244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 510/977] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:33.884182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:33.894015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:33.912918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.914605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.915332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:33.926453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:33.927476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:33.935740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:34.336959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.357199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.364172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.410054 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ab34624-4534-4c1f-9e77-44d99afa0828 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.529936 Oct 19 00:47:34.413320 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 511/978] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:33 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:34.461139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:34.474760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:34.475776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:34.522790 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a53ad78-8f5a-4a4a-b4ae-6d2a470b59a0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.041519 Oct 19 00:47:34.524441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 468/979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:33 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:34.527258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:34.529839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:34.532246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:34.537459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:34.540111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:34.542578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:34.797811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:34.799327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:34.834573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:34.840312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:34.851669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:34.856520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:34.859763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:34.863236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:35.811161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:35.822142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:35.879554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4dd6aa99-f91f-4394-9be0-b104eeacbab6 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1543 microversion: 2.1 time: 1.085395 Oct 19 00:47:35.883582 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ffbf74b4-40e6-4685-a90c-445a9bd27a66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1528 microversion: 2.1 time: 1.412960 Oct 19 00:47:35.889759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 512/980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:34 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1528 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:35.907797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 469/981] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:34 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1543 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:35.960145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:35.961221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:35.967054 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:35.968717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:35.993482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:35.993984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:35.994426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:35.995145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:35.995603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:35.996033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.000158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.000722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.001106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.002450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.003210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.004330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.625930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.638271 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:36.650952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.660252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:36.706620 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37655992-c446-4584-a327-a9499d5ab67b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.799596 Oct 19 00:47:36.708040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 513/982] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:35 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:36.733663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:36.738662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:36.766863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.781278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.782160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:36.786454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:36.790165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:36.790988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.271220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:37.284319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a633b54-b39d-44e1-98b9-84e49b67f120 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1478 microversion: 2.1 time: 1.368735 Oct 19 00:47:37.289921 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 470/983] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:35 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1478 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:37.309462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f8e65c-8f36-4120-a7f6-543d95099881", "name": "network-vif-deleted", "tag": "e44eccba-5e0c-435b-9854-374820b759d9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:37.344182 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:37.346933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.347423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.347865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.408331 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] Creating event network-vif-deleted:e44eccba-5e0c-435b-9854-374820b759d9 for instance 15f8e65c-8f36-4120-a7f6-543d95099881 on n-h1-master-1 Oct 19 00:47:37.422230 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-34a1dd94-e1fc-4a44-ae7e-1ea34af70b50 req-6ab0e717-3072-455b-a744-117c6e91cb06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130796 Oct 19 00:47:37.430189 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 471/984] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:37.450378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:37.460857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:37.490491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.491086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.493199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.494079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.496177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.496718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.744342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:37.753806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe594b38-ca3a-4bdc-bf56-f5917529fd8c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1317 microversion: 2.1 time: 0.320838 Oct 19 00:47:37.766396 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 472/985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:37 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:37.819066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:37.819869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:37.843498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.847432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.848148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:37.849168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:37.850841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:37.851838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.585900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.608969 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7e19bf1-72d4-4a3d-9ef5-bd6839658c83 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1528 microversion: 2.1 time: 1.899485 Oct 19 00:47:38.621997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 514/986] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:36 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1528 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:38.646745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:38.647560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:38.670388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.671195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.671764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.673780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.674574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.675460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.769901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.779707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.790019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:38.812558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a96dcd4f-7c71-4d28-9c80-b2b6cc68e9c4 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 1.028589 Oct 19 00:47:38.814592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 473/987] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:37 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:38.825661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-74e500df-402d-471f-b693-13da0bef075b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:38.860650 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-74e500df-402d-471f-b693-13da0bef075b tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2a5d21cb-5608-497f-9479-7e2368bb183b" status: 202 len: 0 microversion: 2.1 time: 0.044604 Oct 19 00:47:38.865862 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 474/988] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:47:38 2022] DELETE /compute/v2.1/flavors/2a5d21cb-5608-497f-9479-7e2368bb183b => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:47:38.874516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:38.879798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:38.893991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.894943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.896580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:38.898032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:38.901026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:38.901687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:39.034476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:39.034836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:39.035481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:39.037262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lazy-loading 'fault' on Instance uuid 15f8e65c-8f36-4120-a7f6-543d95099881 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:39.284921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c68fb32e68194933b6c69383572c27b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796e6e3631804c6db3fae3e40e4702fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:39.297030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba6156ff-162a-4239-94ca-73bfb81ded3c tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 200 len: 1322 microversion: 2.1 time: 0.427944 Oct 19 00:47:39.297952 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 475/989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:38 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:39.327792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fb5977c-42ea-4fdc-83e4-54dda050bc2e tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:39.389299 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fb5977c-42ea-4fdc-83e4-54dda050bc2e tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.087870 Oct 19 00:47:39.400372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 476/990] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:47:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:39.422498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:39.425335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:39.433149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:39.433938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:39.434548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:39.435526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:39.436143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:39.436765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:39.719428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:39.733884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Old instance type tempest-test_resize_flavor_-1930696987, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 00:47:39.741580 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:39.751987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:47:39.752738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:47:39.753582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:47:39.754192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:47:39.754790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:47:40.099389 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da97ad94-cd8e-47fc-9188-3845fedce399 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.682727 Oct 19 00:47:40.106423 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 477/991] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:39 2022] POST /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7/action => generated 0 bytes in 690 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:47:40.122231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:40.123017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:40.145035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.145489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.145953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.146716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.147189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.147660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.697002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.728610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.736358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.755149 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1035b146-1d07-45d1-94f2-8158280f839e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.647536 Oct 19 00:47:40.766773 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 478/992] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:40 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:40.771681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:40.780652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:40.812778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.812778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.814556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.815645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.816591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.817404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.825389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:40.854365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9462d5ef-4c90-4bf4-b633-06d4bbc85757 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1463 microversion: 2.1 time: 2.224658 Oct 19 00:47:40.855198 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 515/993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:38 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1463 bytes in 2233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:40.872811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:40.878340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] [instance: 15f8e65c-8f36-4120-a7f6-543d95099881] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:40.905247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.907719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.922931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.930221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:40.933697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:40.939086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:40.995943 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] HTTP exception thrown: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Request method failure captured: Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 HTTP/1.1 Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0jbxSjk0Ye4xu-4naHC19uMDixFkc74LMNB-TX26phbyCy-sINSz_6iTENiNNPtBvVMaAfmIMFt217oJvOvslvhQRNgIAXGx6Nh-jy_4Y_jDOjyTCgo1AlUi5eL8CfWBPUm0k-O9cKKXw-v3FUToUUr1fCjMZxwejUClK1hb6cRH3g Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:41.035484 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_796e6e3631804c6db3fae3e40e4702fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/796e6e3631804c6db3fae3e40e4702fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/796e6e3631804c6db3fae3e40e4702fb"}]}] Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 796e6e3631804c6db3fae3e40e4702fb Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c68fb32e68194933b6c69383572c27b6 Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:47:41.037259 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '15f8e65c-8f36-4120-a7f6-543d95099881'} Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:41.038027 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. Oct 19 00:47:41.039340 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:41.043303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] Returning 404 to user: Instance 15f8e65c-8f36-4120-a7f6-543d95099881 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:41.044779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b8c2e34f-b09c-444b-9102-35ff08e51cc1 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470 tempest-FloatingIPsAssociationNegativeTestJSON-2122790470-project] 10.222.0.27 "GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881" status: 404 len: 111 microversion: 2.1 time: 0.188560 Oct 19 00:47:41.051628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 516/994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:40 2022] GET /compute/v2.1/servers/15f8e65c-8f36-4120-a7f6-543d95099881 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:41.087081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:41.091384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:41.120460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.121428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.124567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.125944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.127381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.129623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.408820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad529ae7-2d11-4859-8ddd-4e4238cfadd6 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 0 microversion: 2.1 time: 0.352438 Oct 19 00:47:41.410573 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 517/995] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:41 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:47:41.422829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:41.427637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:41.440497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.442419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.443298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.450458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.451227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.452179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.537014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.538302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.538912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.539541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lazy-loading 'fault' on Instance uuid b4ac136e-a80e-408b-a0d1-4afeea2d689a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:41.697457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:41.722539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3318c3d-b616-46ba-8cff-47accd046caa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1537 microversion: 2.1 time: 0.959893 Oct 19 00:47:41.723566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 479/996] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:40 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1537 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:41.804333 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a667ed6-c4f0-48a0-92b9-e548612cb380 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1597 microversion: 2.1 time: 0.385921 Oct 19 00:47:41.811957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:41.812836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:41.819272 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 518/997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:41 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1597 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:41.822319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.825757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.825757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.829069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.829752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.831078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.854970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:41.857795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:41.870517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.879928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.881428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:41.887291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:41.890408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:41.891291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.074024 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65520ea6-c072-4811-a59f-61f1834db43b tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action" status: 202 len: 0 microversion: 2.1 time: 0.221118 Oct 19 00:47:42.074755 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 519/998] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:47:41 2022] POST /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:47:42.088655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:42.091730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:42.105569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.106381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.108596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.109550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.112883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.113607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.278260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.295556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.301480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:42.312737 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-700c30ba-4d9e-4778-a115-aed3d1725a31 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.505056 Oct 19 00:47:42.313352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 480/999] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:41 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:42.627364 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3302f139-45e1-4646-bbf4-b59fac362512 tempest-ServersAdminTestJSON-179537576 tempest-ServersAdminTestJSON-179537576-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1614 microversion: 2.1 time: 0.545994 Oct 19 00:47:42.651227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 520/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:42 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1614 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:42.683863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:42.684841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:42.696081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.696914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.697680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.698819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.699619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.700389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.754961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:42.757849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:42.780081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:47:42.781070 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:42.785992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.789586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.797684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:42.799318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:42.800944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:42.805619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.134938 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53f2ba49-34e9-463b-ac21-a9e6ef4ef15e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 204 len: 0 microversion: 2.1 time: 0.456705 Oct 19 00:47:43.136661 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 481/1001] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:47:42 2022] DELETE /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:43.158026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:43.159080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:43.178821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.179337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.180730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.183121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.186702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.187548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.663891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:43.683870 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9be0a624-4963-4058-b4f9-b9c624875a04 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1537 microversion: 2.1 time: 0.936739 Oct 19 00:47:43.700826 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 521/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:42 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1537 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:43.713966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:43.714877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:43.724596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.725376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.726028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:43.727034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:43.727664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:43.728324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:44.105158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.110536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.121468 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-362ab7df-364a-477b-8215-e52e2e6813d3 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1469 microversion: 2.1 time: 0.980657 Oct 19 00:47:44.124543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.131832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:44.140908 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 482/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:43 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1469 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:44.190266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd4b2815-af83-4a64-a88c-929bbe51417a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.487396 Oct 19 00:47:44.194428 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 522/1004] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:43 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:44.712642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:44.713336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:44.734561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.736490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.748597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:44.749529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:44.750068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:44.750792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.151368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:45.152288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:45.172266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.173326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.174061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:45.175049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:45.184703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:45.205528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:46.154824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.173554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba5d6146-506e-498d-9c0a-5543f0a35ec6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1537 microversion: 2.1 time: 1.465256 Oct 19 00:47:46.178724 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 483/1005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:44 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1537 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:46.183766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:46.184376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:46.213464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:46.213977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:46.214427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:46.215156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:46.215614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:46.216038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:46.409011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.422048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9ee23165-7c03-4e35-be24-2c5bb42e412b tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1469 microversion: 2.1 time: 1.276839 Oct 19 00:47:46.438164 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 523/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:45 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1469 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:46.454154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.466498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.469034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:46.477349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e36d3281-6d6a-4789-ae24-39363e732c0c tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1555 microversion: 2.91 time: 0.297314 Oct 19 00:47:46.478770 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 484/1007] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:46 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1555 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:47.209776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:47.210703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:47.238382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.239276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.241463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.243812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.246755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.247488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.459942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:47.460873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:47.484291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.488887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.489641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.497104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.497875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.498499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.939305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:47.954792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e3a1ccd-5c2f-4266-a1b0-bf0f3d73279c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1427 microversion: 2.1 time: 0.499578 Oct 19 00:47:47.962428 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 485/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:47 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1427 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:47.967862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:47.968476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:47.984235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.984765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.985283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:47.993482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:47.994054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:47.994516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:48.002935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.013213 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-173fc371-bbe5-4e43-bbe9-2e144cbb79ab tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1537 microversion: 2.1 time: 0.810284 Oct 19 00:47:48.014653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 524/1009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:47 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1537 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:48.252267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.271223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.274070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:48.290068 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e35ea52-c55f-466d-bc00-ff13e657d584 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1537 microversion: 2.91 time: 0.326253 Oct 19 00:47:48.295083 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 486/1010] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:47 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:48.650770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbda252-08e1-428a-92d8-b6703607f790", "name": "network-vif-deleted", "tag": "f28635c9-1b32-4e8a-af3a-3ca7952c962f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:48.725810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:48.726935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:48.728891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:48.811592 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] Creating event network-vif-deleted:f28635c9-1b32-4e8a-af3a-3ca7952c962f for instance ebbda252-08e1-428a-92d8-b6703607f790 on n-h1-master-1 Oct 19 00:47:48.857481 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-df06cc4e-2231-4e89-b2ec-da289a09deab req-d71935d4-b372-48d0-aa19-16df2bd907f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188550 Oct 19 00:47:48.865029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 525/1011] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:47:48.979321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:48.980562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:49.000031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.007701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.008767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.018928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.019754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.024767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.042531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:49.053821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:49.076705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.079576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.080212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.095429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.095958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.096414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.189390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.189939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.190386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.191059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lazy-loading 'fault' on Instance uuid ebbda252-08e1-428a-92d8-b6703607f790 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:49.501814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.539685 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01b50f41-3434-4282-8639-b3fe74c6002c tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1303 microversion: 2.1 time: 0.562764 Oct 19 00:47:49.540339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 487/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:48 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1303 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:49.553333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:49.576767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:49.615337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.615853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.616300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.628694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:49.629208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:49.629669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:49.833336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.847672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.855056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.875618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83ebbb49-5d26-4436-b9a6-714b037888e0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1537 microversion: 2.91 time: 0.333914 Oct 19 00:47:49.876807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 488/1013] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:49 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:49.906299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:49.921036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d84407bd-2453-4dc4-be05-a5dc0f2c5ffa tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1537 microversion: 2.1 time: 0.883699 Oct 19 00:47:49.927443 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 526/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:49 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1537 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:47:50.591354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:50.593349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:50.612677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.627477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.627951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.628735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.630691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.631366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.779066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.785634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.787440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.790153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lazy-loading 'fault' on Instance uuid ebbda252-08e1-428a-92d8-b6703607f790 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:50.914424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:50.915332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:50.935401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.936568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.944598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.948190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:50.948854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:50.949376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:50.958471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:50.976732 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07f7c316-9c8f-497a-bf4d-5618aade637e tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 200 len: 1303 microversion: 2.1 time: 0.391965 Oct 19 00:47:50.993960 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 489/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:50 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 1303 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:51.027923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:51.029023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:51.054049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:51.060132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:51.065685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:51.066715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:51.067365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:51.070957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:51.270272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.284357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.286256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.316127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-077f96f8-4074-49e5-b946-88de10dab383 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1537 microversion: 2.91 time: 0.406329 Oct 19 00:47:51.330322 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 527/1016] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:50 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1537 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:51.739886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:51.744416 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:51.763339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d77b746-c158-4e06-b7b5-5912a80c492e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.760800 Oct 19 00:47:51.764525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 490/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:50 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:51.999840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:52.000699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ebbda252-08e1-428a-92d8-b6703607f790] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:52.020773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.031998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.035830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.036922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.041230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.049548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.104513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] HTTP exception thrown: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Request method failure captured: Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 HTTP/1.1 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ifFjx8UYBng9ApM8RcATss117tP36cB8eOD5sfYFxVv-SVNT4pXhvN19QGMad4I7eZ8L-CO9LZE5gKnSy4iZ7ee64A1IbkoBy25MA-mAq95Oy_2kt4u_XbgQTk9JG1Sxb44w2S5BbpW0FkkmH0s1_2lnAZGeg8hv5X0p2raFd_2DQ Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:52.110725 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0ee493430f849718083118f0a4e61c0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}] Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e94cc0780af240188e5024335e581dea Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. Oct 19 00:47:52.113824 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ebbda252-08e1-428a-92d8-b6703607f790'} Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:52.115391 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. Oct 19 00:47:52.118011 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:52.122122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Returning 404 to user: Instance ebbda252-08e1-428a-92d8-b6703607f790 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:52.127352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e50e6522-1a94-42a4-a720-3afe05d61a42 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790" status: 404 len: 111 microversion: 2.1 time: 0.131228 Oct 19 00:47:52.134915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 528/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:51 2022] GET /compute/v2.1/servers/ebbda252-08e1-428a-92d8-b6703607f790 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:47:52.157993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:52.167985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:52.180144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.181404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.182368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.187674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.190040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.192903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.307349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:47:52.365720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:52.367934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:52.386636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.387382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.388931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.391777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.392680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.394781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.469450 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:52.584899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e78d727-6759-4ac1-9653-0d5c0a5cb45a tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 204 len: 0 microversion: 2.1 time: 0.444141 Oct 19 00:47:52.586303 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 491/1019] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:47:52 2022] DELETE /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:52.608469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:52.611342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:52.707980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.709051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.711781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.717462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.718465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.719295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.758967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:52.791872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:52.797420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:52.807765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce3ed113-c00d-45e0-b69a-0202ae736b24 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1480 microversion: 2.91 time: 0.447975 Oct 19 00:47:52.820752 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 529/1020] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:52 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1480 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:52.850636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:52.855200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:52.884850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.885596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.886335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:52.894009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:52.894848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:52.895588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.431864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:53.443639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e49a3d0-55ad-4da1-bcf5-bca0463c6ed2 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1470 microversion: 2.1 time: 0.845257 Oct 19 00:47:53.444321 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 492/1021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:52 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1470 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:53.472668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:53.475574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:53.488913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.494473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.497406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.498381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.500062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.504986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.600973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-master-1". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 00:47:53.613325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:53.623736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-836fa36e-f773-45b3-9438-2888c6e735af tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.801032 Oct 19 00:47:53.624356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 530/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:52 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:53.774867 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-438c8a2f-5923-4986-8969-ead4564915ed tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action" status: 202 len: 0 microversion: 2.91 time: 0.319342 Oct 19 00:47:53.784205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:53.784958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:53.795270 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 493/1023] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:47:53 2022] POST /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:53.796705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.797219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.797738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:53.798604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:53.806513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:53.807036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:54.004032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.042612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.044100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:54.063266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8398e2d-3065-461b-8dc8-33ca0a9673e8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1488 microversion: 2.91 time: 0.283275 Oct 19 00:47:54.093711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 531/1024] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:53 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1488 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:47:54.483271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:54.487463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:54.506926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:54.518378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:54.521141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:54.529059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:54.529687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:54.530148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:54.793919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-304f5054-efc3-4f92-8fbb-4186c664dcac tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Calling method '.version_select at 0x7f2af94918b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:54.961784 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-304f5054-efc3-4f92-8fbb-4186c664dcac tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 371 microversion: 2.1 time: 0.499666 Oct 19 00:47:54.972466 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 494/1025] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:47:54 2022] GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 371 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:55.018423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:55.019378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:55.033211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.055991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.063773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.064790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.065405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.066040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.435462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.446987 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6664634-9076-4ba6-8486-24669394b867 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1470 microversion: 2.1 time: 0.977515 Oct 19 00:47:55.456297 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 532/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:54 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1470 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:55.487581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5c0f280>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:55.557150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.566301 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bfd2a0cc-1a10-44c7-a083-fa1d426541ee tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.586553 Oct 19 00:47:55.587796 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 495/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:54 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:55.603443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:55.605886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:55.633072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.634481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.634944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.636834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.639807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.640704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.780453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.784773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.785647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.789457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.790292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.790967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.876942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.924380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.926587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:55.933670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-513ebc57-64ca-4d08-9e8d-aa024a868415 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 328 microversion: 2.1 time: 0.475758 Oct 19 00:47:55.948144 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 533/1028] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:47:55 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 328 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:55.953398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:55.955275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:55.970985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.971221 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a71d2ddc-f8c7-488a-b483-666f7183b4dd tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1490 microversion: 2.91 time: 0.379281 Oct 19 00:47:55.972274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.980366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 496/1029] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:55 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1490 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:55.980767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:55.993387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:55.993387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:55.993387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.060752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0", "name": "network-vif-deleted", "tag": "4ad823f3-226f-42e0-8c46-45c357270f6d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:56.080065 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:47:56.092515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.093717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.099028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.134852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] Creating event network-vif-deleted:4ad823f3-226f-42e0-8c46-45c357270f6d for instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 on n-h1-master-1 Oct 19 00:47:56.166956 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-59e0426c-51cf-4a55-8708-75587a32e293 req-b4cfdd5a-2788-4145-afa9-a859e2a39b9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122979 Oct 19 00:47:56.171069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 497/1030] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:56.364701 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a36114aa-44ac-4853-89d7-abb707f2cc0c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1813 microversion: 2.1 time: 0.416172 Oct 19 00:47:56.393900 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 534/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:55 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1813 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:56.419188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:56.430272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.437525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.439667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.440733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.441521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.442126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.476047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-235649265", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:56.529276 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9071cdde-db3f-4d3f-a63a-1dcb941cdc80 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.121401 Oct 19 00:47:56.530182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 535/1032] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:47:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:47:56.549172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:56.550632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:56.569618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.572872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.573708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.575137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.575907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.579415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.614762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:47:56.753614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:56.754398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:56.754857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:56.755360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lazy-loading 'fault' on Instance uuid ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:47:57.102758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:57.113542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad7f3f82-9b7c-43b0-ab96-a33885111db0 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 200 len: 1304 microversion: 2.1 time: 0.572887 Oct 19 00:47:57.122762 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 536/1033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:56 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 1304 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:57.147497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:57.155188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:57.169354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:57.170215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:57.171744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:57.176839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:57.177714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:57.178450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.578196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:47:58.579568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:47:58.580247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:47:58.580924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:47:58.581530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:47:58.603327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.615000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.615474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.623088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.623709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.624172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.693792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:47:58.711658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for user cda5affea11b414e953a847d7fa8ae5e and project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:47:58.756153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.utils [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] cores quota exceeded for c6b94eaa25a6419d8b445a9a11a71e16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131450) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 00:47:58.759076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Request method failure captured: Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 144 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0k4R3kzvAL7Lt_OhqEqRgOBQnZfUVA7-2fHFPD6HaJw6ruWeECVucCND8FoKqG9Jx56SrMrwggf-MJHNutLkE0nETsSHYYYGWEZ29N9FMMXNGIRBdlyCKJOJSuuOi78bsaQDWdg8TfS5-FWDBezRhykKbcXteaF--GUijdWRNh4FLk Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:47:58.787153 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6b94eaa25a6419d8b445a9a11a71e16", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}] Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cda5affea11b414e953a847d7fa8ae5e Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-235649265", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} Oct 19 00:47:58.788747 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-235649265', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452'}}} Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 00:47:58.789599 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:58.790778 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.792339 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 19 00:47:58.793899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.796056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:58.797813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc8b980f-c347-4456-b501-0994da066ce6 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.527236 Oct 19 00:47:58.799335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 498/1034] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:47:56 2022] POST /compute/v2.1/servers => generated 111 bytes in 2530 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:58.806679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:58.811019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:58.822523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:58.826686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c58f2e79-7c2a-4650-b88e-e4a5b08e99a5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 1.700888 Oct 19 00:47:58.830454 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 537/1035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:57 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:58.837374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.838210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.838936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.839903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.840591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.845905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:58.846922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:58.851219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.860683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.861204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.861641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.867259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:58.877254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:58.878007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:58.909116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] HTTP exception thrown: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Request method failure captured: Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 HTTP/1.1 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ifFjx8UYBng9ApM8RcATss117tP36cB8eOD5sfYFxVv-SVNT4pXhvN19QGMad4I7eZ8L-CO9LZE5gKnSy4iZ7ee64A1IbkoBy25MA-mAq95Oy_2kt4u_XbgQTk9JG1Sxb44w2S5BbpW0FkkmH0s1_2lnAZGeg8hv5X0p2raFd_2DQ Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:47:58.911100 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0ee493430f849718083118f0a4e61c0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}] Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e94cc0780af240188e5024335e581dea Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. Oct 19 00:47:58.912844 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0'} Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:47:58.913636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. Oct 19 00:47:58.914934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:47:58.928820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Returning 404 to user: Instance ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:47:58.930074 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f681671-9b90-470b-bf93-84eae3c72dff tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0" status: 404 len: 111 microversion: 2.1 time: 0.098151 Oct 19 00:47:58.931211 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 538/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:58 2022] GET /compute/v2.1/servers/ababd2f6-d89b-4f7e-ac35-d5af5e1eafa0 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:47:58.936908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4f6f940>, body: {"quota_set": {"cores": 20}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:47:58.987579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.001515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.003571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.011052 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5161f391-526f-41de-adc6-59158c639c86 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.209792 Oct 19 00:47:59.030040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 499/1037] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:47:58 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:47:59.050653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:59.051588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:59.061868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.063462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.064158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.065220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.065989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.066675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.106404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:47:59.239290 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24133529-ac6d-42ef-8688-21dfc57b3486 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 204 len: 0 microversion: 2.1 time: 0.205434 Oct 19 00:47:59.241224 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 500/1038] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:47:59 2022] DELETE /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:47:59.258036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:59.260157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:59.278152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.279874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.280862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.284701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.286365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.288601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.726191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.727320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.745732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:47:59.770812 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f789999e-d3b9-4602-b240-14abe193e7d5 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1469 microversion: 2.1 time: 0.517369 Oct 19 00:47:59.770908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.770908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.770908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.770908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.794153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 501/1039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:59 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1469 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:47:59.860234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:47:59.861418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:47:59.883403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.884866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.889019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.902172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:47:59.905888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:47:59.913047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:47:59.990384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7946baee-0886-42ef-98a4-dc6eaae4c2f9 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 329 microversion: 2.1 time: 1.052426 Oct 19 00:48:00.001189 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 539/1040] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:47:58 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 329 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:00.072111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd36063d-d90f-4a93-9a2a-cf657cdfff42 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Calling method '.version_select at 0x7f2af4fcd820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:00.378955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.400542 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c82748f0-3b84-45ec-8437-c123c58c10f5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.544943 Oct 19 00:48:00.401576 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 502/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:47:59 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:00.417001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:00.425835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:00.462455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.463226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.464457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.467111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.467907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.470694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.668344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.691943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.696037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:00.718115 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ddfd53b-d7da-47f8-80bd-abd6be5ac2dc tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.314190 Oct 19 00:48:00.732827 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 503/1042] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:00 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:00.796938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:00.799365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:00.813523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.814740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.819292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.820520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:00.826555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:00.827362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:00.974826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd36063d-d90f-4a93-9a2a-cf657cdfff42 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 371 microversion: 2.1 time: 0.931273 Oct 19 00:48:00.976598 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 540/1043] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:48:00 2022] GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 371 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:00.994197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4f1d3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:01.233562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.234068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.235144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.236032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.236530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.258136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.399809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:01.411234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68d84390-4d74-4368-90ad-97080986f517 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1469 microversion: 2.1 time: 0.622277 Oct 19 00:48:01.411839 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 504/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:00 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1469 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:01.442243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:01.444995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:01.470025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.473411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.474137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.477174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.477461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.477909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.481095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b7947f3-ba29-4be4-8db1-c33b75d9d9f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 328 microversion: 2.1 time: 0.494339 Oct 19 00:48:01.491045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 541/1045] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:48:00 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 328 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:01.493256 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:01.767456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:01.777592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:01.816663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.823327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.824567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.827356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:01.835931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:01.837122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:01.883281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:01.893873 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef5e9fe3-af89-407e-a8e0-3dab95913918 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.467554 Oct 19 00:48:01.909215 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 505/1046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:01 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:01.917533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1220098401", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:02.147202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.162392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.186154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:02.213276 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-035ad85f-f346-4dfa-a468-0ae514a1aad8 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.454768 Oct 19 00:48:02.218789 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 542/1047] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:01 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:02.243818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "096dc72e-f59a-441e-8e72-e180a5f51427", "device": "/dev/xvdb"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:02.258413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:02.292530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:02.293350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:02.299749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:02.300866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:02.302591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:02.313703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.311698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ea0a75d-ec10-441e-a6ef-05096fd0f86d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.084740 Oct 19 00:48:03.317061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 543/1048] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 00:48:02 2022] POST /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 194 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:03.343674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:03.347129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:03.375531 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:03.379920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.380830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.381464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.383827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.385785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.386868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.598824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e94cc0780af240188e5024335e581dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ee493430f849718083118f0a4e61c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:03.619296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27c973d9-9c6e-40d1-b229-a89812b050d6 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 200 len: 1299 microversion: 2.1 time: 0.297883 Oct 19 00:48:03.622967 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 544/1049] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:03 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 1299 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:03.638208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:03.639156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:03.660295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.660728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.664367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:03.666682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:03.669022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:03.671196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:04.440865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:04.488967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f832cbce-3b4d-4465-97db-d00807a16520 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.864204 Oct 19 00:48:04.501598 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 545/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:03 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:04.523982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ac136e-a80e-408b-a0d1-4afeea2d689a", "name": "network-vif-deleted", "tag": "fe0d3770-c062-456f-ba3a-5846f7508c82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:04.550939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:04.551463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:04.557477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:04.586423 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] Creating event network-vif-deleted:fe0d3770-c062-456f-ba3a-5846f7508c82 for instance b4ac136e-a80e-408b-a0d1-4afeea2d689a on n-h1-master-1 Oct 19 00:48:04.602518 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2a0681f7-b126-4c5a-920b-d69a68ac031c req-97e6a867-3b94-4258-8b4c-ec49df9c0a9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098251 Oct 19 00:48:04.603768 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 546/1051] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:04.644685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:04.645453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:04.667657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:04.668169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:04.674815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:04.675722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:04.676211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:04.682950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.069153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.103463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.105165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:05.146523 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6582301b-15bb-49c3-9d94-7d17fb3f3184 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.540171 Oct 19 00:48:05.180233 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 547/1052] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:04 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:05.191907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:05.192536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] [instance: b4ac136e-a80e-408b-a0d1-4afeea2d689a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:05.223037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:05.240489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:05.241001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.241836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:05.242742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:05.248714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.327287 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] HTTP exception thrown: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Request method failure captured: Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a HTTP/1.1 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ifFjx8UYBng9ApM8RcATss117tP36cB8eOD5sfYFxVv-SVNT4pXhvN19QGMad4I7eZ8L-CO9LZE5gKnSy4iZ7ee64A1IbkoBy25MA-mAq95Oy_2kt4u_XbgQTk9JG1Sxb44w2S5BbpW0FkkmH0s1_2lnAZGeg8hv5X0p2raFd_2DQ Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:48:05.331304 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e0ee493430f849718083118f0a4e61c0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e0ee493430f849718083118f0a4e61c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e0ee493430f849718083118f0a4e61c0"}]}] Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e0ee493430f849718083118f0a4e61c0 Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminTestJSON-2030824605 Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e94cc0780af240188e5024335e581dea Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminTestJSON-2030824605-project Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. Oct 19 00:48:05.333007 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b4ac136e-a80e-408b-a0d1-4afeea2d689a'} Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:05.333938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. Oct 19 00:48:05.335441 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:05.336863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] Returning 404 to user: Instance b4ac136e-a80e-408b-a0d1-4afeea2d689a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:05.336863 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7fe2572d-6fe0-4e0f-b4ad-6a3a2b198d86 tempest-ServersAdminTestJSON-2030824605 tempest-ServersAdminTestJSON-2030824605-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a" status: 404 len: 111 microversion: 2.1 time: 0.159516 Oct 19 00:48:05.336863 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 548/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:05 2022] GET /compute/v2.1/servers/b4ac136e-a80e-408b-a0d1-4afeea2d689a => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:05.523949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:05.524594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:05.540730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:05.541246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:05.549208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:05.550760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:05.552655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:05.556946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:06.571308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.576309 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:06.606477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-053014c9-0db3-404b-910d-c54794ef5d22 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 1.084340 Oct 19 00:48:06.625435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 549/1054] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:05 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:06.631602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:06.632258 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:06.642089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:06.642898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:06.643566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:06.644484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:06.645139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:06.645905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:06.840786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.860087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.865096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:06.885085 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddfc6d23-fec6-469c-83ce-01caf592f53a tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.256325 Oct 19 00:48:06.886192 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 550/1055] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:06 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:07.653774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:07.667768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:07.744027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:07.749864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:07.753301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:07.754495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:07.777870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:07.780031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:08.674396 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:08.707975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:08.727002 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f1fe2a9-1942-4c59-a65d-696a66e847b6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 1.086802 Oct 19 00:48:08.741285 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:08.744836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 551/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:07 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:08.768539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:08.769210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:08.813969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:08.815936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:08.816494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:08.818524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:08.824196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:08.829190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:09.075383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.103606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.111246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:09.123535 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2dd6423-4fb0-48e7-a92f-a5a0f20b8dc0 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.376696 Oct 19 00:48:09.127051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 552/1057] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:08 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:09.589418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:10.247599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20cf8c57-2863-473a-93a9-4345266e67e0 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Action: 'create', calling method: .version_select at 0x7f2af5c0f4c0>, body: {"keypair": {"name": "tempest-keypair-1515828034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJwLxwRk7ZellJZqSeAcMKSVpxq2p4K7viBGcN69WCV1bkss9IuVw9qWWWc8jjZsh/Ypgz38ljdoTjZi5MFzlGJr8y9GCI+wII/waAThABC33JF7oFf+ckLhxzQjQG5rMw=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:10.303910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-20cf8c57-2863-473a-93a9-4345266e67e0 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Getting quotas for project bf3b8f8475874a7988dc35023a58d083. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:10.333024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-20cf8c57-2863-473a-93a9-4345266e67e0 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Getting quotas for user 1e43026c56e0462b976a840266ea8acf and project bf3b8f8475874a7988dc35023a58d083. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:10.419401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20cf8c57-2863-473a-93a9-4345266e67e0 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.885899 Oct 19 00:48:10.433064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 553/1058] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:48:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:10.455336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:10.456186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:10.492871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:10.493533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:10.493984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:10.494717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:10.502115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:10.502982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.143581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:11.165966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-adb6131f-ad98-4fcf-a86a-948085416248 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.730853 Oct 19 00:48:11.166579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 554/1059] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:10 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:11.182542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:11.183978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:11.186036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:11.187956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:11.188647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:11.191271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:11.191906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:11.208737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.209992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.210504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.210957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.211724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.212136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.212690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.219733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.220550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.221644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.222476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.223144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.285176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:11.305255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for user cda5affea11b414e953a847d7fa8ae5e and project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:11.307835 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:11.328156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.utils [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] instances quota exceeded for c6b94eaa25a6419d8b445a9a11a71e16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131450) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 00:48:11.329753 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Request method failure captured: Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 145 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0k4R3kzvAL7Lt_OhqEqRgOBQnZfUVA7-2fHFPD6HaJw6ruWeECVucCND8FoKqG9Jx56SrMrwggf-MJHNutLkE0nETsSHYYYGWEZ29N9FMMXNGIRBdlyCKJOJSuuOi78bsaQDWdg8TfS5-FWDBezRhykKbcXteaF--GUijdWRNh4FLk Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:48:11.335074 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6b94eaa25a6419d8b445a9a11a71e16", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}] Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cda5affea11b414e953a847d7fa8ae5e Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1220098401", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} Oct 19 00:48:11.337389 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1220098401', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452'}}} Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 00:48:11.338460 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:11.340055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.341683 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 19 00:48:11.343174 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:11.345193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:11.346269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f23e26f9-d541-46cc-9274-aa1df70875eb tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 9.433099 Oct 19 00:48:11.347356 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 506/1060] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:48:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 9435 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:48:11.362329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af5d33af0>, body: {"quota_set": {"instances": 10}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:11.615910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:11.632279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:11.640109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:11.656227 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f389626-17fc-4c31-8e1c-9a478839553e tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.488509 Oct 19 00:48:11.664774 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 555/1061] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:11 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:11.983542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.986666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.987431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:11.990290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:11.991590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:11.995724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.192000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b5c982c-c63e-439a-98c8-cbb90eeff6a8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 329 microversion: 2.1 time: 0.839818 Oct 19 00:48:12.196759 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 507/1062] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:48:11 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 329 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:12.211395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ba007be-e649-450b-ba2c-1f7719b841f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Calling method '.version_select at 0x7f2af9383ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:12.211669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:12.212034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:12.228519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.229748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.231904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.233339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.235811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.237720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.669398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ba007be-e649-450b-ba2c-1f7719b841f8 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 371 microversion: 2.1 time: 0.464121 Oct 19 00:48:12.671256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 508/1063] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:48:12 2022] GET /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 371 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:12.683871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af59b9790>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:12.700519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:12.717152 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77305f77-e980-41f3-bd9b-cd8a2a182249 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 0.510705 Oct 19 00:48:12.720319 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 556/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:12 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:12.725349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:12.726196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:12.732535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.736136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.737047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.738454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.750323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.751220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.838436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.841583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.843099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.846142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:12.847885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:12.848547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:12.939400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:12.956153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:12.961458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:12.996986 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-996ec532-3ad6-4eb9-8c36-231bcb256725 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.273993 Oct 19 00:48:13.000896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 557/1065] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:12 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:13.121765 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49c3a3dd-d22d-448d-8524-1cb14f088778 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 325 microversion: 2.1 time: 0.441708 Oct 19 00:48:13.133287 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 509/1066] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:48:12 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 325 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:13.508288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-668252904", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:13.653031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:13.745917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:13.751588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:13.776658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:13.778022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:13.781954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:13.783023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:13.783700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:13.784468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.266069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:15.337297 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f205a914-6d1f-48a9-a8dd-5085e6cbea44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1542 microversion: 2.1 time: 1.588363 Oct 19 00:48:15.371229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 510/1067] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:13 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1542 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:15.408705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:15.414493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:15.430922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.431818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.432641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:15.434572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:15.435645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:15.436807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.072454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:16.132542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:16.134910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:16.151061 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9518656-8f54-4c23-a181-7e925a00df8b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.778359 Oct 19 00:48:16.154139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 511/1068] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:15 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:16.238907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:16.239677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:16.240262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:16.241056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:16.241656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:16.272295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.272829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.273297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.276705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.279806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.280527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.334629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:16.352964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Getting quotas for user cda5affea11b414e953a847d7fa8ae5e and project c6b94eaa25a6419d8b445a9a11a71e16. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:16.382954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.utils [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] ram quota exceeded for c6b94eaa25a6419d8b445a9a11a71e16, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131449) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 19 00:48:16.384653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Request method failure captured: Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 144 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0k4R3kzvAL7Lt_OhqEqRgOBQnZfUVA7-2fHFPD6HaJw6ruWeECVucCND8FoKqG9Jx56SrMrwggf-MJHNutLkE0nETsSHYYYGWEZ29N9FMMXNGIRBdlyCKJOJSuuOi78bsaQDWdg8TfS5-FWDBezRhykKbcXteaF--GUijdWRNh4FLk Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:48:16.390716 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6b94eaa25a6419d8b445a9a11a71e16", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}] Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cda5affea11b414e953a847d7fa8ae5e Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-668252904", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} Oct 19 00:48:16.392523 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-668252904', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452'}}} Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 00:48:16.395091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:16.396401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.399255 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 19 00:48:16.402143 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.402897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:16.402897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:16.404839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:16.406890 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d45854bf-de11-4660-a285-090544236d3d tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 2.902325 Oct 19 00:48:16.408631 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 558/1069] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:48:13 2022] POST /compute/v2.1/servers => generated 110 bytes in 2906 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:48:16.409314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.409819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.410257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.410970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.420465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4f20280>, body: {"quota_set": {"ram": 51200}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:16.425844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.426468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.553953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.556911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.558030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.559956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:16.560890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:16.573851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:16.729959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20dbb62d-9b50-46ab-acd7-0a65ea46d255 tempest-QuotasAdminNegativeTest-1582857436 tempest-QuotasAdminNegativeTest-1582857436-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 200 len: 329 microversion: 2.1 time: 0.316814 Oct 19 00:48:16.736953 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 559/1070] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:48:16 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 329 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:16.751636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0fcc970-6990-4ec3-9894-53e4c066f780 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Action: 'update', calling method: .version_select at 0x7f2af4efe790>, body: {"quota_set": {"ram": 0}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:16.763832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0fcc970-6990-4ec3-9894-53e4c066f780 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cda5affea11b414e953a847d7fa8ae5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b94eaa25a6419d8b445a9a11a71e16', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0fcc970-6990-4ec3-9894-53e4c066f780 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Request method failure captured: Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 HTTP/1.1 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 25 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0k4R3kzvAL7Lt_OhqEqRgOBQnZfUVA7-2fHFPD6HaJw6ruWeECVucCND8FoKqG9Jx56SrMrwggf-MJHNutLkE0nETsSHYYYGWEZ29N9FMMXNGIRBdlyCKJOJSuuOi78bsaQDWdg8TfS5-FWDBezRhykKbcXteaF--GUijdWRNh4FLk Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:48:16.777611 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c6b94eaa25a6419d8b445a9a11a71e16", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c6b94eaa25a6419d8b445a9a11a71e16"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c6b94eaa25a6419d8b445a9a11a71e16"}]}] Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c6b94eaa25a6419d8b445a9a11a71e16 Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-122873562 Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cda5affea11b414e953a847d7fa8ae5e Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-QuotasAdminNegativeTest-122873562-project Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: {"quota_set": {"ram": 0}} Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 00:48:16.779343 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c6b94eaa25a6419d8b445a9a11a71e16', 'body': {'quota_set': {'ram': 0}}} Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:16.780401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.782371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 19 00:48:16.784187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:16.787466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0fcc970-6990-4ec3-9894-53e4c066f780 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:16.787466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0fcc970-6990-4ec3-9894-53e4c066f780 tempest-QuotasAdminNegativeTest-122873562 tempest-QuotasAdminNegativeTest-122873562-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16" status: 403 len: 116 microversion: 2.1 time: 0.040841 Oct 19 00:48:16.788675 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 560/1071] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:48:16 2022] PUT /compute/v2.1/os-quota-sets/c6b94eaa25a6419d8b445a9a11a71e16 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:17.189619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:17.190875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:17.214814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:17.217437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:17.217908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:17.219517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:17.222926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:17.226310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:17.671534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:17.712303 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49493355-b989-4b68-904a-88f6ba7043d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1541 microversion: 2.1 time: 1.305179 Oct 19 00:48:17.720153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 512/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:16 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1541 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:48:18.106582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-unplugged", "status": "completed", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:18.165407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:18.166360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:18.167405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:18.237561 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Creating event network-vif-unplugged:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h1-master-1 Oct 19 00:48:18.277408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:48:18.319999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:18.328598 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f45a95d7-e51f-4325-8cd0-d401871f5ef6 req-fea6409f-bd2a-4a1b-89d8-2bd936c7f3b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.226596 Oct 19 00:48:18.331803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:18.338408 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 513/1073] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:18.345010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:18.358207 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8403721f-7043-43db-8a8c-e77b1509ab69 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 1.175120 Oct 19 00:48:18.376500 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 561/1074] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:17 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:18.752403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:18.754835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:18.785670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:18.791012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:18.792160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:18.794947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:18.800327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:18.801719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.394707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:19.395910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:19.426247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.427256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.428518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.431668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:19.432589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:19.433743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:19.834406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:19.856946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:19.860669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:19.867508 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb91ca9b-bfdc-4e9c-858f-972aeeb1f025 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.477638 Oct 19 00:48:19.868413 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 562/1075] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:19 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:20.109915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:20.139139 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-958e52b3-67af-4e56-9d3e-fa1187f13511 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1541 microversion: 2.1 time: 1.387562 Oct 19 00:48:20.158668 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 514/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:18 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1541 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:20.812163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-969300962", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "82c7aa9d-4226-40d4-9740-5580292913bc"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:20.906991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:20.908320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:20.932593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:20.937748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:20.938643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:20.941095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:20.942604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:20.943796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:20.994150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] validate_networks() for [('82c7aa9d-4226-40d4-9740-5580292913bc', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:21.213172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:21.255887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:21.263255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:21.281998 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a888a37-6801-429a-a161-90c0d5726782 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.384775 Oct 19 00:48:21.291647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 515/1077] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:20 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:21.305773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:21.305773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:21.333583 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:21.341581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.342125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.344994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.346467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:21.346671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:21.349228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:21.990656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:22.007515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-259d6539-724b-4c53-b1d7-e01c0cbf7aa4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1541 microversion: 2.1 time: 0.713347 Oct 19 00:48:22.017694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 516/1078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:21 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1541 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:22.030694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-397233780", "imageRef": "2d6da1ea-d969-4501-9996-8cae26f75e95", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2115433f-09ed-4134-a186-bb9ed9973e89"}], "security_groups": [{"name": "tempest-securitygroup--1192524544"}], "key_name": "tempest-keypair-1515828034", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:22.357883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] validate_networks() for [('2115433f-09ed-4134-a186-bb9ed9973e89', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:22.450343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:22.451099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:22.451575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:22.452767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:22.454161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:22.476320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:22.476755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:22.477198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:22.477943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:22.491766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:22.492213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:22.555832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:22.566042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for user 5d0158da7efc485ebd6a1e1db617b5e7 and project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:22.597026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:48:22.599379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:48:22.710979 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c6e0f60-c618-4ce4-aa25-64c29d23db2a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.840614 Oct 19 00:48:22.721800 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 563/1079] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:48:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2843 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:48:22.721800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:22.721800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:22.724546 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:22.726294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:22.726843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:22.727236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:22.728113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:22.728530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:22.729100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:22.899101 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:22.964036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:22.977973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:22.981640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:22.998065 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0a565c9-15ed-4a39-b7a0-ef6a16a7f90f tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.284600 Oct 19 00:48:23.001231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 564/1080] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:22 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:23.013207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.013946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.094346 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=24 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:23.202250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.213765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.219841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.221291 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c808693-6051-4f38-b216-e82a2b0ec780 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1261 microversion: 2.25 time: 0.218987 Oct 19 00:48:23.223055 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 565/1081] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:23.241345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.241345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.251535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.253078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.253637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.257518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.258309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.258940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.279343 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:23.279872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:23.280596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:23.281207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:23.282063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:23.306298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.306839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.309778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.314587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.315133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.316568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.366024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Getting quotas for project bf3b8f8475874a7988dc35023a58d083. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:23.376817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Getting quotas for user 1e43026c56e0462b976a840266ea8acf and project bf3b8f8475874a7988dc35023a58d083. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:23.402302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:48:23.407545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d6da1ea-d969-4501-9996-8cae26f75e95',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:48:23.503088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.524839 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e88014c-acc1-48f9-9a61-5c59f0e6ebae tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1541 microversion: 2.1 time: 0.300491 Oct 19 00:48:23.528196 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 566/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1541 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:23.534780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:23.549747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:23.550544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:23.551469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:23.556841 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be2b3f1a-b4e1-4bf9-aa69-dd5736f9d1c8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.524160 Oct 19 00:48:23.558352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 517/1083] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:48:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:48:23.570460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a498cd18-e571-4da9-b452-3575b8c403ad tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:23.571441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a498cd18-e571-4da9-b452-3575b8c403ad tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:23.579728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Creating event network-changed:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h1-master-1 Oct 19 00:48:23.596386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:48:23.666413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dae56d73-dd72-4518-9768-b4eac5aef24a req-ffe41979-03e2-4926-bda3-4586251d0f97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136585 Oct 19 00:48:23.672106 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 567/1084] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:23.738597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a498cd18-e571-4da9-b452-3575b8c403ad tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:23.757888 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a498cd18-e571-4da9-b452-3575b8c403ad tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1245 microversion: 2.1 time: 0.191710 Oct 19 00:48:23.779458 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 518/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:23 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1245 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:24.033237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:24.033772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:24.069246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.069246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.069246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.070025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.073211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.077747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.250205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:24.251111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:24.267391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.268275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.274107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.275372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.276325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.277087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.289150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.300457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.310184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.324045 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f889300-0267-45d0-a041-1d97ca492181 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.296867 Oct 19 00:48:24.337600 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 568/1086] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:24 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:24.581569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.615794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.635676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:24.640537 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4617917d-9abf-4aac-8cd5-0f0962ee8b01 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1265 microversion: 2.25 time: 0.392580 Oct 19 00:48:24.663585 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 519/1087] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:24 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:48:24.682048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:24.686378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:24.710442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.711148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.711354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:24.711938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:24.712402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:24.712899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:25.206129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1718229646", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "71a16a2e-75bd-4080-b95d-7bbf65754e6a"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:25.372947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] validate_networks() for [('71a16a2e-75bd-4080-b95d-7bbf65754e6a', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:25.820809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:25.869199 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a5a553a-bc3f-4b12-9e13-3ae4422922ff tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1541 microversion: 2.1 time: 1.204247 Oct 19 00:48:25.870973 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 520/1088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:24 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1541 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:25.910552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:25.912989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:25.931236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:25.931734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:25.932190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:25.935708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:25.940738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:25.941793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.838430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:26.865083 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b63433ee-f059-47d9-bd86-d04f26f08b63 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1297 microversion: 2.1 time: 0.988799 Oct 19 00:48:26.870267 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 521/1089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:25 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1297 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:26.915730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:26.922539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:26.969082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.972607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.975922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:26.978695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:26.982073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:26.982867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:27.451180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.460204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.473011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.497718 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4bba4d2a-b34e-46a7-8e68-5cbe03737fc1 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1546 microversion: 2.91 time: 0.625445 Oct 19 00:48:27.512747 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 522/1090] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:26 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1546 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:27.518173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:27.522723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:27.549233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:27.550005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:27.550626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:27.560584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:27.561773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:27.562807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:27.886278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.896442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.914056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:27.915554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28f2fa48-cc7e-48a2-80d9-e35faf74b0cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1319 microversion: 2.25 time: 0.401604 Oct 19 00:48:27.916324 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 523/1091] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:27 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:28.225560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.229625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.232479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.233322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.236195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.236870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.243851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.313382 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15a494f6-1911-4398-ab0a-4b16aeec3baf tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.395673 Oct 19 00:48:28.314530 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 524/1092] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:27 2022] GET /compute/v2.1/os-services => generated 944 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:28.326755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.328133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:28.346872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.347648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.348219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.349187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.349778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.350422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.360963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:28.361510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:28.362252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:28.362913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:28.363442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:28.385349 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=53 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:28.387205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.387833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.388393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.389300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.390415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.390963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.442508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:28.458650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for user 2ab51886a81f4e1194e0c1ac50eef9d4 and project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:28.479022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:48:28.482088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:48:28.585518 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e099536a-4d3a-43a0-b637-b9789bc00fd3 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.102097 Oct 19 00:48:28.596025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 569/1093] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:48:28.601716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.602524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:28.640410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.641053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.643216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.646885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.647617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.648258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.731418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:28.757027 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78f8da04-a11e-4c91-acb2-2e09bda6f650 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1473 microversion: 2.1 time: 0.427639 Oct 19 00:48:28.763432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 525/1094] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1473 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:28.784271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.797236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.797688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.798153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.798994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.799435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.799866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.841978 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b023e239-26b2-4d9c-9c77-81dfe4ee6dcb tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.077224 Oct 19 00:48:28.843245 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 526/1095] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:28.853388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:28.859797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.861084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:28.868733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03c70ee2-8790-4e41-90fd-9a0170572127 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1303 microversion: 2.1 time: 0.271183 Oct 19 00:48:28.869702 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 570/1096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:28.875684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.876751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:28.876900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.877503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.878178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:28.879190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.879743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.880572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.903784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.906391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.907563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:28.908672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:28.910333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:28.911861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.130854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:29.152935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:29.157797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:29.179558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d76dd8d7-788d-4dcb-a906-556d4d0b5d48 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1533 microversion: 2.91 time: 0.334966 Oct 19 00:48:29.205432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 527/1097] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1533 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:29.219762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12c464bb-098e-4d53-8c57-0f949a24ff61 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:29.221274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12c464bb-098e-4d53-8c57-0f949a24ff61 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:29.408255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12c464bb-098e-4d53-8c57-0f949a24ff61 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:29.421280 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12c464bb-098e-4d53-8c57-0f949a24ff61 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1225 microversion: 2.1 time: 0.213011 Oct 19 00:48:29.430574 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 528/1098] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:29 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:29.462509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:29.467066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.476847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.478997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.486004 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-81581985-b775-4f83-b194-f7f307783f68 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1859 microversion: 2.1 time: 0.615203 Oct 19 00:48:29.494226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.495640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.499995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.500997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 571/1099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:28 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1859 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:29.518651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:29.519510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:29.542737 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:29.551799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.552337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.553008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.554364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.554870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.555313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.642524 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:29.650272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f35ffe4f-acfa-450b-9eaf-a6c5225f22b2 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.217021 Oct 19 00:48:29.652396 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 529/1100] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:29 2022] GET /compute/v2.1/os-services => generated 944 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:29.670449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:29.677281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:29.705043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.707175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.708129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.711609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:29.715156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:29.715884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:29.977965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] Lazy-loading 'services' on Instance uuid cc8705d2-ef97-4f0e-bb42-4feb4800bb76 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:30.064591 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-685a50f0-de1d-43e7-887f-3245e79b554a tempest-UnshelveToHostMultiNodesTest-380958647 tempest-UnshelveToHostMultiNodesTest-380958647-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1938 microversion: 2.91 time: 0.400981 Oct 19 00:48:30.073319 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 530/1101] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:29 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1938 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:30.089673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:30.110302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:30.131041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.134165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.145800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:30.153000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.154057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.155605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:30.390744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:30.407665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:30.421756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lazy-loading 'flavor' on Instance uuid 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:30.422568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:30.423811 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8ba27c0-d44c-4829-9c59-4ebb950f10c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 0.921548 Oct 19 00:48:30.424790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 572/1102] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:29 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:30.456426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:30.466818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Going to try to live migrate instance to n-h1-master-1 {{(pid=131450) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:48:30.477681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.478515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.479929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:30.483205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.490987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.492079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:30.608874 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f50a1583-7331-43d4-9336-e14b80b4e7a8 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.175839 Oct 19 00:48:30.610376 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 573/1103] 10.222.0.27 () {58 vars in 1194 bytes} [Wed Oct 19 00:48:30 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:48:30.619401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:30.620539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:30.641423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.642584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.643320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:30.644739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:30.645689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:30.646371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.460207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:31.469673 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32a61485-a32d-479c-8d48-4a0a4b1a6a52 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1470 microversion: 2.1 time: 0.857679 Oct 19 00:48:31.505887 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 574/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:30 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1470 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:31.529473 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:31.531560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:31.579549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.580153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.580728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.581597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.583068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.585168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.808288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:31.827714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-997ca3fc-429f-4ed9-af7f-bcb44c18a115 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1303 microversion: 2.1 time: 0.319527 Oct 19 00:48:31.829810 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 575/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:31 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:31.844108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:31.844108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:31.851951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.852740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.857712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.859527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:31.860194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:31.860841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:31.946920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:48:32.250521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fef0e1da-0344-4abf-9a57-3c1e8335ea6b tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 204 len: 0 microversion: 2.91 time: 0.417752 Oct 19 00:48:32.276057 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 576/1106] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:48:31 2022] DELETE /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:48:32.308277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:32.313303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:32.322067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.322637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.323094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.326432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.327607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.331099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.629564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:32.642488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3054f39-f5d9-4170-b121-b9abb0a7af2c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1283 microversion: 2.1 time: 0.363517 Oct 19 00:48:32.643355 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 577/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:32 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1283 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:32.664311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:32.668111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.668945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.669555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.670588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.671785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.672407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.703713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74646cf4-fb28-4c34-acde-051758ab0446 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.049715 Oct 19 00:48:32.708577 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 578/1108] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:32 2022] GET /compute/v2.1/os-services => generated 944 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:32.715424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:32.716324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:32.724655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.725449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.726073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:32.726983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:32.727621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:32.728236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:33.377679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:33.398217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:33.399697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:33.401103 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4428baee-0241-4f49-9126-68112bf47744 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 0.691153 Oct 19 00:48:33.402132 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 579/1109] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:32 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:33.408410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:33.412722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:33.442257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:33.443116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:33.443936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:33.445181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:33.445972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:33.446719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:33.533869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:33.534358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:33.534988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:33.535936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:33.536555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:33.537325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:33.600550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:33.611351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:34.059657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3978324-7a09-44b5-aa79-07dd30ce3fe7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7/action" status: 202 len: 0 microversion: 2.1 time: 0.655713 Oct 19 00:48:34.063685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 580/1110] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:48:33 2022] POST /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:34.078787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:34.097870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:34.136168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.137584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.143240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:34.144510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.145419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.146163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:34.708304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:34.745595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:34.750419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f399df50fd34de3b8d9c69d8461fc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5b69c18338643abba49d008af53c18e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:34.777727 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5fa1c135-3d7b-4102-aaf9-211f5ee68262 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 200 len: 1539 microversion: 2.91 time: 0.709033 Oct 19 00:48:34.779072 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 581/1111] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:34 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 1539 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:34.803182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:34.816896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.817854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.819762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:34.821489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.825282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.826300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:34.926642 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c34850de-ef36-4ecd-867b-538ce4ad7268 tempest-ServicesAdminNegativeTestJSON-632263323 tempest-ServicesAdminNegativeTestJSON-632263323-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.127383 Oct 19 00:48:34.927677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 582/1112] 10.222.0.27 () {58 vars in 1198 bytes} [Wed Oct 19 00:48:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:48:34.958040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:34.958684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:34.972246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.972877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.973408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:34.974257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:34.974879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:34.975345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:35.939397 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fc9c295-f2eb-429e-b485-336a1011c9b5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/action" status: 202 len: 0 microversion: 2.1 time: 5.863197 Oct 19 00:48:35.944453 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 531/1113] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:48:30 2022] POST /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/action => generated 0 bytes in 5866 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:35.966424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:35.973014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:35.975564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2ae38b2-8ca7-4ee3-9661-48f938cc97f2 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 1.042454 Oct 19 00:48:35.978510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:35.978718 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 583/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:34 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:35.988827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:35.993856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:35.994364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:35.995966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:35.997305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:35.999071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:36.000200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:36.001082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:36.036156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:36.037061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:36.037704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:36.038639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:36.041996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:36.057463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.654393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:37.668537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-912238d0-8429-4ac2-96e3-ac3cb45a554e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1469 microversion: 2.1 time: 1.688513 Oct 19 00:48:37.669212 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 584/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:35 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1469 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:37.678456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:37.684122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:37.705732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.707131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.707759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.708700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:37.709391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:37.710110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:37.931597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:37.951465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d178cf6-d2c7-4875-a49f-6845eec5f63e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1325 microversion: 2.1 time: 2.000935 Oct 19 00:48:37.955899 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 532/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:35 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1325 bytes in 2011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:37.969983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-plugged", "status": "completed", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:37.997997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.000269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.004695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.035958 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Creating event network-vif-plugged:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h1-master-1 Oct 19 00:48:38.056451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:48:38.093528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5f2e50fc-aa76-4f23-bd7c-0f095fce870d req-4b229fbf-eb09-4ef2-9846-f62b4ed73bd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134579 Oct 19 00:48:38.100278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 533/1117] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:38.413358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51ea5849-fd53-47d5-9b47-4c6220249def tempest-ServicesAdminNegativeTestJSON-121694903 tempest-ServicesAdminNegativeTestJSON-121694903-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:38.431499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51ea5849-fd53-47d5-9b47-4c6220249def tempest-ServicesAdminNegativeTestJSON-121694903 tempest-ServicesAdminNegativeTestJSON-121694903-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ff22e779b6ca4d6dbda4127579d0f656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81793aa60f054fd9a6d14301d3e76ced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51ea5849-fd53-47d5-9b47-4c6220249def tempest-ServicesAdminNegativeTestJSON-121694903 tempest-ServicesAdminNegativeTestJSON-121694903-project] Request method failure captured: Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lXWnwzwtqcPDEoiwIoMfKaKFomuscHPg_ZdHVe4_w1gGYN2A6vIN4s5hW3oVqtXJminRMRtNy0AmW2mmITSIl_kxIwwuOsbGRj5aisCqxhkXfzJUQNrsuM4fefKBl1vw_HmV6J7-VTYn162SIk-FKC6K1BNIG0TrVY2MEJVaiJQA4 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 81793aa60f054fd9a6d14301d3e76ced Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-121694903 Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:48:38.443484 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81793aa60f054fd9a6d14301d3e76ced", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81793aa60f054fd9a6d14301d3e76ced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81793aa60f054fd9a6d14301d3e76ced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81793aa60f054fd9a6d14301d3e76ced"}]}] Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-121694903 Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 81793aa60f054fd9a6d14301d3e76ced Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-121694903 Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServicesAdminNegativeTestJSON-121694903-project Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ff22e779b6ca4d6dbda4127579d0f656 Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-121694903-project Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:48:38.445216 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:48:38.446290 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:48:38.447781 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.449486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51ea5849-fd53-47d5-9b47-4c6220249def tempest-ServicesAdminNegativeTestJSON-121694903 tempest-ServicesAdminNegativeTestJSON-121694903-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:38.449486 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51ea5849-fd53-47d5-9b47-4c6220249def tempest-ServicesAdminNegativeTestJSON-121694903 tempest-ServicesAdminNegativeTestJSON-121694903-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.343806 Oct 19 00:48:38.463626 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 534/1118] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:38 2022] GET /compute/v2.1/os-services => generated 112 bytes in 362 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:48:38.470632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:38.471843 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:38.476197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] [instance: cc8705d2-ef97-4f0e-bb42-4feb4800bb76] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:38.496866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.500566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.501277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.502433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.504188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.505174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.558106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] HTTP exception thrown: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Request method failure captured: Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 HTTP/1.1 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0iNo5PTSsOTMSL6MOAc87x0BeLbVtSXg3rhnJLNcdo5BMEOw7oLSSmqtFDnS7mC_MK5oW3FHFw-MYwotJJeuXrHx0SajYFXM0CY_Q2meXim4TACw9sw1BU4TH8RU3DlAFiV-rN_clhvmY75Y5UV6JDs6SJXj8fHTq_UW7pa4CICIaA Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.91 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c5b69c18338643abba49d008af53c18e Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-515118071 Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:48:38.566072 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c5b69c18338643abba49d008af53c18e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5b69c18338643abba49d008af53c18e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c5b69c18338643abba49d008af53c18e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5b69c18338643abba49d008af53c18e"}]}] Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-515118071 Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c5b69c18338643abba49d008af53c18e Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-515118071 Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-UnshelveToHostMultiNodesTest-515118071-project Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f399df50fd34de3b8d9c69d8461fc13 Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-515118071-project Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: exception: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. Oct 19 00:48:38.569075 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'cc8705d2-ef97-4f0e-bb42-4feb4800bb76'} Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:38.570703 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. Oct 19 00:48:38.572765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:48:38.575168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] Returning 404 to user: Instance cc8705d2-ef97-4f0e-bb42-4feb4800bb76 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:38.585991 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15fa6508-486d-411b-bde6-3030b45e4f62 tempest-UnshelveToHostMultiNodesTest-515118071 tempest-UnshelveToHostMultiNodesTest-515118071-project] 10.222.0.27 "GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76" status: 404 len: 111 microversion: 2.91 time: 0.120282 Oct 19 00:48:38.588254 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 535/1119] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:38 2022] GET /compute/v2.1/servers/cc8705d2-ef97-4f0e-bb42-4feb4800bb76 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:48:38.595360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b94506-e150-46f4-a7a3-b340d0ccb6d0", "tag": "ab9bd828-572a-4f51-b2af-60a415f3fd21"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:38.608457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:38.627308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.629797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.630720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.655099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:38.659865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:38.666387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd23efdf-3268-486e-8774-56558382ae77 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 0.990049 Oct 19 00:48:38.689899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 585/1120] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:37 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:38.691350 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] Creating event network-changed:ab9bd828-572a-4f51-b2af-60a415f3fd21 for instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 on n-h1-master-1 Oct 19 00:48:38.703257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3c838a06-2e17-4635-9c64-bbb38ec3a9d0 req-faf754bc-02fa-48a4-a5d1-1f314e18873d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112931 Oct 19 00:48:38.712165 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 536/1121] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:38.714332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:38.715926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:38.737946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.740935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.742220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.743867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.746519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:38.747591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.748158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.750187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:38.785838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.787389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.788471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.791326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:38.792262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:38.793706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:38.848382 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.374682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:39.387024 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-105ba24a-289d-4be3-b030-44a03c619bb9 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.689806 Oct 19 00:48:39.394204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:39.401987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 586/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:38 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:39.409688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:39.411358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:39.412309 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d874a43a-ccd2-4af3-9da4-1ad445516449 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.697889 Oct 19 00:48:39.418422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.418917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.419357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.420238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.420740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.421412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.425171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 537/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:38 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:39.433862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98cca62-8e30-4c84-a431-4a0c1138ac18", "tag": "edda9ea9-a567-4cff-a6fb-0fb7e578d1bc"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:39.440402 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.447312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.448477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.449222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.462673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] Creating event network-changed:edda9ea9-a567-4cff-a6fb-0fb7e578d1bc for instance c98cca62-8e30-4c84-a431-4a0c1138ac18 on n-h1-master-1 Oct 19 00:48:39.468992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5ca022d7-6cd0-46bf-9036-27e81c23f75a req-adca0f94-86fe-4a2f-b88d-bda4388a34ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042389 Oct 19 00:48:39.470119 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 538/1124] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:39.476659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:39.477687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:39.484578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.485459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.486309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.487273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:39.487968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:39.488671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:39.539890 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:39.901870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:39.911100 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54538020-a506-4352-8d65-5622bf1aa45b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1469 microversion: 2.1 time: 0.507119 Oct 19 00:48:39.941756 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 587/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:39 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1469 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:39.959572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:39.970492 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d9030bf-ca2a-40c2-8eef-c434579767bb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1325 microversion: 2.1 time: 0.498872 Oct 19 00:48:39.981020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:39.982087 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 539/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:39 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:39.994581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:40.026392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:40.036420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:40.038084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:40.040491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:40.041162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:40.041703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:40.554154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8db3036-34f8-4ebe-aa41-bd5d4e222502 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Action: 'create', calling method: .version_select at 0x7f2af93aaf70>, body: {"pool": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:41.027393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:41.039116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:41.040940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:41.042422 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4f1c9f4-01d8-4f83-a4e6-89541b2f96d0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 1.099203 Oct 19 00:48:41.060728 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 588/1127] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:39 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:41.060728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:41.060728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:41.070114 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:41.078324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.079711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.080736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:41.082097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.083357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.084397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:41.556655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:41.571104 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e75ae05b-dc44-4bb9-9960-8a3206f995c6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.520862 Oct 19 00:48:41.572336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 589/1128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:41 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:41.579524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:41.580506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:41.610601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.611101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.611551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:41.612277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:41.612772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:41.613335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.129106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:42.150223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-70bc37f0-f031-43c4-94b0-660ea2e2481c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.575456 Oct 19 00:48:42.151290 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 590/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:41 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:42.181802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:42.184107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:42.200747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.208574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.209895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.211606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.214294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.216597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.925827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:42.935317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f8ac101-1ed8-4972-a10a-2177e02fd673 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1469 microversion: 2.1 time: 0.782123 Oct 19 00:48:42.941112 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 591/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:42 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1469 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:42.956809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:42.958158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:42.973826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.974540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.975062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:42.976506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:42.977342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:42.978132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:43.886575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:43.901335 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-05e0a361-cc5f-400e-8852-e5f59e6d0fdc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1325 microversion: 2.1 time: 0.958858 Oct 19 00:48:43.903185 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 592/1131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:42 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1325 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:43.908267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca86d4f0-73e6-407c-b6a9-3b7f3048f09a", "tag": "f5f41137-1106-4da0-8e1e-06fe00f1c387"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:43.933040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:43.933164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:43.933585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:43.970826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] Creating event network-changed:f5f41137-1106-4da0-8e1e-06fe00f1c387 for instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a on n-h2-master-1 Oct 19 00:48:43.987349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-21ac4db8-66a6-4f67-88c2-4b90593bf011 req-b1412c23-676c-40a1-a6e3-a947d9007678 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082636 Oct 19 00:48:43.987982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 593/1132] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:43.994501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:43.995717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:44.016246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.017528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.018196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.019155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.019811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.024843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.792463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:44.805140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:44.806602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:44.814262 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c77aa05-1631-4fb3-8569-1005751cc8ed tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 0.824844 Oct 19 00:48:44.814871 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 594/1133] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:43 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:44.829364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:44.830000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:44.847577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.848170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.848656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.849411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:44.853335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:44.854102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:44.866808 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=17 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:45.989553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:45.999507 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ba4158cd-8695-4ff7-aeaf-217aa978398b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 1.183558 Oct 19 00:48:46.003146 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 595/1134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:44 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.008499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.009410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.028489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.032865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.034341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.036101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.037334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.038424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.240437 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8db3036-34f8-4ebe-aa41-bd5d4e222502 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.032539 Oct 19 00:48:46.241797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 540/1135] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:48:40 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:46.247153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.248198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.256160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.257825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.258545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.259819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.260536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.261234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.407461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.416157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f798953f-a7e2-4fdc-ac71-bc1e9c66b5f8 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.411533 Oct 19 00:48:46.417492 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 596/1136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.423273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b94506-e150-46f4-a7a3-b340d0ccb6d0", "name": "network-vif-plugged", "status": "completed", "tag": "ab9bd828-572a-4f51-b2af-60a415f3fd21"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:46.438684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.439402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.440361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.455961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] Creating event network-vif-plugged:ab9bd828-572a-4f51-b2af-60a415f3fd21 for instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 on n-h1-master-1 Oct 19 00:48:46.463579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-aefea001-78e5-4746-a64d-8d6bd4522a32 req-f33cbb1b-2c96-4359-b83d-d71e33659d84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043394 Oct 19 00:48:46.465292 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 597/1137] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:46.477022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.478398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.488065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.488944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.489642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.491288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.491992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.493691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.560026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.577739 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c8954bd-e1a0-4ac0-906a-a44b21727d80 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1469 microversion: 2.1 time: 0.334035 Oct 19 00:48:46.578442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 541/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1469 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.711917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.725257 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5080c85-3e41-4db0-a15f-7b97119d5720 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1325 microversion: 2.1 time: 0.255800 Oct 19 00:48:46.726166 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 598/1139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1325 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:46.731755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.732656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:46.741439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.742271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.742967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.743904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:46.744538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:46.745207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:46.931986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.940993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.943795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:46.945330 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef5ff0da-39b2-49bb-97bf-2342af17cde8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1361 microversion: 2.25 time: 0.217734 Oct 19 00:48:46.949157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 599/1140] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:46.955165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26120ea4-b288-48f0-965b-7d227dccfc87 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af4f1d3a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:46.999674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Calling method '.version_select at 0x7f2af9332550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.011107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.011591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.012037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.012798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.013231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.013863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.034862 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97ad8af2-b92d-4d2e-8455-5d202caa23b1 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.438274 Oct 19 00:48:47.035465 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 542/1141] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/limits => generated 511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:47.199402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.206882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.219044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.219861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.224127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.224950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.225593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.295832 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d5c3a3d-0153-4b43-8ea8-312b70713285 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.258317 Oct 19 00:48:47.305789 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 543/1142] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/os-services => generated 944 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:47.306144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26120ea4-b288-48f0-965b-7d227dccfc87 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/b44da087-0b6a-4568-bedc-fe21e48ac3aa" status: 200 len: 141 microversion: 2.1 time: 0.355489 Oct 19 00:48:47.314628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 600/1143] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:48:46 2022] GET /compute/v2.1/os-floating-ips/b44da087-0b6a-4568-bedc-fe21e48ac3aa => generated 141 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:47.314853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.314970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-225443127", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:47.315486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:47.321807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.322694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.323141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.324117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.324854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.325833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.412946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:47.706090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:47.735798 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e95475f-cae6-4c97-a034-85d1d0022bc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.423590 Oct 19 00:48:47.736435 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 544/1144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:47.765818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.769603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.770095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.770531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.771259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:47.771713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:47.772144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:47.833403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d98cdeaf-8834-4fb8-bbd1-99795da5f483 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1" status: 200 len: 578 microversion: 2.1 time: 0.083350 Oct 19 00:48:47.834326 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 545/1145] 10.222.0.27 () {58 vars in 1172 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/os-services?host=n-d-master-1 => generated 578 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:47.839015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbc1daa6-1d69-4501-a362-3beaff3f48d0 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af93aa4c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.905101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Getting quotas for project 80bb1917c24c4b2691adcbcc01f01e46. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:47.919238 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Getting quotas for user d5a12c60c8de4fb681d464a23b06697c and project 80bb1917c24c4b2691adcbcc01f01e46. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:47.952951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Request method failure captured: Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 1751 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ltLCAYCxlPHrmCCRWj8XtUFIIbdX7Z11Qs1D3M6IEp-ZY04teY-Las3bgYXRAFh4-hNA3PFnYCTJh_0xCbTyu1sfidaW3tvldPr2AyCRodze7kavCi0cAZr4o4vrgFIAL21-jFstIukMjNVd8VSECscm4BXXf9hrLLx9zk9Fih6GI Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 80bb1917c24c4b2691adcbcc01f01e46 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-301999611 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80bb1917c24c4b2691adcbcc01f01e46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80bb1917c24c4b2691adcbcc01f01e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80bb1917c24c4b2691adcbcc01f01e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80bb1917c24c4b2691adcbcc01f01e46"}]}] Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-301999611 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 80bb1917c24c4b2691adcbcc01f01e46 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-301999611 Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-301999611-project Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d5a12c60c8de4fb681d464a23b06697c Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-301999611-project Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-225443127", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:48:47.962086 n-d-master-1 devstack@n-api.service[131449]: exception: Maximum number of metadata items exceeds 128 Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-225443127', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:47.965021 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:47.970648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:47.973783 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-033f3d49-dae4-4665-90e9-429d3ade08c0 tempest-AbsoluteLimitsNegativeTestJSON-301999611 tempest-AbsoluteLimitsNegativeTestJSON-301999611-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.665080 Oct 19 00:48:47.976802 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 601/1146] 10.222.0.27 () {60 vars in 1148 bytes} [Wed Oct 19 00:48:47 2022] POST /compute/v2.1/servers => generated 87 bytes in 669 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:48:47.988956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:47.995746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.010659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.012203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.012763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.018330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.018917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.019456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.352233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:48.363140 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-99fda3ae-15fb-4bcd-b45b-a68404c21b96 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.384921 Oct 19 00:48:48.365623 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 602/1147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:48.388026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:48.389205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:48.406519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.407018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.407456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:48.408175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:48.408649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:48.409080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.147180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:49.160418 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95fe1bba-d2b8-476a-aa6a-fae299f720c1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1535 microversion: 2.1 time: 0.782043 Oct 19 00:48:49.173513 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 603/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:48 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1535 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:49.193224 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cbc1daa6-1d69-4501-a362-3beaff3f48d0 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 1.357588 Oct 19 00:48:49.194074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:49.194798 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 546/1149] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:48:47 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:49.199996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:49.206912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:49.214487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.215003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.215464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.216217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.217360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.217809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.234626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.236988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.237737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.238694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.240846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.241604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.270103 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:49.283888 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e3d46fa-5346-4206-a947-de8dfc509ef7 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.087577 Oct 19 00:48:49.295364 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 547/1150] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:48:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:49.302307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:49.303188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:49.312050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.312983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.313766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:49.314733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:49.316106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:49.316865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.184152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:50.199381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d7048f3-475e-4513-bdea-c864e1acbe54 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1325 microversion: 2.1 time: 1.024593 Oct 19 00:48:50.213827 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 604/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:49 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1325 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:50.225488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca86d4f0-73e6-407c-b6a9-3b7f3048f09a", "name": "network-vif-plugged", "status": "completed", "tag": "f5f41137-1106-4da0-8e1e-06fe00f1c387"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:50.239341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.240206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.240917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.257021 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] Creating event network-vif-plugged:f5f41137-1106-4da0-8e1e-06fe00f1c387 for instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a on n-h2-master-1 Oct 19 00:48:50.280191 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2af4f1e6-aea7-4a1a-9bb4-f67ce3eec326 req-f09f6248-78d4-4fba-8053-d7fc5c884f27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062220 Oct 19 00:48:50.283580 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 605/1152] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:50.288902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:50.297617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:50.299075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:50.300276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e9138c8-4ce5-42eb-94cc-c3eb8709547c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1558 microversion: 2.25 time: 1.003291 Oct 19 00:48:50.306852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:50.307758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:50.321419 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 548/1153] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:49 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1558 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:50.327286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83e391c2-e18e-4772-a2ad-c76c5dc6e596 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af4faf940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:50.330808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.331620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.332283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.333273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.333959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.334597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.732129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:50.741749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-740b5422-c7be-47af-92dc-938d6a62bddf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.456773 Oct 19 00:48:50.753066 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 606/1154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:50 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:50.766919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:50.777953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.781035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.789656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.791369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.792360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.794158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.820691 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:50.852046 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-270083fc-e117-4bee-b7c8-4977c42183c0 tempest-ServicesAdminTestJSON-1105366188 tempest-ServicesAdminTestJSON-1105366188-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.107543 Oct 19 00:48:50.852999 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 607/1155] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:48:50 2022] GET /compute/v2.1/os-services => generated 944 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:50.859112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:50.861608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:50.872225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.873725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.874556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:50.875531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:50.876208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:50.876882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.358621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:51.375751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-078293d8-76c7-413f-a72a-508320144801 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.520491 Oct 19 00:48:51.377179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 608/1156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:50 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:51.383463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-unplugged", "status": "completed", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:51.398894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.399388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.399832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.414794 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Creating event network-vif-unplugged:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:48:51.423007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:48:51.436746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f50daef7-0eed-4af3-a601-ab840fc77aec req-61031e81-7dce-4388-bcdf-bebea8975b56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058042 Oct 19 00:48:51.437696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 609/1157] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:51.443351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:51.444063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:51.453532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.454330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.455165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.456074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:51.456889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:51.457513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:51.935219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:51.944655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8633950d-03e1-4b77-9b4c-ca75f2d8bc66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1535 microversion: 2.1 time: 0.505524 Oct 19 00:48:51.949495 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 610/1158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:51 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1535 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:52.335449 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83e391c2-e18e-4772-a2ad-c76c5dc6e596 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b44da087-0b6a-4568-bedc-fe21e48ac3aa" status: 202 len: 0 microversion: 2.1 time: 2.012777 Oct 19 00:48:52.337435 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 549/1159] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:48:50 2022] DELETE /compute/v2.1/os-floating-ips/b44da087-0b6a-4568-bedc-fe21e48ac3aa => generated 0 bytes in 2015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:52.343565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:52.344194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:52.346057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:52.349525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:52.358797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.360181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.360720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.361163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.361812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.362435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.362611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.363229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.363913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.364286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.364839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.365651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.704584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:52.712902 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5c3fb7a-e8cb-4053-9f34-c9f12a4c5735 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.374054 Oct 19 00:48:52.713568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 550/1160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:52 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:52.733051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:52.734397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:52.740432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid e2b94506-e150-46f4-a7a3-b340d0ccb6d0 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:52.741640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.742145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.742593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.743314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.743777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.744212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.757244 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3be3dbcb-7e3b-4e81-9252-5e954d1400af tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 2050 microversion: 2.25 time: 0.805508 Oct 19 00:48:52.757855 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 611/1161] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:51 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 2050 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:52.783579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98cca62-8e30-4c84-a431-4a0c1138ac18", "name": "network-vif-plugged", "status": "completed", "tag": "edda9ea9-a567-4cff-a6fb-0fb7e578d1bc"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:52.795391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:52.796108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:52.796702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:52.808912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] Creating event network-vif-plugged:edda9ea9-a567-4cff-a6fb-0fb7e578d1bc for instance c98cca62-8e30-4c84-a431-4a0c1138ac18 on n-h1-master-1 Oct 19 00:48:52.815035 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2813ccb4-f2b6-4c73-bec5-4aec69465b0a req-acd3deff-275d-4505-af5e-975848f71bd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044537 Oct 19 00:48:52.816920 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 612/1162] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:52.828197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d852ac22-9daf-4400-82ad-0b685cff53d7 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Action: 'create', calling method: .version_select at 0x7f2af5023160>, body: {"pool": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:53.009055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:53.020354 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff9c7b32-269a-472d-97d6-4b3650429817 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.305494 Oct 19 00:48:53.026404 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 551/1163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:52 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:53.054282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.055212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:53.069144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.072936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.073594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.077029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.079725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.080321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.389935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:53.411222 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-043ee560-2d3f-4f45-b530-b9079b4eb356 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1371 microversion: 2.1 time: 0.378211 Oct 19 00:48:53.414110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 552/1164] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:53 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:53.420941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.421933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:53.453312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.454212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.455012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.456289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.457467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.458609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.523096 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:53.814398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:53.824576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-671c7f92-b2be-43a8-8640-793a9d587b3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.408469 Oct 19 00:48:53.842657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 553/1165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:53 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:53.866681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:53.867686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:53.876130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.876961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.877625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:53.878543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:53.879179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:53.880396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:54.319890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid e2b94506-e150-46f4-a7a3-b340d0ccb6d0 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:54.350995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c863e906-4635-45fa-a4b9-94120fc04930 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 2050 microversion: 2.25 time: 0.506847 Oct 19 00:48:54.359286 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 554/1166] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:48:53 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 2050 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:48:54.364487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:54.365348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:54.378212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:54.380549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:54.381270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:54.382167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:54.382789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:54.383795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.063458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:55.076852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c1c4ac5a-6dde-41b8-98bf-eef4efa0dd5a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1535 microversion: 2.1 time: 0.715535 Oct 19 00:48:55.077463 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 555/1167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:54 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1535 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:55.088987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:55.111795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.112285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.112759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.141880 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] Creating event network-changed:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:48:55.159239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d852ac22-9daf-4400-82ad-0b685cff53d7 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.338928 Oct 19 00:48:55.160021 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 613/1168] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:48:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:55.161660 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b9a1135c-c990-4e51-9c00-6ecdc5458730 req-7f1a5003-b223-4f22-a812-214b4bbf9700 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082921 Oct 19 00:48:55.162695 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 556/1169] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:55.168128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.168882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:55.180434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.181317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.181987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.182742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.183211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.183644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.195590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be13b9ff-77e5-49fa-a3cd-8b469102c57e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-682702747", "metadata": {"": ""}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be13b9ff-77e5-49fa-a3cd-8b469102c57e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action HTTP/1.1 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 106 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-682702747", "metadata": {"": ""}}} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-682702747', 'metadata': {'': ''}}}} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'': ''} Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:48:55.211208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be13b9ff-77e5-49fa-a3cd-8b469102c57e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be13b9ff-77e5-49fa-a3cd-8b469102c57e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action" status: 400 len: 170 microversion: 2.1 time: 0.049133 Oct 19 00:48:55.215620 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 614/1170] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Oct 19 00:48:55 2022] POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action => generated 170 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:48:55.245350 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.252292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.253083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.253758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.254910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.255653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.266909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.299658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8192afc7-7ce8-47a5-8e08-15e7d008e646 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078230 Oct 19 00:48:55.300302 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 615/1171] 10.222.0.27 () {60 vars in 1217 bytes} [Wed Oct 19 00:48:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:48:55.511039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1859425688", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:55.567274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:55.576984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24b179ca-6f36-4ca1-9250-df20e6962729 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.412888 Oct 19 00:48:55.577578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 557/1172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:55 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:55.582699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:48:55.597287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:55.598103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:55.605243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.606308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.607482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.609023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:55.609730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:55.610619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:55.993218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:56.012514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e01cfd6f-c4f5-4e74-8b3f-17ae62bc55ab tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1557 microversion: 2.1 time: 0.430850 Oct 19 00:48:56.015340 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 558/1173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:55 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1557 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:56.026747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08b098bd-e341-4d97-86e1-8f07c58d3058 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af9383ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.145274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:48:56.147917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:48:56.149385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:48:56.150515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:48:56.151664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:48:56.179972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.180742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.186199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.186199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.186199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.186199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.213426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Getting quotas for project 8d60a9bdaee646508bf9f42d390191d3. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:48:56.223326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Getting quotas for user 2a896789dc814debba3a0a8f8f0c8943 and project 8d60a9bdaee646508bf9f42d390191d3. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:48:56.252130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:48:56.256308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:48:56.347156 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd3490b8-4660-48c5-b102-5342fa94ba1e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045420 Oct 19 00:48:56.361915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 616/1174] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:48:56.367208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:56.384583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:56.396460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.397111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.397655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.398603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:56.399195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:56.399763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:56.955528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:56.971549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e255128c-0fdc-4c06-8a7b-f1c8a3dc6fb2 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.603975 Oct 19 00:48:56.973244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 617/1175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:56 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:56.989243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:48:57.004516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:57.010121 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:57.026391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.029434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.032177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.035222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.036700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.037316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.118141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'flavor' on Instance uuid e2b94506-e150-46f4-a7a3-b340d0ccb6d0 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:48:57.168541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Going to try to live migrate instance to n-h2-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:48:57.733895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08b098bd-e341-4d97-86e1-8f07c58d3058 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9" status: 202 len: 0 microversion: 2.1 time: 1.716996 Oct 19 00:48:57.735079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 559/1176] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:48:56 2022] DELETE /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 => generated 0 bytes in 1719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:48:57.741318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:57.741829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:57.756796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.757706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.758317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.760640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.761155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.761600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.932643 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d5fcc0f-cd0e-46ab-9ecf-a4b65f32a7fb tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195937 Oct 19 00:48:57.934278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 560/1177] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:48:57 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-interface => generated 284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:48:57.943516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:57.944508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:57.973442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.974348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.975043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:57.975964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:57.976605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:57.977428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.317292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:58.327586 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66814238-c71b-40ef-a3fa-11867bd015e2 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1528 microversion: 2.1 time: 0.390743 Oct 19 00:48:58.339326 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 561/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:57 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1528 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:58.351953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:58.353580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:58.365561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.366389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.367015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.368016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.368707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.369378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.453062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:58.463499 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-702ba906-0ee1-49d6-a518-348af2e4d8cb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1269 microversion: 2.1 time: 0.120419 Oct 19 00:48:58.480070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 562/1179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:58 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:58.480070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:58.480070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:58.489875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.490422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.491008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.492767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.493341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.494128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.809478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:58.823325 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-775faa83-7e5c-4eca-971f-54034f8ecf85 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.357229 Oct 19 00:48:58.832696 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 563/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:58 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:58.834865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:58.835496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:48:58.848506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.849028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.857874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:58.858998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:48:58.859662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:48:58.860335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:48:59.249690 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:48:59.676288 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2619e33d-d0d1-4cfd-916f-db47247f332b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0/action" status: 202 len: 0 microversion: 2.25 time: 2.700855 Oct 19 00:48:59.680306 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 618/1181] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:48:56 2022] POST /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0/action => generated 0 bytes in 2703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:48:59.685663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af4e70ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:48:59.805448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:48:59.817135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc97dab3-aa2b-4d70-84a9-bb38728f4491 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.989839 Oct 19 00:48:59.817864 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 564/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:48:58 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:48:59.928701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-482cf729-f2d3-4c63-bc93-bdb4c99a41fa tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4f7b550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1584885286", "description": "tempest-description-811839959"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:00.138861 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 could not be found", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:49:00.141594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] HTTP exception thrown: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Request method failure captured: Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 HTTP/1.1 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lo1J8e48H_zD8ddXOb0hQYtLdmYX2t0gUzNF9ocrAlAyuMHGyEhX3qhtfjRY-SnBD-7MbfLshD8MfDdAwgjaW03mDch4C3Q9yHksRXFeJXHr4V5hbbhHYZO8nD65ik-hcYKVur6wPGwNCkyMHjgSKb1FhfKOwywK9Cf3MWsuxx3RE Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 924c4188dbcd4bcbb4cc76aed769c0c1 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_924c4188dbcd4bcbb4cc76aed769c0c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/924c4188dbcd4bcbb4cc76aed769c0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/924c4188dbcd4bcbb4cc76aed769c0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/924c4188dbcd4bcbb4cc76aed769c0c1"}]}] Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 924c4188dbcd4bcbb4cc76aed769c0c1 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsTestJSON-634230694-project Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 80f50eb98d76433eacaa60c62d94ad69 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsTestJSON-634230694-project Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: exception: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '65ceadac-a8da-4aeb-97a6-0fb3cccc89a9'} Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 could not be found Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-517529a6-6315-45a4-9556-a100072095f4'] Oct 19 00:49:00.149727 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9. Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:00.158904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:00.166805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Returning 404 to user: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:00.168909 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9d35b46-d0eb-41e7-860f-91345821f569 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9" status: 404 len: 111 microversion: 2.1 time: 0.489807 Oct 19 00:49:00.172182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 619/1183] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:48:59 2022] GET /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 => generated 111 bytes in 494 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:00.184243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:00.186289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:00.194611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.195234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.195771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.196650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.197399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.198056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.683806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:00.693147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d54612d1-9f25-4f85-8b70-dcadbf85108a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1528 microversion: 2.1 time: 0.518182 Oct 19 00:49:00.693963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 620/1184] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:00 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1528 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:00.699490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-plugged", "status": "completed", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:00.711937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.712771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.713706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.726933 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] Creating event network-vif-plugged:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:49:00.733023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1b649704-508c-4056-97b0-f433a8bbf647 req-c723ed0b-e4b8-40ba-a6ef-e62c416c756c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037394 Oct 19 00:49:00.734254 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 621/1185] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:00.740403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:00.741705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:00.752888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.753392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.754165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.755534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.756326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.757066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.813407 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-482cf729-f2d3-4c63-bc93-bdb4c99a41fa tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.978481 Oct 19 00:49:00.814588 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 565/1186] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:48:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:00.830249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:00.832640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:00.845767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.846482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.846992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.847785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:00.848251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:00.848711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:00.973030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:00.988698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f99466ae-cc3b-4e3c-a024-c0890ebe225a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1275 microversion: 2.1 time: 0.252193 Oct 19 00:49:00.989863 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 622/1187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:00 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:00.999006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f25eb072-cf6d-4955-a0d3-0983dd2ab565 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-900412053", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f25eb072-cf6d-4955-a0d3-0983dd2ab565 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action HTTP/1.1 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 618 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-900412053", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-900412053', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:49:01.006132 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 00:49:01.009077 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.014552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f25eb072-cf6d-4955-a0d3-0983dd2ab565 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:01.016328 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f25eb072-cf6d-4955-a0d3-0983dd2ab565 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action" status: 400 len: 938 microversion: 2.1 time: 0.024585 Oct 19 00:49:01.024955 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 623/1188] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Oct 19 00:49:00 2022] POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:01.031691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:01.033683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:01.042314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.043159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.043806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.046743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.047559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.048526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.576517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:01.595266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:01.599862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:01.605258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:01.610643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bae73ee4-88f7-4e84-8aef-a851055de119 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.578736 Oct 19 00:49:01.610970 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b71ee51-46c1-4e95-bacb-0ffcd554ffb7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1568 microversion: 2.25 time: 0.781230 Oct 19 00:49:01.611790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 624/1189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:01 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:01.622190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Calling method '.version_select at 0x7f2af508aca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:01.627030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 566/1190] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:00 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1568 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:01.662762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44c7c446-e11e-4a42-bab2-1b53b3297362 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:01.681225 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-44c7c446-e11e-4a42-bab2-1b53b3297362 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] HTTP exception thrown: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44c7c446-e11e-4a42-bab2-1b53b3297362 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Request method failure captured: Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/flavors/2a5d21cb-5608-497f-9479-7e2368bb183b HTTP/1.1 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0hgikZFeUgoqUlOvb9_qBqJ6MHljGW4eUiwVlrmr-py0lIk3DgAiR2kH9f8LP_U7j2C8qRNRSPs0M4VTCaUraepMS3LMkVmnkoWNannCWnC2VUPZaD3pWdZVh7s3i6uq6pkVkdWPFGSAeZrJ3fFgJrZYT_ipvZG6RibaTzSFu7WUKM Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5f2fec863e8446128e270320b0ef204d Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MigrationsAdminTest-2074028690 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5f2fec863e8446128e270320b0ef204d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f2fec863e8446128e270320b0ef204d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5f2fec863e8446128e270320b0ef204d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5f2fec863e8446128e270320b0ef204d"}]}] Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MigrationsAdminTest-2074028690 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5f2fec863e8446128e270320b0ef204d Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MigrationsAdminTest-2074028690 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MigrationsAdminTest-2074028690-project-admin Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 886050a9ea1a46428ee4927b2e5fdbe7 Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MigrationsAdminTest-2074028690-project-admin Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: exception: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2a5d21cb-5608-497f-9479-7e2368bb183b'} Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.688573 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44c7c446-e11e-4a42-bab2-1b53b3297362 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Returning 404 to user: Flavor 2a5d21cb-5608-497f-9479-7e2368bb183b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:01.693976 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44c7c446-e11e-4a42-bab2-1b53b3297362 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2a5d21cb-5608-497f-9479-7e2368bb183b" status: 404 len: 109 microversion: 2.1 time: 0.062522 Oct 19 00:49:01.706836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 567/1191] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:49:01 2022] DELETE /compute/v2.1/flavors/2a5d21cb-5608-497f-9479-7e2368bb183b => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:01.713522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "name": "network-vif-unplugged", "status": "completed", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:01.727591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.728098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.728543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.743093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] Creating event network-vif-unplugged:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h2-master-1 Oct 19 00:49:01.750306 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-58280bf3-7854-4220-8b29-20c4c018c493 req-15a67d79-37ad-48b1-affc-1c693e2586a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040309 Oct 19 00:49:01.750930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 568/1192] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:01.758700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c056ef1-a455-438a-a225-f148d68036d5 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af9383670>, body: {"security_group_rule": {"parent_group_id": "52f44c0f-74d2-4454-b61d-befebfb1a5fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:01.773008 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 could not be found", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:49:01.773751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] HTTP exception thrown: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Request method failure captured: Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 HTTP/1.1 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lo1J8e48H_zD8ddXOb0hQYtLdmYX2t0gUzNF9ocrAlAyuMHGyEhX3qhtfjRY-SnBD-7MbfLshD8MfDdAwgjaW03mDch4C3Q9yHksRXFeJXHr4V5hbbhHYZO8nD65ik-hcYKVur6wPGwNCkyMHjgSKb1FhfKOwywK9Cf3MWsuxx3RE Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 924c4188dbcd4bcbb4cc76aed769c0c1 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_924c4188dbcd4bcbb4cc76aed769c0c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/924c4188dbcd4bcbb4cc76aed769c0c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/924c4188dbcd4bcbb4cc76aed769c0c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/924c4188dbcd4bcbb4cc76aed769c0c1"}]}] Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 924c4188dbcd4bcbb4cc76aed769c0c1 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsTestJSON-634230694 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsTestJSON-634230694-project Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 80f50eb98d76433eacaa60c62d94ad69 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsTestJSON-634230694-project Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: exception: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '65ceadac-a8da-4aeb-97a6-0fb3cccc89a9'} Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 could not be found Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d19ad03-3396-4182-af26-7aa1ed8d188f'] Oct 19 00:49:01.775683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9. Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] Returning 404 to user: Floating IP not found for ID 65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ea6099e-8a8d-4dca-9993-5efb94819a28 tempest-FloatingIPsTestJSON-634230694 tempest-FloatingIPsTestJSON-634230694-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9" status: 404 len: 111 microversion: 2.1 time: 0.164102 Oct 19 00:49:01.781784 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 625/1193] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:49:01 2022] DELETE /compute/v2.1/os-floating-ips/65ceadac-a8da-4aeb-97a6-0fb3cccc89a9 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:01.790437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:01.790437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:01.810280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.812843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.813622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:01.814674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:01.816191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:01.816895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:02.463592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:02.480295 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3a17da8-e348-464e-9a0a-e71e9217ab3f tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.700864 Oct 19 00:49:02.480946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 626/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:01 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:02.501096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b94506-e150-46f4-a7a3-b340d0ccb6d0", "name": "network-vif-unplugged", "status": "completed", "tag": "ab9bd828-572a-4f51-b2af-60a415f3fd21"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:02.512230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:02.512770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:02.513219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:02.537170 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] Creating event network-vif-unplugged:ab9bd828-572a-4f51-b2af-60a415f3fd21 for instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 on n-h1-master-1 Oct 19 00:49:02.544960 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-084681bf-af67-4c93-b871-c5048cc26097 req-0431156d-7f11-464c-b42a-e69b62f2ab0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047506 Oct 19 00:49:02.549901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 627/1195] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:02.558329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1292058268", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:02.619379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:49:02.774660 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c056ef1-a455-438a-a225-f148d68036d5 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.021580 Oct 19 00:49:02.776488 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 569/1196] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:01 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:02.790251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:02.791435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:02.812343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:02.814212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:02.815153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:02.816602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:02.817525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:02.819654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.242086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:03.251561 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-88db5e27-eafc-41d5-851d-cb5e807c9751 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1275 microversion: 2.1 time: 0.473432 Oct 19 00:49:03.252525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 570/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:02 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1275 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:03.259239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:03.260079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:03.269233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.270104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.270818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.271847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.272406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.272942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.800564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:03.812071 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c0ab26e-d250-4897-9f56-dddc6eb28ec8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.557401 Oct 19 00:49:03.825889 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 571/1198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:03 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:03.832905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:03.834687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:03.841637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.842265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.843027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.843835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.844662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.845529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.859219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:49:03.860243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:49:03.861055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:49:03.861709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:49:03.862503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:49:03.878531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.879448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.880145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.881526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:03.882242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:03.884571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:03.908994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:03.915516 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:03.917013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Getting quotas for user c5bef756c5c74e688ded867d98a6d29a and project fd215e75fbda44c9a04e669cde1dfaa1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:03.936835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:49:03.939726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:49:03.997924 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23b51029-64e0-462c-b2ae-32bb07a99099 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.446541 Oct 19 00:49:03.998927 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 628/1199] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:49:04.004014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:04.005182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:04.012669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.013656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.014370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.015366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.016976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.017532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.312593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:04.329252 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8c1cf92-9548-44a9-9928-387d56671506 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.501748 Oct 19 00:49:04.330142 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 572/1200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:03 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:04.335371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ce5abe5-ff52-4679-be80-b8924e1a224f tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af9332670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1428185621", "description": "tempest-description-1967966053"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:04.507344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:04.525054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:04.527458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:04.530836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f26984e5-b5c8-4c30-bd9a-c6fbd59c0aee tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1568 microversion: 2.25 time: 0.530642 Oct 19 00:49:04.546369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 629/1201] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:03 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1568 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:04.557592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c98cca62-8e30-4c84-a431-4a0c1138ac18", "tag": "edda9ea9-a567-4cff-a6fb-0fb7e578d1bc"}, {"name": "network-changed", "server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:04.569519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.570283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.573210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.596899 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Creating event network-changed:edda9ea9-a567-4cff-a6fb-0fb7e578d1bc for instance c98cca62-8e30-4c84-a431-4a0c1138ac18 on n-h1-master-1 Oct 19 00:49:04.598036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] Creating event network-changed:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h2-master-1 Oct 19 00:49:04.613398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4542b677-3e21-4ae8-91d0-02a7f4d9a5a0 req-0941c30e-3757-4684-ad52-942d7b1877d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063187 Oct 19 00:49:04.614432 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 630/1202] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:04.623481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c48e7e1-feee-4bcd-bb0c-8d2a6e4222ba tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c48e7e1-feee-4bcd-bb0c-8d2a6e4222ba tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action HTTP/1.1 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 285 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:04.629146 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 00:49:04.633887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:04.638942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c48e7e1-feee-4bcd-bb0c-8d2a6e4222ba tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:04.640492 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c48e7e1-feee-4bcd-bb0c-8d2a6e4222ba tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action" status: 400 len: 619 microversion: 2.1 time: 0.024391 Oct 19 00:49:04.641782 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 631/1203] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Oct 19 00:49:04 2022] POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:49:04.648050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:04.648916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:04.658453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.659069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.659669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.665961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.666670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.671858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.836841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:04.851244 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd1c16f6-62b8-4f75-ad30-0badef8b0885 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1209 microversion: 2.1 time: 0.207742 Oct 19 00:49:04.851874 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 632/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:04 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1209 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:04.860541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:04.862614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:04.880165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.883520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.884039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.888434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:04.888995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:04.889449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:04.900083 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:05.108807 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ce5abe5-ff52-4679-be80-b8924e1a224f tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.774590 Oct 19 00:49:05.109530 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 573/1205] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:04 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:05.250453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2b94506-e150-46f4-a7a3-b340d0ccb6d0", "tag": "ab9bd828-572a-4f51-b2af-60a415f3fd21"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:05.276808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.277599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.278352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.294560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] Creating event network-changed:ab9bd828-572a-4f51-b2af-60a415f3fd21 for instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 on n-h1-master-1 Oct 19 00:49:05.314369 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-404361fa-2bae-449d-a3d6-5875d816a86c req-df450e67-e271-4bf5-938e-66ce4ab48acc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191035 Oct 19 00:49:05.321552 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 574/1206] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:05.330866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:05.333827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:05.340255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.340920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.341454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.342241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.342798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.343309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.478878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:05.490667 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-448f6295-b70e-4c13-9cc0-b1695a52ebb0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.637530 Oct 19 00:49:05.491640 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 633/1207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:04 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:05.520746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ba55b5a-5e9a-43a8-929b-dffec491b426 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4e70e50>, body: {"security_group_rule": {"parent_group_id": "2bad9060-9ea3-4f75-a5e6-5e76f2ac71f5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:05.795751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:05.809655 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e6c1b26-0d4d-4a44-82f1-5c6ff65c7339 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.485599 Oct 19 00:49:05.813102 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 575/1208] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:05 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:05.827503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:05.828567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:05.841740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.842487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.843091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:05.843796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:05.844253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:05.844703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.319714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:06.329905 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:06.364859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57a016e0-00f8-4cf9-b041-fb1783dacb5a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.546006 Oct 19 00:49:06.365651 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 576/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:05 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:06.387254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:06.392580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:06.409201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.409892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.412310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.413118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.413763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.414367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.512044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ba55b5a-5e9a-43a8-929b-dffec491b426 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.002984 Oct 19 00:49:06.514864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 634/1210] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:05 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:06.523765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:06.524634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:06.542604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.543097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.546490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:06.547252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:06.547725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:06.549705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:07.224949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:07.237822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:07.239707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:07.241244 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-711295a3-7441-45ca-9e33-f2d6158f21cd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1568 microversion: 2.25 time: 0.871300 Oct 19 00:49:07.242309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 577/1211] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:06 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1568 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:07.247864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:07.248846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:07.255299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:07.256005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:07.256750 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:07.257689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:07.258345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:07.259066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:07.473553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:07.487522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0ffaa29-f718-4ee3-af70-c45df7caae85 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.970937 Oct 19 00:49:07.492064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 635/1212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:06 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:07.497893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d17bebd1-3b54-4b54-8f5c-81234a1eebea tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af50233a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-360439916", "description": "tempest-description-717105275"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:07.903114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:07.923357 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97d73142-ef1f-442c-9b0f-c577f30acf01 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.679576 Oct 19 00:49:07.925285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 578/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:07 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:07.955032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:07.957420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:07.987065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:07.989409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:07.992057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:07.994250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:07.994917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:07.995517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.270748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d17bebd1-3b54-4b54-8f5c-81234a1eebea tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.775522 Oct 19 00:49:08.280534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 636/1214] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:07 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:08.285480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:08.319858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.320386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.320967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.336713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] Creating event network-changed:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:49:08.345221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-462feb54-6fec-4cac-880b-57d3ac7227f3 req-faad0110-e553-4552-812f-4b458a5ce55d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065329 Oct 19 00:49:08.345910 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 637/1215] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:08.359407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:08.360888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:08.369503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.370210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.370963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.372391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.373058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.373760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.442283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:08.452027 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c65a941-a19f-4c33-912b-25e8bd8a1f65 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.524835 Oct 19 00:49:08.461278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 579/1216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:07 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:08.470093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-342100578"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:08.473032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:08.480533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.481709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.482427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.483471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.484293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.485558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.745399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:08.779134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d3f4575-4b86-4d59-8e59-3c036dafd456 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.431242 Oct 19 00:49:08.782383 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 638/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:08 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:08.819999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:08.826019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:08.842584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.848876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.849892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.853378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:08.854069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:08.857242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:08.922075 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-336e164f-f3ab-4461-8bd0-b8379b537b48 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action" status: 202 len: 0 microversion: 2.1 time: 0.457487 Oct 19 00:49:08.922775 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 580/1218] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:08 2022] POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action => generated 0 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 00:49:08.941934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2e8ea38-1ea1-4201-bf07-91fde9521844 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4f7b5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-119859511", "description": "tempest-description-161400777"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:09.291494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:09.308174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:09.311766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:09.313549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4816827-f55e-4d4d-b9e9-f4b151db98a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1568 microversion: 2.25 time: 0.511509 Oct 19 00:49:09.314432 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 639/1219] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:08 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:09.321516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-739026020"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:09.324477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:09.344611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.345488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.346551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.349852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.350741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.351493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.399012 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Cannot 'createImage' instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a while it is in task_state image_snapshot_pending Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action HTTP/1.1 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 84 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-739026020"}} Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'createImage' instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a while it is in task_state image_snapshot_pending Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-739026020'}}} Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 00:49:09.400811 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a while it is in task_state image_snapshot_pending Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a while it is in task_state image_snapshot_pending Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 409 to user: Cannot 'createImage' instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a while it is in task_state image_snapshot_pending {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f91c38cf-02ff-4393-9e8e-e306210ef724 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action" status: 409 len: 167 microversion: 2.1 time: 0.086709 Oct 19 00:49:09.405870 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 640/1220] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:09 2022] POST /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a/action => generated 167 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:49:09.406886 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2e8ea38-1ea1-4201-bf07-91fde9521844 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.481682 Oct 19 00:49:09.408446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:09.409113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:09.412848 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 581/1221] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:08 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:09.415867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.416366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.416849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.417558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.418011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.419179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.420316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:09.436344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.436979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.439375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.457588 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] Creating event network-changed:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:49:09.467575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8777ee09-5d6d-4ecb-b539-fa46888bc7ac req-b6c927c1-987d-41c8-b5e5-b70c3c3d009b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051116 Oct 19 00:49:09.469635 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 582/1222] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:09.485201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fefc4c1-56eb-45f0-8120-9c53f63e5f70 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af4f05700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:09.705806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2fefc4c1-56eb-45f0-8120-9c53f63e5f70 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/images/0a3ff272-6ed6-48b0-97b0-315097c96189" status: 204 len: 0 microversion: 2.1 time: 0.234466 Oct 19 00:49:09.706787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 583/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:09 2022] DELETE /compute/v2.1/images/0a3ff272-6ed6-48b0-97b0-315097c96189 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:09.713674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6a65e19-e3cc-43e2-a4b6-581381205575 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4f61dc0>, body: {"security_group_rule": {"parent_group_id": "c6f2f5c4-ed7b-4638-bb48-d0742e91306c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "e273093c-d584-45d4-91ed-c386658dcf0a"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:09.901520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:09.910809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9fa2d021-06f3-4342-9d0b-0f57eb86abfc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.506728 Oct 19 00:49:09.911395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 641/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:09 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:09.916056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:09.916698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:09.923900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.924674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.925311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:09.926205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:09.926826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:09.927428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:10.651290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:10.670397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db62319f-8dfa-4bc5-bb7b-a93c965aefc0 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.757893 Oct 19 00:49:10.689707 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 642/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:09 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:10.698228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:10.699362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:10.709855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:10.711402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:10.712670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:10.715691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:10.716912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:10.717584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.061088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a6a65e19-e3cc-43e2-a4b6-581381205575 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.352565 Oct 19 00:49:11.077628 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 584/1226] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:09 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:11.103712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.106240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:11.133479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.134585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.139965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.141883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.144090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.145437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.169196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.197504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a1b5611-cf5a-4d64-a515-02943b444c86 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1533 microversion: 2.1 time: 0.505847 Oct 19 00:49:11.199232 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 643/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:10 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1533 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:11.219367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.221060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:11.239916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.245770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.247010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.248481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.255967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.256776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.619529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.634082 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67eece7c-bc57-490c-89f0-df587aa6f2d5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.551186 Oct 19 00:49:11.635016 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 585/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:11 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:11.640962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.641742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:11.655952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.658299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.659018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.659648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.660539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:11.661179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:11.661893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:11.666507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.668792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.670732 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-465239f9-36a2-4328-a2ea-aafdff1ad2fb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1568 microversion: 2.25 time: 0.469219 Oct 19 00:49:11.671908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 644/1229] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:11 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1568 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:11.677394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02fbc097-afce-4a18-a4c9-a1a66a03a36a tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af59d2af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-967732364", "description": "tempest-description-1666681864"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:11.925552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:11.944647 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a12f9323-07da-4420-b6e9-cb29e27abecf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.308449 Oct 19 00:49:11.945269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 586/1230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:11 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:11.975741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:11.976377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:12.002446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.003204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.003863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.004857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.005499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.007383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.040541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02fbc097-afce-4a18-a4c9-a1a66a03a36a tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.366855 Oct 19 00:49:12.041408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 645/1231] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:11 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:12.057182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14038a74-1d27-473a-bdfa-2f729abe513b tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af5021ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1285614036", "description": "tempest-description-1661594919"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:12.427094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14038a74-1d27-473a-bdfa-2f729abe513b tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.374987 Oct 19 00:49:12.428408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 646/1232] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:12 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:49:12.433566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:12.434796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:12.451216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:12.463645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.473976 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd28f354-fcc5-40f4-aeb5-740b45c86809 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.523011 Oct 19 00:49:12.475667 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 587/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:11 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:12.479276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.481297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.482254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ba6bb83-7bb2-4704-8344-8e4bdde79ddb tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4f7b9d0>, body: {"security_group_rule": {"parent_group_id": "f5d7b6c7-77ce-42a5-bb57-34c298b99c4d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "822465b6-7c5a-4147-bb3d-a7d301dc62b3"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:12.482587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.483323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.483962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.782652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:12.798809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-363defd4-799e-4965-9230-39e0d96edd09 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1539 microversion: 2.1 time: 0.368972 Oct 19 00:49:12.799742 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 647/1234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:12 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1539 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:12.807537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:12.808221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:12.821296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.822097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.822648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:12.823479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:12.824032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:12.824479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.152644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:13.189174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ba6bb83-7bb2-4704-8344-8e4bdde79ddb tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.711369 Oct 19 00:49:13.189868 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 588/1235] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:12 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:13.203185 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-edc4bebc-ca95-4199-b61e-dedef027f548 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.401324 Oct 19 00:49:13.209629 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 648/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:12 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:13.211292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:13.213094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:13.233970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.235037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.236852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:13.237656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.239029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:13.240700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.241908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.242964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.254415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.259645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.260124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.261362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.261819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.262300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.643377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:13.658672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:13.660973 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-011bccce-7af1-4b70-8da2-3b8bea3c54de tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.449636 Oct 19 00:49:13.662733 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 649/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:13 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:13.672803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-135f08df-8dd5-4704-8605-82a307495f63 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4e70790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:13.697192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:13.698714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:13.701002 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-891ecb9c-78e8-492b-bb9a-356311e8c94f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1558 microversion: 2.25 time: 0.509236 Oct 19 00:49:13.702101 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 589/1238] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:13 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1558 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:13.708394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:13.709402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:13.728217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.728743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.729375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.730344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:13.731131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:13.731766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:13.898357 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:13.927712 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:14.193844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:14.206881 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 00:49:14.207537 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 00:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 (ip 10.222.0.27) !!! Oct 19 00:49:14.218517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6343021-ee1e-4396-aead-eeac6a4c029f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.514802 Oct 19 00:49:14.239569 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 590/1239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:13 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:14.268146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-plugged", "status": "completed", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:14.295147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.296509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.297361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.319492 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] Creating event network-vif-plugged:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:49:14.328174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e71a3fb4-e4a7-44c7-84cb-c032f477ce79 req-21ac2df3-3ff4-46c7-b451-a46ff129bb49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086684 Oct 19 00:49:14.330370 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 591/1240] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:14.344360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a22ec1b-1c99-4690-b2c5-df2b8ef7fdfa tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '.version_select at 0x7f2af4f7aee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.354187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a22ec1b-1c99-4690-b2c5-df2b8ef7fdfa tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.355634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a22ec1b-1c99-4690-b2c5-df2b8ef7fdfa tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.357544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a22ec1b-1c99-4690-b2c5-df2b8ef7fdfa tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.385582 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a22ec1b-1c99-4690-b2c5-df2b8ef7fdfa tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3205 microversion: 2.25 time: 0.052595 Oct 19 00:49:14.386516 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 592/1241] 10.222.0.27 () {60 vars in 1184 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/os-migrations => generated 3205 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:14.394340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.395919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:14.406685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.407646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.408263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.409829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.410293 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-135f08df-8dd5-4704-8605-82a307495f63 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/822465b6-7c5a-4147-bb3d-a7d301dc62b3" status: 202 len: 0 microversion: 2.1 time: 0.746051 Oct 19 00:49:14.410745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.410986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 650/1242] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:13 2022] DELETE /compute/v2.1/os-security-groups/822465b6-7c5a-4147-bb3d-a7d301dc62b3 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:14.411531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.416279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.418442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:14.439705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.440222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.440884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.442391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.443906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.444791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.713815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:14.729771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e1929dc-551c-4276-a20e-cc8ff677d7ce tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1534 microversion: 2.1 time: 0.340436 Oct 19 00:49:14.733164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 593/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1534 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:14.742143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.743803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:14.755513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.756345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.757239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.758253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.758884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.759616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.786436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:14.802184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-685da398-4ef5-40b5-b67d-210264f1e628 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.390107 Oct 19 00:49:14.802799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 651/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:14.813413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d2e5fc4-c546-41e9-84d9-9a651b5d225c tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af5067310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.918091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d2e5fc4-c546-41e9-84d9-9a651b5d225c tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/f5d7b6c7-77ce-42a5-bb57-34c298b99c4d" status: 200 len: 247 microversion: 2.1 time: 0.112931 Oct 19 00:49:14.929070 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 652/1245] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/os-security-groups/f5d7b6c7-77ce-42a5-bb57-34c298b99c4d => generated 247 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:14.929070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:14.929070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:14.932739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.933238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.933703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:14.934495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:14.934986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:14.935421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:15.001678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid e2b94506-e150-46f4-a7a3-b340d0ccb6d0 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:15.041643 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d5a345b-7448-47fb-a730-f415b7302202 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 2050 microversion: 2.25 time: 0.306581 Oct 19 00:49:15.042349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 594/1246] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 2050 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:15.051906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1aa39fb-90c1-45ab-8e03-552180470cac tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af9422f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1246095287", "description": "tempest-description-1718483043"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:15.186342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:15.204811 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad555ccc-4f21-435b-937c-49ef2d910224 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.281750 Oct 19 00:49:15.205445 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 653/1247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:14 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:15.261121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2003638327", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "82c7aa9d-4226-40d4-9740-5580292913bc"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:15.332013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] validate_networks() for [('82c7aa9d-4226-40d4-9740-5580292913bc', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:49:15.408450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1aa39fb-90c1-45ab-8e03-552180470cac tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.364800 Oct 19 00:49:15.409886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 595/1248] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:49:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:15.416860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:15.418112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:15.433748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:15.436286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:15.436995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:15.437895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:15.438431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:15.440116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:15.682788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:15.698256 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5331de7-74f6-4c38-8da4-882f74c25d00 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1317 microversion: 2.1 time: 0.286591 Oct 19 00:49:15.710346 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 596/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:15 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:15.719214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e344793c-546d-469c-b73f-9d5642cdffd4 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4ff4280>, body: {"security_group_rule": {"parent_group_id": "0965c4ef-c435-46ea-8987-dded5a5c3573", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:16.082854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:49:16.092872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:49:16.093628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:49:16.094057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:49:16.095205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:49:16.109008 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e344793c-546d-469c-b73f-9d5642cdffd4 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.396480 Oct 19 00:49:16.110559 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 597/1250] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:15 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:16.116572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.117664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.118119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.124797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:16.126036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:16.132256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.133460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.134190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.136315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.147259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.148131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.149114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.149795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.150429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.157982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:16.163742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for user 5d0158da7efc485ebd6a1e1db617b5e7 and project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:16.182209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:49:16.186726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:49:16.249654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-98752795-6861-4b79-b11e-c1145b18d7a4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.992408 Oct 19 00:49:16.257426 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 654/1251] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:49:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:49:16.264516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:16.265833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:16.309737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.312952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.313668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.314685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.316974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.318727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.555153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:16.570470 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad726cf5-bf23-4899-b1a7-6a388a8aeb38 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1521 microversion: 2.1 time: 0.457888 Oct 19 00:49:16.578387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 598/1252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:16 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1521 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:16.583395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7aeb8f19-a936-4bc1-8d3a-9fd9320f4695 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Action: 'create', calling method: .version_select at 0x7f2af4f79d30>, body: {"security_group_rule": {"parent_group_id": "0965c4ef-c435-46ea-8987-dded5a5c3573", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:16.807590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:16.824205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e51e7751-3f17-475a-9514-a5ce61eb0957 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1718 microversion: 2.1 time: 0.564208 Oct 19 00:49:16.827441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 655/1253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:16 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1718 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:16.835203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:16.836926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:16.845339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.845944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.846454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:16.847200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:16.847684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:16.848105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.336915 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7aeb8f19-a936-4bc1-8d3a-9fd9320f4695 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.757345 Oct 19 00:49:17.340185 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 599/1254] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:49:16 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:17.346325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.351398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:17.368507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.369473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.370908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.372740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.373513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.374152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.441246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:17.450729 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11a1ea45-190f-4c6b-815b-296f1a152113 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.621000 Oct 19 00:49:17.452249 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 656/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:16 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:17.459135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-plugged", "status": "completed", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:17.470745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.471656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.472313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.493910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:17.495512 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:17.499870 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] Creating event network-vif-plugged:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:49:17.505871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1b432a5f-0e3f-4b39-905f-e826b9545d55 req-91337b5f-8cab-4e0d-888e-9425c61673d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051357 Oct 19 00:49:17.507066 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 657/1256] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:17.511483 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:17.515051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.515897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:17.517193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:17.519330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:17.523328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.524085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.524335 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3241e29-b613-4a2d-870e-46ceb26f1050 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1314 microversion: 2.25 time: 0.180654 Oct 19 00:49:17.525280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.526248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.526917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.527586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.562869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:49:17.564507 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 600/1257] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:17 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:17.574094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.575374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:17.582989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.583492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.583966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.590605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.591393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.591869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.740390 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d379e68a-6c20-4c0b-9687-363f94b50e18 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 204 len: 0 microversion: 2.1 time: 0.229721 Oct 19 00:49:17.747292 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 658/1258] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:49:17 2022] DELETE /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:17.761223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2d160923-d143-48fb-a547-ddf1b1c60904 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af50c3670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.919760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2d160923-d143-48fb-a547-ddf1b1c60904 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/0965c4ef-c435-46ea-8987-dded5a5c3573" status: 200 len: 665 microversion: 2.1 time: 0.171030 Oct 19 00:49:17.920557 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 659/1259] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:49:17 2022] GET /compute/v2.1/os-security-groups/0965c4ef-c435-46ea-8987-dded5a5c3573 => generated 665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:17.925440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:17.926178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:17.933929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.935685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.935685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:17.936276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:17.936856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:17.937300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:18.012587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:18.023353 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-645d212d-035f-4f05-a459-05e05629a0e5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1467 microversion: 2.1 time: 0.455854 Oct 19 00:49:18.024168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 601/1260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:17 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1467 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:18.031640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.032351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:18.038735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:18.039540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:18.040203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:18.057183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:18.058425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:18.059794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:18.642011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:18.654042 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-925a0cfb-81ad-4f9f-af92-d95dda8d2197 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1527 microversion: 2.1 time: 0.731416 Oct 19 00:49:18.654935 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 660/1261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:17 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1527 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:18.659757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fea59be-afe9-4fef-a3df-2b8630cc992f tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4e70820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:18.748220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:18.757203 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50d7a359-e735-4286-9987-a940732974d6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1708 microversion: 2.1 time: 0.731654 Oct 19 00:49:18.778127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 602/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:18 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1708 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:18.785203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1866027565", "metadata": {"image_type": "test"}}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:18.788006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:18.797586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:18.798486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:18.799525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:18.800686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:18.801865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:18.802424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:18.880290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Getting quotas for project 8d60a9bdaee646508bf9f42d390191d3. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:18.900898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Getting quotas for user 2a896789dc814debba3a0a8f8f0c8943 and project 8d60a9bdaee646508bf9f42d390191d3. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:19.138809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7fea59be-afe9-4fef-a3df-2b8630cc992f tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/73806784-ce96-4701-944d-5f1cf397681a" status: 202 len: 0 microversion: 2.1 time: 0.482568 Oct 19 00:49:19.140682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 661/1263] 10.222.0.27 () {58 vars in 1287 bytes} [Wed Oct 19 00:49:18 2022] DELETE /compute/v2.1/os-security-group-rules/73806784-ce96-4701-944d-5f1cf397681a => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:19.146522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.148181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:19.180126 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0bcdaa6-aafc-47b3-8dd1-ba2da39bf286 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "POST /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208/action" status: 202 len: 0 microversion: 2.1 time: 0.399425 Oct 19 00:49:19.190285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.190484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 603/1264] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:18 2022] POST /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 00:49:19.194817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.195547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.196480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.197751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.197947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.198390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.199013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:19.210363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.211350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.212327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.213289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.213938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.214539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.403123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:19.414606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:19.417291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:19.418874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-438c8d38-3b3a-4107-9f81-812cb87fdb05 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1320 microversion: 2.25 time: 0.226934 Oct 19 00:49:19.452947 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 604/1265] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:19.466308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7519a15-4877-409c-aaf7-21f253c8c9bb tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '.version_select at 0x7f2af4faf430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.474202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7519a15-4877-409c-aaf7-21f253c8c9bb tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.475170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7519a15-4877-409c-aaf7-21f253c8c9bb tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.475805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7519a15-4877-409c-aaf7-21f253c8c9bb tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.493034 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7519a15-4877-409c-aaf7-21f253c8c9bb tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2728 microversion: 2.1 time: 0.035903 Oct 19 00:49:19.503289 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 605/1266] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/os-migrations => generated 2728 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:19.509747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8a1702a-8e9d-48b1-9577-5c5aa9afc456 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af93aa280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.617307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:19.626021 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b73d2897-fc57-4b3d-a870-104213e0c2b5 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1313 microversion: 2.1 time: 0.484066 Oct 19 00:49:19.627254 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 662/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1313 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:19.632481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbefafef-103c-4d91-8a79-3dcf0152cdbb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4fc3790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.702703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbefafef-103c-4d91-8a79-3dcf0152cdbb tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.073788 Oct 19 00:49:19.711884 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 663/1268] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:19.716774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:19.717393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:19.724715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.725561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.726214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:19.727226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:19.727975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:19.728759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.073974 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60341890-e858-4909-85f5-d59e052410e5 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1859 microversion: 2.1 time: 0.360891 Oct 19 00:49:20.075168 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 664/1269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:19 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1859 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:20.249263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8a1702a-8e9d-48b1-9577-5c5aa9afc456 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0965c4ef-c435-46ea-8987-dded5a5c3573" status: 202 len: 0 microversion: 2.1 time: 0.744493 Oct 19 00:49:20.250059 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 606/1270] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:19 2022] DELETE /compute/v2.1/os-security-groups/0965c4ef-c435-46ea-8987-dded5a5c3573 => generated 0 bytes in 749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:20.256852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:20.259678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:20.281918 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:20.285333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.286103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.286755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.287647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca86d4f0-73e6-407c-b6a9-3b7f3048f09a", "name": "network-vif-plugged", "status": "completed", "tag": "f5f41137-1106-4da0-8e1e-06fe00f1c387"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:20.287838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.288456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.289082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.313503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.314321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.318111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.368032 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] Creating event network-vif-plugged:f5f41137-1106-4da0-8e1e-06fe00f1c387 for instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a on n-h2-master-1 Oct 19 00:49:20.383474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-64275fab-97c7-4a02-8971-daebeb298144 req-4208548b-2c45-4b95-8628-ad5047f17800 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.306712 Oct 19 00:49:20.384214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 665/1271] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:20.392983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:20.399123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:20.409337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.410132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.410924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.411770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.412349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.412900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.744397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:20.762492 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c951825b-67ce-40dd-9590-0a10e1731e74 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1527 microversion: 2.1 time: 0.510948 Oct 19 00:49:20.765788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 607/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:20 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1527 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:20.773692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4f05040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:20.865365 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:49:20.866827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Neutron security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:49:20.869145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] HTTP exception thrown: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.869145 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.875687 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7f421c1-080f-4274-8007-59426921f8c1 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1859 microversion: 2.1 time: 0.488361 Oct 19 00:49:20.880760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 666/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:20 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1859 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:20.886517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:20.887687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Request method failure captured: Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-security-groups/822465b6-7c5a-4147-bb3d-a7d301dc62b3 HTTP/1.1 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0l63K60yiG5UFs3igc-oJ4MJ7y_SDDhYyCtoL2zatJEMRjJ8xgSco8rjq8ab1Unr3QqKXUJ2Rzl6GbShivvziKQDEQWYLjwtH5q5ZEsXk5iz-zm8gWpB8Nvt99WJPVlFMljngkxdLznrkMPIcxGF74Fp8R5VUOuSfhnEmq3f86W2_A Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: dbd865e323184a67ae37cb93f7334adb Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-481662596 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dbd865e323184a67ae37cb93f7334adb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbd865e323184a67ae37cb93f7334adb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dbd865e323184a67ae37cb93f7334adb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dbd865e323184a67ae37cb93f7334adb"}]}] Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupRulesTestJSON-481662596 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: dbd865e323184a67ae37cb93f7334adb Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-481662596 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupRulesTestJSON-481662596-project Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c10bfa3078e14866b10189c65037c2de Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupRulesTestJSON-481662596-project Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: exception: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '822465b6-7c5a-4147-bb3d-a7d301dc62b3'} Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:49:20.889944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Returning 404 to user: Security group 822465b6-7c5a-4147-bb3d-a7d301dc62b3 does not exist Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-1aa49016-daf6-4f27-9ad1-3bd6b194c653'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f52dcecc-beff-4b2e-a645-50449f2aea46 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/822465b6-7c5a-4147-bb3d-a7d301dc62b3" status: 404 len: 194 microversion: 2.1 time: 0.124406 Oct 19 00:49:20.894823 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 608/1274] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:20 2022] DELETE /compute/v2.1/os-security-groups/822465b6-7c5a-4147-bb3d-a7d301dc62b3 => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:20.904871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:20.904871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:20.915535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.916043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.916491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.917296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.917776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.918367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.952841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.960574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.962310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:20.967240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:20.970207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:20.970813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:21.448509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:21.469381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:21.476489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:21.481960 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7edf7f59-9144-4673-86b7-a7f51c89d9f0 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.597999 Oct 19 00:49:21.505235 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 667/1275] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:20 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:21.524682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41c997b0-ba11-4453-ad12-117b2d461236 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af50c5a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:21.624591 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41c997b0-ba11-4453-ad12-117b2d461236 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.116673 Oct 19 00:49:21.625615 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 668/1276] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:21 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:21.631524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f5639d08-3e83-43d0-b817-c732a3ffb824 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af50ca1f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:21.686374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:21.696323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6658324a-3a86-47b4-8497-c8357f11cb44 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1461 microversion: 2.1 time: 0.801639 Oct 19 00:49:21.697599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 609/1277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:20 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1461 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:21.704334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:21.705285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:21.712250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:21.713166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:21.713834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:21.714819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:21.715632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:21.717062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:21.933731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'services' on Instance uuid 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:22.177301 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf76f88a-59ec-47fa-bc8a-1e88b4070862 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments/096dc72e-f59a-441e-8e72-e180a5f51427" status: 202 len: 0 microversion: 2.1 time: 0.477626 Oct 19 00:49:22.178502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 610/1278] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 00:49:21 2022] DELETE /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments/096dc72e-f59a-441e-8e72-e180a5f51427 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:22.190859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bfd31f-98ce-4bd1-8214-d862c74e8247", "tag": "d17e1f5f-3261-4df3-8cf7-372e2857c241"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:22.203397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.204384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.205074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.220197 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] Creating event network-changed:d17e1f5f-3261-4df3-8cf7-372e2857c241 for instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 on n-h1-master-1 Oct 19 00:49:22.226236 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ef1def4e-c686-4e35-85f8-c50476260460 req-e64d8ecb-0507-42a5-a0b9-87bbdfe161ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045908 Oct 19 00:49:22.227200 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 611/1279] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:22.236232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:22.237092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:22.245532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.246215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.246703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.247503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.251333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.251333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.762798 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f2dc9b3-db1b-42ff-96ee-472ef7ae7320 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1612 microversion: 2.1 time: 0.533478 Oct 19 00:49:22.764437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 612/1280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:22 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1612 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:22.767706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f5639d08-3e83-43d0-b817-c732a3ffb824 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f5d7b6c7-77ce-42a5-bb57-34c298b99c4d" status: 202 len: 0 microversion: 2.1 time: 1.140909 Oct 19 00:49:22.768857 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 669/1281] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:21 2022] DELETE /compute/v2.1/os-security-groups/f5d7b6c7-77ce-42a5-bb57-34c298b99c4d => generated 0 bytes in 1143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:22.774225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:22.778167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:22.778340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:22.778819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:22.790842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.791268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.791703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.793927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.794277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.794987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.796065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.796515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.797149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.798861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.799453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.799905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.855328 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22415fbe-8c72-42c5-a9bc-38d074582f97 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085224 Oct 19 00:49:22.860743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 670/1282] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:22 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:22.861540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca86d4f0-73e6-407c-b6a9-3b7f3048f09a", "name": "network-vif-deleted", "tag": "f5f41137-1106-4da0-8e1e-06fe00f1c387"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:22.875802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.876455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.877031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.879369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.879940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.880380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.880883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lazy-loading 'fault' on Instance uuid ca86d4f0-73e6-407c-b6a9-3b7f3048f09a {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:22.898339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] Creating event network-vif-deleted:f5f41137-1106-4da0-8e1e-06fe00f1c387 for instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a on n-h2-master-1 Oct 19 00:49:22.906868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4c3f4631-0415-4131-8167-8b0a84870005 req-e0e54d39-3406-46cb-9282-2bb19988031d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049037 Oct 19 00:49:22.907807 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 671/1283] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:22.913627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:22.914820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:22.922988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.923485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.923925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.924682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:22.925147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:22.925674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:22.953738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:22.966257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab8e398b-b5ca-46fd-972e-aa9dcbd3a498 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 200 len: 1315 microversion: 2.1 time: 0.192686 Oct 19 00:49:22.969512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 613/1284] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:22 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:22.977011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5f3cbcb-4b5e-4831-a440-c6958420a36d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4e17ee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:23.037174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5f3cbcb-4b5e-4831-a440-c6958420a36d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.063968 Oct 19 00:49:23.039005 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 614/1285] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:22 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:23.045440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-045bebaa-d12c-485b-ba42-f2f438d6d777 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4e33550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:23.236920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:23.253070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:23.258619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:23.262479 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df051a52-fccb-402b-a5f0-89b2b830f85f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.350957 Oct 19 00:49:23.294348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 672/1286] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:22 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:23.300293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:23.300842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:23.307564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.308061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.308650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.310544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.310544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.310846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.509207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '886050a9ea1a46428ee4927b2e5fdbe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f2fec863e8446128e270320b0ef204d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:23.510108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] flavor_id is None. Assuming migration. {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 00:49:23.512003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 00:49:23.626751 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-045bebaa-d12c-485b-ba42-f2f438d6d777 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e273093c-d584-45d4-91ed-c386658dcf0a" status: 202 len: 0 microversion: 2.1 time: 0.584920 Oct 19 00:49:23.628241 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 615/1287] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:23 2022] DELETE /compute/v2.1/os-security-groups/e273093c-d584-45d4-91ed-c386658dcf0a => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:23.635306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-plugged", "status": "completed", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:23.648570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.649092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.649895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.683280 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] Creating event network-vif-plugged:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:49:23.690511 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e59779a9-0033-4354-b643-9034778c6d79 req-e1849898-4aba-4b95-bcbf-58354f689ec3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060400 Oct 19 00:49:23.692587 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 616/1288] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:23.700673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1387759-ec66-4385-aa61-745a5287eca2 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4e17af0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:23.893470 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03fd4d57-a3aa-4952-a9d5-07036c0819e5 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80/action" status: 202 len: 0 microversion: 2.1 time: 0.597220 Oct 19 00:49:23.894486 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 673/1289] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:23 2022] POST /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:23.900608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:23.904001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:23.912187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.912735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.913167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.914120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.914470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.914900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.961885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b49ae721-fc61-4503-80c8-000e6a41bbc0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065943 Oct 19 00:49:23.963206 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 674/1290] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:23 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:23.968695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:23.969536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:23.990784 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:23.992427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.993194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.994413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:23.995688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:23.997810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:23.998543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:24.337265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1387759-ec66-4385-aa61-745a5287eca2 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c6f2f5c4-ed7b-4638-bb48-d0742e91306c" status: 202 len: 0 microversion: 2.1 time: 0.643044 Oct 19 00:49:24.341699 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 617/1291] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:23 2022] DELETE /compute/v2.1/os-security-groups/c6f2f5c4-ed7b-4638-bb48-d0742e91306c => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:24.347489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:24.348755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:24.358909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:24.370762 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-59840caa-b0a0-4bd2-b03e-a810a9e88f09 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1470 microversion: 2.1 time: 0.406093 Oct 19 00:49:24.372931 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 675/1292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:23 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1470 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:24.373307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:24.373996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:24.375883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:24.376841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:24.379107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:24.379692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:24.392436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c89e7ddd-1c83-4339-89f2-12467a291bf1 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ebd3a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:24.429455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a HTTP/1.1 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a'} Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:24.431195 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:49:24.436601 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:49:24.448805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:24.450448 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b2bf6431-db41-4a9a-9b6b-242fa07ae0e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 404 len: 111 microversion: 2.1 time: 0.110817 Oct 19 00:49:24.451570 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 618/1293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:24 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:49:24.462855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:24.464037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:24.474561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:24.476099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:24.477282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:24.479374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:24.482342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:24.484755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:24.510691 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c89e7ddd-1c83-4339-89f2-12467a291bf1 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.135395 Oct 19 00:49:24.511277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 676/1294] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:24 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:24.525451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e289f54-0a99-4d27-860b-8bf6b1449346 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af5d0f8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:24.905067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:24.922543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:24.925159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:24.926816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-539e5b2b-15fc-4ecd-aea8-909234be8dd3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.474116 Oct 19 00:49:24.928874 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 619/1295] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:24 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:24.937756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20c7ad21-2f16-4f78-8187-ec90a77026e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'create', calling method: .version_select at 0x7f2af4e33700>, body: {"keypair": {"name": "tempest-keypair-1819995624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNSxta/+VNNwfgiZZ9fBpX5QD3h7Qwv4XHV2Zzxlmg3fdCbKYM/s7sPV395Xv1Pa6urP6qk830SoxTO363Ns9lISkBy/u2+iEoqzfmNcTNqIm/N+TMhxUILA0fgesJsniA=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:24.991546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-20c7ad21-2f16-4f78-8187-ec90a77026e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:25.006193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-20c7ad21-2f16-4f78-8187-ec90a77026e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for user 2ab51886a81f4e1194e0c1ac50eef9d4 and project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:25.042362 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20c7ad21-2f16-4f78-8187-ec90a77026e4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112179 Oct 19 00:49:25.050733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 620/1296] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:49:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:25.064010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:25.067179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:25.092375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:25.092977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:25.096712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:25.098622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:25.099409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:25.101962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:25.195480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e289f54-0a99-4d27-860b-8bf6b1449346 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2bad9060-9ea3-4f75-a5e6-5e76f2ac71f5" status: 202 len: 0 microversion: 2.1 time: 0.681361 Oct 19 00:49:25.196402 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 677/1297] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:24 2022] DELETE /compute/v2.1/os-security-groups/2bad9060-9ea3-4f75-a5e6-5e76f2ac71f5 => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:49:25.206389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df79cb8a-9893-4fca-9db2-818d21f242a8 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] Calling method '.version_select at 0x7f2af4fc3b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:25.243304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31930a3d-4054-4b7c-a8b4-783d35e34401 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191326 Oct 19 00:49:25.247536 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 621/1298] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:25 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:25.399724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:25.401172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:25.410948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:25.411457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:25.418015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:25.418862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:25.419349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:25.419801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:25.817026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:25.834987 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-423be146-b804-430b-9881-4224e7b3e00b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1470 microversion: 2.1 time: 0.439796 Oct 19 00:49:25.836822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 622/1299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:25 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1470 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:25.851063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1c4d4192-afb3-46cd-8620-38299b9f1390 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4dc0d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:25.974289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1c4d4192-afb3-46cd-8620-38299b9f1390 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.134881 Oct 19 00:49:25.975081 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 623/1300] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:25 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:26.055853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df79cb8a-9893-4fca-9db2-818d21f242a8 tempest-SecurityGroupRulesTestJSON-481662596 tempest-SecurityGroupRulesTestJSON-481662596-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/52f44c0f-74d2-4454-b61d-befebfb1a5fe" status: 202 len: 0 microversion: 2.1 time: 0.854572 Oct 19 00:49:26.058073 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 678/1301] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:49:25 2022] DELETE /compute/v2.1/os-security-groups/52f44c0f-74d2-4454-b61d-befebfb1a5fe => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:49:26.065478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:26.067061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:26.127978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.133100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.134293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:26.138295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.142474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.143889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:26.149183 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:26.161165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1331560770", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "fb04b404-f122-4169-8d33-7b7de973a455"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:26.189363 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:26.280879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] validate_networks() for [('fb04b404-f122-4169-8d33-7b7de973a455', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:49:26.685139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:26.694481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:26.707195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:26.710521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bfc5886e-6ef9-4a5a-b9e5-f39f3964fe0f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.650486 Oct 19 00:49:26.717709 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 679/1302] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:26 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:26.734932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:26.738901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:26.756117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.763681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.768606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:26.769560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.773286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.775837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:26.849207 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:26.923777 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e86d269-8585-40ae-a5f2-dc9334dff35c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204151 Oct 19 00:49:26.925131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 680/1303] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:26 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:26.930269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:26.944734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:26.951997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.952877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.953537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:26.959194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:26.960022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:26.960719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:27.397695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:27.411184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58c48f5e-00d2-43b2-b98b-e276feb24baf tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1470 microversion: 2.1 time: 0.482882 Oct 19 00:49:27.412646 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 681/1304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:26 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1470 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:27.418631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aca3f8a5-bafe-4931-87f1-02fbef13bc3e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af508a940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:27.520151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aca3f8a5-bafe-4931-87f1-02fbef13bc3e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.105776 Oct 19 00:49:27.520934 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 682/1305] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:27 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:27.745373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:27.747112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:27.760472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:27.761331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:27.762745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:27.763831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:27.765832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:27.766576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.142370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:49:28.145194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:49:28.146017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:49:28.148359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:49:28.149074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:49:28.201051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.202886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:28.203780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.209403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.213008 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:28.215838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:28.217677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.223535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.225274 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc784404-135d-492c-bbec-3e60c580f4c6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.483922 Oct 19 00:49:28.229380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.229672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 683/1306] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:27 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:28.244601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:28.251429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:28.265854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.266687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.268285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.269916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.272062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.277908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.306757 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:28.358903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1f6262f-f677-4b3b-beef-c54f252cb198 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126732 Oct 19 00:49:28.364392 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 684/1307] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:28 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:28.369788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Getting quotas for project b9790689725747ce8c1b18cdefb12c85. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:28.382274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Getting quotas for user f8b9d723cf9f4786a444cc1a33857abb and project b9790689725747ce8c1b18cdefb12c85. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:28.414554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:49:28.423864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:49:28.446005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:28.446900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:28.462346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.465489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.483067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.484069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:28.486942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:28.487604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:28.577852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ef0bdb2-dcd5-4592-98d8-bd0ad09135b8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.596872 Oct 19 00:49:28.580972 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 624/1308] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:49:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:49:28.614423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-982698fb-1e73-4b77-8964-c1092ba7f0c7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4dd9550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:28.754517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-982698fb-1e73-4b77-8964-c1092ba7f0c7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.170032 Oct 19 00:49:28.776345 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 625/1309] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:28 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:28.809977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-34d64d68-90ea-4d8b-b712-ed80778b5e86 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:28.810613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-34d64d68-90ea-4d8b-b712-ed80778b5e86 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:28.968372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:28.984907 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f86fff14-0adb-46f4-bbea-0d7a5c2d258e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1470 microversion: 2.1 time: 0.544127 Oct 19 00:49:28.998932 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 685/1310] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:28 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1470 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:29.014904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34d64d68-90ea-4d8b-b712-ed80778b5e86 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:29.019443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-191714922", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:29.024109 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-34d64d68-90ea-4d8b-b712-ed80778b5e86 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1216 microversion: 2.1 time: 0.242361 Oct 19 00:49:29.029185 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 626/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:28 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1216 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:29.142813 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] validate_networks() for [('71a16a2e-75bd-4080-b95d-7bbf65754e6a', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:49:29.255197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:29.256688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:29.268338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:29.287633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:29.288268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:29.291023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:29.294786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:29.297054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:30.680364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:30.694224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:30.698204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:30.701930 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e976d20-8f5e-43ab-8ba0-069512287262 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 1.451105 Oct 19 00:49:30.702940 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 627/1312] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:29 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:49:30.717720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:30.720866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:30.727413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:30.728168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:30.729131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:30.730078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:30.730740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:30.731589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:30.769936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2186982e-b5ed-4093-88b4-27cf9fefa149 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064940 Oct 19 00:49:30.771172 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 628/1313] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:30 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:30.775994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bfd31f-98ce-4bd1-8214-d862c74e8247", "name": "network-vif-plugged", "status": "completed", "tag": "d17e1f5f-3261-4df3-8cf7-372e2857c241"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:30.800778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:30.801573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:30.804910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:30.817289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] Creating event network-vif-plugged:d17e1f5f-3261-4df3-8cf7-372e2857c241 for instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 on n-h1-master-1 Oct 19 00:49:30.822830 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1a0a91ae-63fe-456a-8ab6-435530ab014b req-e81e1d5a-276c-46ef-8250-d010824a9f28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050164 Oct 19 00:49:30.825007 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 629/1314] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:30.831643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5c14e5a-53df-4964-bc24-f025338c69ad tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ddfaf0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:30.888234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5c14e5a-53df-4964-bc24-f025338c69ad tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.061448 Oct 19 00:49:30.889583 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 630/1315] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:30 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:30.895790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:30.896773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:30.906210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:30.907427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:30.907976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:30.908854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:30.909423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:30.909990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:31.482983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:49:31.484030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:49:31.484837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:49:31.485813 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:49:31.486438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:49:31.503896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:31.504756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:31.505377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:31.506649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:31.507479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:31.508132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:31.531697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:49:31.538661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for user 2ab51886a81f4e1194e0c1ac50eef9d4 and project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:49:31.559720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:49:31.562645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:49:31.646421 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a24073a-048f-4fb6-a408-735015f3432d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.659256 Oct 19 00:49:31.647976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 686/1316] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:49:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:49:31.674944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:31.675772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:31.711320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:31.712890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:31.713602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:31.715647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:31.716644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:31.717345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:31.970406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:31.981442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3c45f39-7529-4a3e-8c26-9039f905b89e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1274 microversion: 2.1 time: 0.326652 Oct 19 00:49:32.002361 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 687/1317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:31 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1274 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:32.023081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1370f09-68d7-4c69-a60b-2f4018d8da5d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:32.023719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1370f09-68d7-4c69-a60b-2f4018d8da5d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:32.031597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:32.040271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-197c79ff-566d-4700-b849-5a971c0d2d7d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 1.148997 Oct 19 00:49:32.062626 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 631/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:30 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:32.075240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:32.087134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:32.104228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:32.105611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:32.109395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:32.110493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:32.111175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:32.111831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:32.262377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1370f09-68d7-4c69-a60b-2f4018d8da5d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:32.274225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1370f09-68d7-4c69-a60b-2f4018d8da5d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1224 microversion: 2.1 time: 0.270368 Oct 19 00:49:32.296945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 688/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:32 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1224 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:32.302676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:32.305622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:32.315202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:32.315971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:32.316588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:32.317613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:32.318299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:32.318906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:32.393472 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a2947175-508a-4c0b-a42f-d3e88da11a24 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094878 Oct 19 00:49:32.397950 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 689/1320] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:32 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:32.410477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-acd8529f-e361-45db-9324-203267c1ce97 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af58c1820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:32.484128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-acd8529f-e361-45db-9324-203267c1ce97 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.077674 Oct 19 00:49:32.485592 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 690/1321] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:32 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:32.753871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:32.769045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:32.772961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:32.786146 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d446fb0-09d9-4834-af26-5776d06e7949 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1362 microversion: 2.25 time: 0.722058 Oct 19 00:49:32.787421 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 632/1322] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:32 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1362 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:33.010169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:33.011099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:33.037773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.038290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.038745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.039492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.039961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.040398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.070787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:33.071413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:33.086162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.099900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.101391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.105249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.109724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.110202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.517231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:33.529299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b41f6b4b-3524-434c-9616-1abb7d96b674 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1274 microversion: 2.1 time: 0.523476 Oct 19 00:49:33.534222 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 691/1323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:33 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1274 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:33.541058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:33.545209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:33.562681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.563196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.563650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.564403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:33.564914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:33.565358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:33.880033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:33.923645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6c0e144-1177-4a03-ab84-6233b5a8c176 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1276 microversion: 2.1 time: 0.387651 Oct 19 00:49:33.945527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:33.953370 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 692/1324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:33 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1276 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:33.967104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:34.002629 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-69e04484-1380-428e-b495-caf6e6ed1001 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.935642 Oct 19 00:49:34.009165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:34.038099 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 633/1325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:33 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:49:34.056817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0cffc9f-5d00-46ba-a060-bde8e429f30a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4d84b80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:34.057096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.057860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.058365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.059484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.060103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.062433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.214421 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0cffc9f-5d00-46ba-a060-bde8e429f30a tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.173522 Oct 19 00:49:34.233787 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-896fa192-8e95-481f-b727-a9aebab6fd9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.276815 Oct 19 00:49:34.235194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 634/1326] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:34 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:34.253025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 693/1327] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:49:33 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3/os-volume_attachments => generated 25 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:49:34.258084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:34.261152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:34.287098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.288357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.289378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.290867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.291995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.293540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.572993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:34.573680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:34.589703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.590733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.590733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.591219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:34.591681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:34.592108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:34.902719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:34.913237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:34.920456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:34.923263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e25a3b7e-dca2-4c4a-b364-a406ec199b27 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1558 microversion: 2.25 time: 0.686249 Oct 19 00:49:34.929620 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 635/1328] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:34 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1558 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:35.015908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:35.016879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:35.027641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.030064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.031801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.035950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.040340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.041644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.259565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:35.277984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41b8b8ba-5baf-4a65-bda5-a1e032a07b4a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1282 microversion: 2.1 time: 0.266439 Oct 19 00:49:35.280795 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 636/1329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:34 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1282 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:35.288784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:35.291362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:35.305432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:35.310280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.311213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.311970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.313866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.314993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.315124 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-206ab1aa-ceaa-4510-ad8b-03a5cb3d00f8 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1316 microversion: 2.1 time: 0.745998 Oct 19 00:49:35.315603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 694/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:34 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:49:35.316262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.334272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:35.334900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:35.367769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.368303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.368784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.374077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:35.378337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:35.380171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:35.887669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:35.941695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca8fbcdb-ce2c-4be3-a07f-7a50279e1ed8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 2051 microversion: 2.25 time: 0.659051 Oct 19 00:49:35.964817 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 637/1331] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:35 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 2051 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:35.964817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9df1cdc-a1e0-47a8-9816-9150a6389087 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ddfd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:35.975868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:35.991501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22d5fa12-7c00-4110-bc00-062fe0235f0d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.674760 Oct 19 00:49:35.992470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 695/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:35 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:36.011766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:36.021381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:36.042701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.045722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.053878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:36.063560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.065012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.066115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:36.139175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9df1cdc-a1e0-47a8-9816-9150a6389087 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1424 microversion: 2.1 time: 0.186497 Oct 19 00:49:36.141600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 638/1333] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:35 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1424 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:36.308389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:36.309064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:36.340134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.340685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.341145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:36.342093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.342489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.342935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:36.583048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:36.597723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-485699b4-8db6-467b-91b0-95dce9890447 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1282 microversion: 2.1 time: 0.293707 Oct 19 00:49:36.599713 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 639/1334] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:36 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:49:36.609901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:36.610463 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:36.626674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.627190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.627642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:36.628434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:36.645536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:36.646131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:37.584918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:37.638345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-49f7734e-4580-4206-b633-f213126a7044 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 2051 microversion: 2.25 time: 1.637627 Oct 19 00:49:37.639576 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 696/1335] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:35 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 2051 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:37.653590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:37.654767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:37.677812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:37.680690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:37.681440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:37.684595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:37.685435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:37.686077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:37.804167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:37.832990 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7949320f-4e0e-4a34-b012-e7a45cefc15c tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1316 microversion: 2.1 time: 1.232079 Oct 19 00:49:37.859067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 640/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:36 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1316 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:37.898395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b6a6ca0-086e-441f-9a02-8e0b28496046 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4e175e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:38.276263 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:38.383196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:38.410194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aae3970b-a0e0-4395-a55e-8d1bd44f2b1a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.769071 Oct 19 00:49:38.412203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 697/1337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:37 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:38.551796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10142486-98f2-4e41-aab8-9ccb7cb3d12c", "tag": "69e5a7a4-b188-4d92-9909-e60faffd5ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:38.580382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:38.581892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:38.583401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:38.654472 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] Creating event network-changed:69e5a7a4-b188-4d92-9909-e60faffd5ad2 for instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c on n-h2-master-1 Oct 19 00:49:38.680790 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d9251e3b-236f-467c-bc93-359e84c090e5 req-271291d6-3f81-41a2-8817-b30d686e2cc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265638 Oct 19 00:49:38.687713 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 698/1338] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:38.719273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:38.721001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:38.735050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:38.735914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:38.737406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:38.739044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:38.739708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:38.741158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:39.019737 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:39.719104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:39.735610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-facf6514-1db9-43a1-8c71-dc7e41bcb5a0 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 1.034096 Oct 19 00:49:39.737287 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 699/1339] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:38 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:39.744443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:39.751299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:39.752107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:39.752839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:39.753853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:39.754506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:39.757362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:39.798170 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-88703592-993a-442e-9467-19a6ff206313 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.059547 Oct 19 00:49:39.799296 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 700/1340] 10.222.0.27 () {60 vars in 1217 bytes} [Wed Oct 19 00:49:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:49:39.804151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:39.805049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:39.812213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:39.813075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:39.813724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:39.815110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:39.815807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:39.816453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:40.275492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:40.280467 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:40.301713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bc044f9-8d91-464e-bc92-d7e8fd74e66f tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1316 microversion: 2.1 time: 0.499927 Oct 19 00:49:40.303401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 701/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:39 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:40.311821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a87cb280-81ca-4d80-8889-aed0d383d5af"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:40.324700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:40.336308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:40.339728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:40.340443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:40.343766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:40.344480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:40.345156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:40.919523 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29bde498-011e-435c-834f-9cc1bf96c516 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "POST /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614335 Oct 19 00:49:40.920221 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 702/1342] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 00:49:40 2022] POST /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments => generated 194 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:40.961143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:40.966793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:40.987503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:40.989727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:40.990816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:40.992133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:40.997158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:40.997889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.396421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:41.407176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-062509a0-2664-404c-a4ea-847508e1fa91 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.464385 Oct 19 00:49:41.411534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 703/1343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:40 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:41.417087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d36caa6-279a-427a-b584-794e5fc67754", "tag": "e708a57f-7027-462d-9e98-aaf7ac1b5104"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:41.428728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.429627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.430852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.445019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] Creating event network-changed:e708a57f-7027-462d-9e98-aaf7ac1b5104 for instance 6d36caa6-279a-427a-b584-794e5fc67754 on n-h1-master-1 Oct 19 00:49:41.451536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-394e81f2-5651-46ea-882f-025016eb6d9c req-b4e985c7-6f07-4e02-88b5-1346a4c90529 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038363 Oct 19 00:49:41.452963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 704/1344] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:41.460819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:41.461928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:41.470868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.471821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.472577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.473741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.474704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.475568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.579733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62065768-9a22-408a-8b75-e1dc5da3ce80 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247/action" status: 202 len: 0 microversion: 2.25 time: 0.124037 Oct 19 00:49:41.586152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 705/1345] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:49:41 2022] POST /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:41.598583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:41.599700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:41.611229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.612450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.612450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.613858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.614967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.617841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.837834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:41.853663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64eb6919-8d49-44d4-92cf-ac80d3d3f60d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 0.262562 Oct 19 00:49:41.862691 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 706/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:41 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:41.869701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:41.871848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:41.881336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.882431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.883056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:41.884054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:41.884920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:41.892203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:42.187520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:42.197816 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce12ba5b-4462-4e50-87c3-336d36186113 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1316 microversion: 2.1 time: 0.333477 Oct 19 00:49:42.200988 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 707/1347] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:41 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1316 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:42.206752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:42.207391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:42.216313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:42.216919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:42.217376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:42.218122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:42.218586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:42.219011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:42.363216 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:42.777356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:42.793580 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff68f3bb-5f67-47ae-9637-07a2a3db4706 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 2056 microversion: 2.25 time: 0.591388 Oct 19 00:49:42.808061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 708/1348] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:42 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 2056 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:42.828651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:42.839637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:42.878368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:42.880098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:42.883690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:42.896693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:42.905103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:42.906284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:43.288662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:43.299551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e10c6aae-e9bc-4071-8f7d-600fda52d260 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.494389 Oct 19 00:49:43.300806 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 709/1349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:42 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:43.309339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:43.310223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:43.332092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:43.334926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:43.340139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:43.342363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:43.345923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:43.346468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:43.752074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:43.766126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b92c9bc-20cc-498f-a25c-39b58e3a56d4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 0.463905 Oct 19 00:49:43.767585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 710/1350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:43 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:43.773471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:43.791404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:43.831288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:43.832337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:43.833734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:43.837213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:43.840727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:43.841609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:44.204788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:44.222707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f74858e-c98a-4276-860f-bbda89f68568 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1316 microversion: 2.1 time: 0.453439 Oct 19 00:49:44.240691 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 711/1351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:43 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:44.246226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:44.250110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:44.283274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:44.284301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:44.285205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:44.286541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:44.287478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:44.315631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:44.827922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:44.880554 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-412ae673-e8d3-45dc-b62e-8770a24a9c41 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 2036 microversion: 2.25 time: 0.637767 Oct 19 00:49:44.888603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 712/1352] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:44 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 2036 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:44.909805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10142486-98f2-4e41-aab8-9ccb7cb3d12c", "name": "network-vif-plugged", "status": "completed", "tag": "69e5a7a4-b188-4d92-9909-e60faffd5ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:44.964819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:44.969166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:44.971695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:45.010960 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] Creating event network-vif-plugged:69e5a7a4-b188-4d92-9909-e60faffd5ad2 for instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c on n-h2-master-1 Oct 19 00:49:45.043295 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b8b801eb-97bc-4419-9316-62ab9715b3ba req-688dfda2-c6ec-4f79-97ac-ef4fbae69a98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146919 Oct 19 00:49:45.046753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 713/1353] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:45.065373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:45.066488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:45.103108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:45.111415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:45.119750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:45.121875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:45.126781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:45.127321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:45.687274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:45.723288 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c35795c-e530-436e-92f9-466439126bb7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.673510 Oct 19 00:49:45.737248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 714/1354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:45 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:45.763175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:45.763890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:45.794713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:45.800100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:45.800906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:45.801960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:45.802547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:45.803193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:46.163728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:46.188352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9c1ee9b-e745-4a21-9fad-b86b29e77c3c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 0.449134 Oct 19 00:49:46.201140 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 715/1355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:45 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:46.212121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:46.228407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:46.256642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:46.258545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:46.259697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:46.264401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:46.265669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:46.266682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:46.374033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'flavor' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:46.387168 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:46.429800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Going to try to live migrate instance to n-h2-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:49:46.625987 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:47.828301 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=64 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:49.768975 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:51.579271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-47110f98-4641-4156-88f0-5ad264a72fb8 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247/action" status: 202 len: 0 microversion: 2.25 time: 5.376216 Oct 19 00:49:51.586610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 716/1356] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:49:46 2022] POST /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247/action => generated 0 bytes in 5384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:51.594278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:51.597171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:51.619547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:51.621930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:51.624150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:51.626076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:51.631040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:51.633486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.051405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:52.065810 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06ddd0e4-b2d6-4c9f-805e-b7f27e6440e2 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1503 microversion: 2.1 time: 0.476811 Oct 19 00:49:52.068488 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 717/1357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:51 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1503 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:52.074949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:52.075672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:52.083030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.084100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.084840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.087341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.088080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.089320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.483885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:52.500989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-792ad7f2-6703-4e07-ae9c-8f3f9cd68c66 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.431245 Oct 19 00:49:52.501811 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 718/1358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:52 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:52.506632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:52.507258 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:52.524579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.525478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.526726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.527441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.527922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.528357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.849372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:52.864368 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-015fc129-b4e2-4d30-aafa-a1182672aff6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 0.361424 Oct 19 00:49:52.880479 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 719/1359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:52 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:52.880479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d36caa6-279a-427a-b584-794e5fc67754", "name": "network-vif-plugged", "status": "completed", "tag": "e708a57f-7027-462d-9e98-aaf7ac1b5104"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:52.883491 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:52.886548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.887535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.888666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.912354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] Creating event network-vif-plugged:e708a57f-7027-462d-9e98-aaf7ac1b5104 for instance 6d36caa6-279a-427a-b584-794e5fc67754 on n-h1-master-1 Oct 19 00:49:52.918705 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-00e5e842-995e-4442-9e8d-7bd708df3f9f req-786b8a67-3c43-4a57-abd9-69c523c0a8f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051364 Oct 19 00:49:52.919336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 720/1360] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:52.930321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:52.930723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:52.953164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.071395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b6a6ca0-086e-441f-9a02-8e0b28496046 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1433 microversion: 2.1 time: 15.210636 Oct 19 00:49:53.085320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 641/1361] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:37 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1433 bytes in 15214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:53.085320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.085320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.095355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.095927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.098566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.100581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.100581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.100581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.169886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:49:53.258923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.281089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.284005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.287277 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-337748ae-f625-4b88-a672-bba087f07f97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.363241 Oct 19 00:49:53.288368 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 721/1362] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:52 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:53.295881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb7bd06e-fa92-4947-8ed8-b4285ebd2532 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af56743a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.378681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb7bd06e-fa92-4947-8ed8-b4285ebd2532 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 200 len: 1433 microversion: 2.1 time: 0.088859 Oct 19 00:49:53.379799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 722/1363] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 1433 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:53.391067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc99a6eb-e207-451c-ab1a-919620756420 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 204 len: 0 microversion: 2.1 time: 0.313806 Oct 19 00:49:53.399116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.402603 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 642/1364] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:49:53 2022] DELETE /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:53.404866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.412863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.413847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.439611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.441128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.441767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.442330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.442830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.443014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.443269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.444145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.444403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.444524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.445146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.451088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.816793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.833047 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d804f0b3-c6e3-4c42-b841-02bf6e079fd2 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1480 microversion: 2.1 time: 0.441043 Oct 19 00:49:53.835541 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 723/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1480 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:49:53.843973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.847700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.853724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:53.867054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.868127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.869178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.870447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.871216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.871345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ace8888-4ac9-4336-80f5-80c5a7427489 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1509 microversion: 2.1 time: 0.458470 Oct 19 00:49:53.875213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.887476 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 643/1366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:53.893457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:53.894466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:53.902234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.903054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.903693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:53.904811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:53.905560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:53.906247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.440853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:54.452694 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86b9928d-9795-4e50-a56e-0f2070cedd82 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1324 microversion: 2.1 time: 0.563087 Oct 19 00:49:54.453361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:54.454298 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 644/1367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1324 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:49:54.460836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:54.461710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:54.468730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.469579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.470314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.471635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.472334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.473021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.479295 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ab6949b-cdfc-4378-946e-c594408f23f6 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.641906 Oct 19 00:49:54.505106 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 724/1368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:53 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:54.764555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:54.779507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:54.781765 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:54.783373 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76d0c93d-c075-4edc-bfe0-5a218880592e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.327721 Oct 19 00:49:54.784560 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 645/1369] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:54 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:54.875419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:54.878782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:54.901836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:54.903534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:54.914847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.916165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.920548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.934705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.936079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.937582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.947197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.948914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.953094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:54.959636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:54.961336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:54.962397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:55.467592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:55.481809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc10d0c8-e6d6-4e34-af00-93e0dda7ab88 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1467 microversion: 2.1 time: 0.620722 Oct 19 00:49:55.483358 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 725/1370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:54 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1467 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:55.510988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:55.511853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:55.513735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:55.528216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:55.529637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-813dcb60-2942-42bf-b74d-316e0403ffdd tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1509 microversion: 2.1 time: 0.637485 Oct 19 00:49:55.530642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:55.530875 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 646/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:54 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:55.532152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:55.533574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:55.535754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:55.536309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-551bce21-f415-4cf9-b137-8ecbcffc5692 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4dc00d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:55.537158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:55.638184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-551bce21-f415-4cf9-b137-8ecbcffc5692 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340" status: 200 len: 784 microversion: 2.1 time: 0.106101 Oct 19 00:49:55.639942 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 647/1372] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:55 2022] GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340 => generated 784 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:55.647793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:55.655813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:55.666752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:55.667270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:55.670794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:55.672653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:55.674951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:55.676577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.016439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.026695 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-755f0b31-bd39-40a0-b876-d8414d339a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1520 microversion: 2.1 time: 0.528100 Oct 19 00:49:56.028270 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 726/1373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:55 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1520 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:56.034482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c856327a-bafc-4d3b-8c36-f4b799002c80 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:56.054706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c856327a-bafc-4d3b-8c36-f4b799002c80 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024712 Oct 19 00:49:56.056177 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 727/1374] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:49:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:56.062250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:56.063586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:56.084566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.090787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.093257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.095983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.097092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.098291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.118631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.130415 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a909d03-9938-46a2-8227-31394fa43ea7 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.488778 Oct 19 00:49:56.132657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 648/1375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:55 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:56.140294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bfd31f-98ce-4bd1-8214-d862c74e8247", "name": "network-vif-unplugged", "status": "completed", "tag": "d17e1f5f-3261-4df3-8cf7-372e2857c241"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:56.153279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.154609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.155435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.170050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] Creating event network-vif-unplugged:d17e1f5f-3261-4df3-8cf7-372e2857c241 for instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 on n-h1-master-1 Oct 19 00:49:56.176737 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-87a4dcbe-556b-48ef-b45d-aca4d6a65b57 req-f75408aa-adae-492a-b36f-718c7fa75ad2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042054 Oct 19 00:49:56.177643 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 649/1376] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:56.185272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b10added-1e94-45f8-b8a4-4db556e46c34 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ff41f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:56.459105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.478275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.482469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:56.485285 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9cafb00e-021c-429a-aafa-33014433136d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.426806 Oct 19 00:49:56.504934 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 728/1377] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:56 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:56.513037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:56.513896 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:56.546310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.548012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.553587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:56.564673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:56.587464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:56.595264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.464142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:57.477498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54c369f7-0c3b-4973-bb80-195dff02f2cf tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1520 microversion: 2.1 time: 0.968394 Oct 19 00:49:57.478339 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 729/1378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:56 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1520 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:57.492058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:57.494217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:57.510738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.514247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.514985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.518772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.522381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.524215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.582000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b10added-1e94-45f8-b8a4-4db556e46c34 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "DELETE /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 204 len: 0 microversion: 2.1 time: 1.402841 Oct 19 00:49:57.585204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 650/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:56 2022] DELETE /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 0 bytes in 1406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:57.594057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:57.598829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:57.621295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.622180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.622979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:57.632720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:57.633676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:57.634495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.319456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:58.355593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94373538-2dde-4fe3-a9b5-4d4cf0bf0826 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1467 microversion: 2.1 time: 0.873130 Oct 19 00:49:58.380404 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 730/1380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:57 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1467 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:58.415364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2099088811"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:58.420466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:58.432969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.434490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.435161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.436146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.436822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.437452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.535815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:58.568392 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c88e5ba9-f553-4d4a-9b08-b66e9c310cf8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.981076 Oct 19 00:49:58.569081 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 651/1381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:57 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:49:58.591460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:58.592351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:58.601888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.607337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.608847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.612636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:58.613220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:58.613977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:58.970040 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af592c06-11d4-4274-ba56-f401ed974c3b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754/action" status: 202 len: 0 microversion: 2.1 time: 0.587106 Oct 19 00:49:58.988226 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 731/1382] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:58 2022] POST /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 00:49:58.999210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-884b8905-848d-40cd-b64f-37931baf918f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af5674ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:59.028579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:59.062509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:59.068264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:49:59.069408 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-884b8905-848d-40cd-b64f-37931baf918f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] HTTP exception thrown: Image not found. Oct 19 00:49:59.070319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3fba925-49c6-4709-8ced-2b56c914d1f3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.495240 Oct 19 00:49:59.071705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 652/1383] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:49:58 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:49:59.080243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-unplugged", "status": "completed", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:59.094007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.094501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.100297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-884b8905-848d-40cd-b64f-37931baf918f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Request method failure captured: Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 HTTP/1.1 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0l2VGda7gByjv10PtypuoKEuziYHuI7GcngfVOMc_rl_xwUKZaB8HlrTYP-ipbxUj0ztq3ADJNscBRClRc8vTS-ARjHivHIfpidNC1xtTgDiSZVmz_9LAiofGi8qgab2Kwgz6AidkmmNhYWunyZkf58yYFsgw8Z0YAxGDpdXbWVlWo Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d60a9bdaee646508bf9f42d390191d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}] Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2a896789dc814debba3a0a8f8f0c8943 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a8939b73-7f94-43bf-8a2c-5f359fce9d28'} Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a8939b73-7f94-43bf-8a2c-5f359fce9d28 Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:49:59.114000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8939b73-7f94-43bf-8a2c-5f359fce9d28 could not be found. Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:49:59.119287 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:49:59.128684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-884b8905-848d-40cd-b64f-37931baf918f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:49:59.128684 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-884b8905-848d-40cd-b64f-37931baf918f tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 404 len: 62 microversion: 2.1 time: 0.135058 Oct 19 00:49:59.128684 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 732/1384] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:49:58 2022] GET /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 62 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:49:59.133382 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] Creating event network-vif-unplugged:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:49:59.144319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f66a9236-24a5-4429-b8e7-29f285328b9c req-fd14bb4e-9a5f-4a5f-aeb8-d13fbd0db4c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069746 Oct 19 00:49:59.146489 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 653/1385] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:59.155605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10142486-98f2-4e41-aab8-9ccb7cb3d12c", "name": "network-vif-deleted", "tag": "69e5a7a4-b188-4d92-9909-e60faffd5ad2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:59.156411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bfd31f-98ce-4bd1-8214-d862c74e8247", "tag": "d17e1f5f-3261-4df3-8cf7-372e2857c241"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:59.187230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.188481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.191117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.210340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.210897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.211351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.231840 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] Creating event network-vif-deleted:69e5a7a4-b188-4d92-9909-e60faffd5ad2 for instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c on n-h2-master-1 Oct 19 00:49:59.236457 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] Creating event network-changed:d17e1f5f-3261-4df3-8cf7-372e2857c241 for instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 on n-h1-master-1 Oct 19 00:49:59.245845 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ff651b1a-b79f-4d7a-ad74-c35368297ab7 req-2997c08f-edc1-4cb5-9982-70db3120795f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117812 Oct 19 00:49:59.246637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3fc8099a-38dd-4d05-a65f-a4093e63967d req-3de71016-bf2f-468e-9910-976b97e29732 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095729 Oct 19 00:49:59.246946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 733/1386] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:59.249736 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 654/1387] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:49:59.252375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2daf5e5a-f634-4d13-9c54-26d11c1a181e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af55db3a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:59.263526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1680153104"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:49:59.269894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:59.287332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.288951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.290131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.292888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.294048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.295176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.590461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2daf5e5a-f634-4d13-9c54-26d11c1a181e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8" status: 204 len: 0 microversion: 2.1 time: 0.339943 Oct 19 00:49:59.591732 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 734/1388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:59 2022] DELETE /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:49:59.610556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:49:59.613429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:49:59.644655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.645474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.646950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.648558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.650334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.652490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.749855 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:49:59.839795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:49:59.850273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:49:59.851194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:49:59.852004 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lazy-loading 'fault' on Instance uuid 10142486-98f2-4e41-aab8-9ccb7cb3d12c {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:49:59.993686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f8b9d723cf9f4786a444cc1a33857abb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9790689725747ce8c1b18cdefb12c85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.004725 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b36a12a6-938d-466e-bc9a-3cfead43750e tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 200 len: 1306 microversion: 2.1 time: 0.411520 Oct 19 00:50:00.005910 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 735/1389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:49:59 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 1306 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:00.028237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.029506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:00.037465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.038422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.039114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.040155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.040978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.042470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.352406 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0195dde-d3d2-4066-9fa3-932ee5c555ca tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "POST /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208/action" status: 202 len: 0 microversion: 2.1 time: 1.098809 Oct 19 00:50:00.355562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.368683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 655/1390] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:49:59 2022] POST /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208/action => generated 0 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 00:50:00.390445 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8807380-def3-40fe-9da2-ca21f30928c9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.382238 Oct 19 00:50:00.420013 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 736/1391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:00.420344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-913dc601-7597-4bf4-9305-930f14b16f39 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af4ddf820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.497315 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-913dc601-7597-4bf4-9305-930f14b16f39 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Image not found. Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-913dc601-7597-4bf4-9305-930f14b16f39 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8 HTTP/1.1 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b4b9128e-5064-49e5-8b2c-30e032c41ef8'} Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b4b9128e-5064-49e5-8b2c-30e032c41ef8 Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:50:00.512575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4b9128e-5064-49e5-8b2c-30e032c41ef8 could not be found. Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-913dc601-7597-4bf4-9305-930f14b16f39 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-913dc601-7597-4bf4-9305-930f14b16f39 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8" status: 404 len: 62 microversion: 2.1 time: 0.152505 Oct 19 00:50:00.525260 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 656/1392] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8 => generated 62 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:50:00.539357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.540710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:00.551143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.551769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.552581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.554715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.554933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.555762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.775542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c604bb65-dded-4b7b-941d-22ac5566d10e tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Action: 'create', calling method: .version_select at 0x7f2af54eca60>, body: {"keypair": {"name": "tempest-keypair-1409116758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZZ/ntJTGn3XVxfg7PXoPAPw0hv2UpXSIQvsNTtaT0YmzbtTiyGgdmGjI/Ig+y38HUjYEhzuZ6Lf92VkMaX00HfvUqRpkWZI3z3Y7/D2B9WHljcdtt6zX4JCi/FcpNPEg=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:00.808431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c604bb65-dded-4b7b-941d-22ac5566d10e tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Getting quotas for project 9bd2de014bb94e17824f48a23cd16a65. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:00.820171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c604bb65-dded-4b7b-941d-22ac5566d10e tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Getting quotas for user 85b59e131dd940b1b397f5ed429c814f and project 9bd2de014bb94e17824f48a23cd16a65. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:00.861849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.879697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.879697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:00.879697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d02777ff-20a7-49cb-bf80-a7f3a912ba20 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.354540 Oct 19 00:50:00.880567 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 657/1393] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:00.887357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6946de9-f770-45d1-9a4a-0f72ad2895f5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4e17790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.894021 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c604bb65-dded-4b7b-941d-22ac5566d10e tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.500242 Oct 19 00:50:00.896605 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 737/1394] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:50:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:00.902820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:00.904448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:00.913390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.914086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.914714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.915645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:00.916350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:00.917045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:00.992202 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6946de9-f770-45d1-9a4a-0f72ad2895f5 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.110115 Oct 19 00:50:00.994000 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 658/1395] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:01.066829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:01.068371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.104666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.105603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.106421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.107765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.128387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.130791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.202595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.219860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c HTTP/1.1 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '10142486-98f2-4e41-aab8-9ccb7cb3d12c'} Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.231183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.245138 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.246212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61b14678-fa38-4528-8f39-952aa0de459e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1532 microversion: 2.1 time: 0.340270 Oct 19 00:50:01.246212 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 738/1396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:00 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1532 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:01.246735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.246735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e41ff40d-4ddb-47b0-8eaa-8dc35b683741 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 404 len: 111 microversion: 2.1 time: 0.184230 Oct 19 00:50:01.252812 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 659/1397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:01 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:50:01.259571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-148554296", "metadata": {"image_type": "test"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:01.264924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.280382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.282819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.283883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.285649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.288274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.289402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.324742 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c/action HTTP/1.1 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 111 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-148554296", "metadata": {"image_type": "test"}}} Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '10142486-98f2-4e41-aab8-9ccb7cb3d12c', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-148554296', 'metadata': {'image_type': 'test'}}}} Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 00:50:01.326573 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69928f36-2ad4-44b9-ab18-b7135b1446b1 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "POST /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c/action" status: 404 len: 111 microversion: 2.1 time: 0.076035 Oct 19 00:50:01.335829 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 739/1398] 10.222.0.27 () {60 vars in 1279 bytes} [Wed Oct 19 00:50:01 2022] POST /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c/action => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:01.346105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1017211796", "metadata": {"image_type": "test"}}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:01.349875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Failed to fetch instance by id tempest-invalid-358354669 {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 00:50:01.350779 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance tempest-invalid-358354669 could not be found. Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/tempest-invalid-358354669/action HTTP/1.1 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 112 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1017211796", "metadata": {"image_type": "test"}}} Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: exception: Instance tempest-invalid-358354669 could not be found. Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'tempest-invalid-358354669', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1017211796', 'metadata': {'image_type': 'test'}}}} Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-358354669 could not be found. Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.353106 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-358354669 could not be found. Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-358354669 could not be found. Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance tempest-invalid-358354669 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd40cff7-cd9f-4dec-906b-d276fc49e5d5 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-358354669/action" status: 404 len: 100 microversion: 2.1 time: 0.014372 Oct 19 00:50:01.369210 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 660/1399] 10.222.0.27 () {60 vars in 1246 bytes} [Wed Oct 19 00:50:01 2022] POST /compute/v2.1/servers/tempest-invalid-358354669/action => generated 100 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:01.372099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1646015675"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:01.373135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 00:50:01.375181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 57 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: {"createImage": {"name": "tempest-test-snap-1646015675"}} Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1646015675'}}} Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.377667 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cee9043e-705a-4d0d-a262-1641e57f0049 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.014350 Oct 19 00:50:01.392886 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 740/1400] 10.222.0.27 () {60 vars in 1275 bytes} [Wed Oct 19 00:50:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:01.404248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2082846435"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:01.411336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 00:50:01.413305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 57 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: {"createImage": {"name": "tempest-test-snap-2082846435"}} Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2082846435'}}} Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.417002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5967cf3-94e0-4ba6-9f7d-789684adcbf9 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032926 Oct 19 00:50:01.428870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 661/1401] 10.222.0.27 () {60 vars in 1281 bytes} [Wed Oct 19 00:50:01 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:50:01.440038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:01.441259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.442399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:01.443339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.454461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.455371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.456543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.457575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.458264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.458920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.459284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.460978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.462414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.465817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.466698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.467593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.507379 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c HTTP/1.1 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '10142486-98f2-4e41-aab8-9ccb7cb3d12c'} Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.511053 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.515605 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f308dc48-45b6-45f8-b11d-e89276c92b83 tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "DELETE /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 404 len: 111 microversion: 2.1 time: 0.083900 Oct 19 00:50:01.520861 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 662/1402] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:01 2022] DELETE /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:50:01.539882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:01.542420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] [instance: 10142486-98f2-4e41-aab8-9ccb7cb3d12c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.555594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.557781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.559145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.560996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.562522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.564164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.605872 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] HTTP exception thrown: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Request method failure captured: Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c HTTP/1.1 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0mVcMbnBGtnLgjcNqeRoDzaJ36oyipZEK1Fa2vkIFSgGhJERLgyVkKu5JnZhGxwqRwioS3IkXDEMGvKDqs-xdtnv6TthYlLGSEnTTUKMFqxLI57-idQfXJ9wVhlSKK985vYh2LOifcU2NX52CCsLPhEvK-_ZrFs2TqXd8JxDLFoBSM Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9790689725747ce8c1b18cdefb12c85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9790689725747ce8c1b18cdefb12c85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9790689725747ce8c1b18cdefb12c85"}]}] Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b9790689725747ce8c1b18cdefb12c85 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-425210085 Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f8b9d723cf9f4786a444cc1a33857abb Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesNegativeTestJSON-425210085-project Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '10142486-98f2-4e41-aab8-9ccb7cb3d12c'} Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:01.608727 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. Oct 19 00:50:01.613732 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:01.615610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] Returning 404 to user: Instance 10142486-98f2-4e41-aab8-9ccb7cb3d12c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:01.617637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bdc73d5d-500b-4e6f-a521-441b48c1e3ce tempest-ImagesNegativeTestJSON-425210085 tempest-ImagesNegativeTestJSON-425210085-project] 10.222.0.27 "GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c" status: 404 len: 111 microversion: 2.1 time: 0.094977 Oct 19 00:50:01.628895 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 663/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:01 2022] GET /compute/v2.1/servers/10142486-98f2-4e41-aab8-9ccb7cb3d12c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:01.779612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:01.843094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08e463a0-1a14-4a1b-8e54-fe049c01715d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1475 microversion: 2.1 time: 0.392281 Oct 19 00:50:01.845760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 741/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:01 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1475 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:01.910937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:01.911565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:01.927181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.927596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.934505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:01.935241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:01.942120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:01.942999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.021105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-676e11c6-0307-4edf-a44e-c9068ce66719 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af5478430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:02.138922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-676e11c6-0307-4edf-a44e-c9068ce66719 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.129089 Oct 19 00:50:02.157144 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 742/1405] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:02 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:02.268125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:02.272138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:02.303018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.307653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.310623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.315912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.316665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.318509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.826552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:02.854751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:02.865365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:02.879413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f79cd645-fbc1-4d41-9d83-db424619abca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.972171 Oct 19 00:50:02.880473 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 664/1406] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:01 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:02.923375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:02.925654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:02.949145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.950171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.950811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.951784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:02.952454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:02.953104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:02.974241 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:02.997227 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf897b19-184d-4982-8010-27c3ab826f27 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083115 Oct 19 00:50:02.998136 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 665/1407] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:50:02 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:03.010702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:03.011755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:03.019965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.020894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.021675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.022737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.023421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.024057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.506630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:03.523111 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c4ad6fd3-ac53-43a0-9824-492aca589c42 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1538 microversion: 2.1 time: 1.261079 Oct 19 00:50:03.524417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 743/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:02 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1538 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:03.545583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:03.546597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:03.566603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.567557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.568269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.573433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:03.574801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:03.575506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:03.794197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lazy-loading 'services' on Instance uuid c98cca62-8e30-4c84-a431-4a0c1138ac18 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:03.998301 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07601146-6625-447e-89a8-bb970d1e595d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments/a87cb280-81ca-4d80-8889-aed0d383d5af" status: 202 len: 0 microversion: 2.1 time: 0.471662 Oct 19 00:50:03.999374 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 744/1409] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 00:50:03 2022] DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments/a87cb280-81ca-4d80-8889-aed0d383d5af => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:04.026738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3f93afa-d906-42b4-9033-04fd2071b336 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af5556a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:04.138351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3f93afa-d906-42b4-9033-04fd2071b336 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.136421 Oct 19 00:50:04.148086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 745/1410] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:03 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:04.168087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:04.173937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:04.219436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:04.225425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:04.226089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:04.227144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:04.230519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:04.231669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:04.545529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:04.583034 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3387f888-3eff-45b6-b002-d6c061a41f32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1474 microversion: 2.1 time: 1.575125 Oct 19 00:50:04.594923 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 666/1411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:03 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1474 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:04.613411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:04.614932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:04.635130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:04.650914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:04.651979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:04.654222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:04.655453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:04.656531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:05.540309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:05.564987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:05.574780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:05.579422 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-457e0ec0-6bf7-480a-9939-494fe7845886 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 1.427493 Oct 19 00:50:05.584448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 746/1412] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:04 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:05.607744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ba95452f-b5cd-4095-b7af-e30f75499880 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af5478af0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:05.770045 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ba95452f-b5cd-4095-b7af-e30f75499880 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.178043 Oct 19 00:50:05.772077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 747/1413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:05 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:05.785003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:05.786821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:05.801002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:05.802444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:05.803752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:05.805627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:05.806971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:05.808136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.642330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:06.700709 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac1be8dd-e0af-40c4-a2c7-41daeda1cdfb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1538 microversion: 2.1 time: 2.103780 Oct 19 00:50:06.719644 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 667/1414] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:04 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1538 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:06.747769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:06.814961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.817549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.819977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.832424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:06.847478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-488cffde-29f3-410a-b80b-9b890079a2f9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1474 microversion: 2.1 time: 1.073298 Oct 19 00:50:06.852298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 748/1415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:05 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1474 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:06.867007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:06.867656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:06.890320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.890754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.891215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.891977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:06.892450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:06.893375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:06.906921 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Creating event network-vif-unplugged:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h2-master-1 Oct 19 00:50:06.970681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:50:07.085899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-86a92e89-3726-49b9-922f-cea2ad0786a7 req-673af161-8a86-42e6-8e41-59fd5011d2f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.359876 Oct 19 00:50:07.091707 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 668/1416] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:07.130551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b84acaf-dffc-4058-ac2c-208bb69ac699 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4e4ea60>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:07.301934 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b84acaf-dffc-4058-ac2c-208bb69ac699 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.199287 Oct 19 00:50:07.303008 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 669/1417] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:07 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:07.441012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:07.455589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:07.466082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:07.467907 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-66401af1-a343-41e7-86c4-e9c7c7bdddc5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1568 microversion: 2.25 time: 0.613322 Oct 19 00:50:07.469712 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 749/1418] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:06 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1568 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:07.746199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:07.760005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:07.787594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.788133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.788454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.797278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.797778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.798241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.878483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:07.879116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:07.891723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.897914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.901369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:07.902841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:07.904267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:07.909881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:09.017443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:09.052069 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c37f87cb-26e8-4c1f-a225-af0a2dfc3b57 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1520 microversion: 2.1 time: 1.314958 Oct 19 00:50:09.053323 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 670/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:07 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1520 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:09.066451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "17d8b892-35ed-4c26-aaf5-aa2f7950a2ae"}], "security_groups": [{"name": "tempest-securitygroup--872679650"}], "key_name": "tempest-keypair-1409116758", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:09.098688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:09.110991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-905f04bf-f567-4263-b29a-55c3ac1ea6d4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1474 microversion: 2.1 time: 1.237601 Oct 19 00:50:09.136952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 750/1420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:07 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1474 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:09.143569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dda29b60-4fe0-41c5-9af0-8c24f4b946c8 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af55633a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:09.322702 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dda29b60-4fe0-41c5-9af0-8c24f4b946c8 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.184515 Oct 19 00:50:09.324061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 751/1421] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:09 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:09.354841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:09.354841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:09.374685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:09.375564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:09.376121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:09.378621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:09.386073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:09.386913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:09.564045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] validate_networks() for [('17d8b892-35ed-4c26-aaf5-aa2f7950a2ae', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:50:10.549559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:10.561059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:10.585835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:10.587352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3cd18f95-bfd2-46d2-bc3e-adce04e90000 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1543 microversion: 2.25 time: 1.255248 Oct 19 00:50:10.589635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 752/1422] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:09 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1543 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:10.600220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:10.610478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:10.632936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:10.638889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:10.639377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:10.640164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:10.640685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:10.641118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:10.764324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:10.950039 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:11.070629 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39a97fa9-3059-407c-bb0e-3b67c4b63cdb tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 204 len: 0 microversion: 2.1 time: 0.473456 Oct 19 00:50:11.071825 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 753/1423] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:10 2022] DELETE /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:11.090875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:11.104167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.104809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.105890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.128047 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Creating event network-changed:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h2-master-1 Oct 19 00:50:11.135765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:50:11.152967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-509109d7-222f-4b85-9c28-cb4a39fb5971 req-53c55d59-2c7e-48ca-84fe-72b1bca49770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073398 Oct 19 00:50:11.154229 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 754/1424] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:11.175996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-plugged", "status": "completed", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:11.220854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.222076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.223101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.265854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:50:11.266549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:50:11.267376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:50:11.268324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:50:11.269337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:50:11.292391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] Creating event network-vif-plugged:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:50:11.299716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.300518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.301792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.302807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.304225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-458af3ba-4328-406e-a487-dcbc9450b1e4 req-703ad80a-720a-4a5b-a382-793a3480da60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147865 Oct 19 00:50:11.304930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.305591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.310077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 755/1425] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:11.326009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:11.330893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:11.346127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.346931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.347547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.348476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.352911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.354274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.378229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Getting quotas for project 9bd2de014bb94e17824f48a23cd16a65. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:11.403314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Getting quotas for user 85b59e131dd940b1b397f5ed429c814f and project 9bd2de014bb94e17824f48a23cd16a65. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:11.469946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:50:11.472815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:50:11.619943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7e394e6-25f4-4526-9966-85db483d15cb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.564253 Oct 19 00:50:11.629601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 671/1426] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:50:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:50:11.654694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f863f4c2-00ee-4a74-9a92-efd27cd65034 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af5778e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:11.818706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f863f4c2-00ee-4a74-9a92-efd27cd65034 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.172062 Oct 19 00:50:11.819308 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 672/1427] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:11.852289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d661225c-8047-4ea1-abee-3d5b89f0ecc9 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '.version_select at 0x7f2af4e17ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:11.889120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d661225c-8047-4ea1-abee-3d5b89f0ecc9 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.893492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d661225c-8047-4ea1-abee-3d5b89f0ecc9 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.896459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d661225c-8047-4ea1-abee-3d5b89f0ecc9 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.957844 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d661225c-8047-4ea1-abee-3d5b89f0ecc9 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3810 microversion: 2.25 time: 0.133792 Oct 19 00:50:11.958854 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 673/1428] 10.222.0.27 () {60 vars in 1184 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/os-migrations => generated 3810 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:11.964683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:11.965315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:11.975417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:11.990040 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0877ac5a-b8da-41d5-98b6-2f942996689e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1474 microversion: 2.1 time: 0.678371 Oct 19 00:50:11.990656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 756/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1474 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:11.994903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.995406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.995865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:11.996596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:11.997092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:11.997534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:12.003897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8aee7b8-d8f5-43d5-ac4f-a0d1dbd0ba3b tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:12.004323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8aee7b8-d8f5-43d5-ac4f-a0d1dbd0ba3b tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:12.143370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8aee7b8-d8f5-43d5-ac4f-a0d1dbd0ba3b tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:12.161260 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8aee7b8-d8f5-43d5-ac4f-a0d1dbd0ba3b tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1226 microversion: 2.1 time: 0.161339 Oct 19 00:50:12.162546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 757/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1226 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:12.167557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:12.168446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:12.189016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:12.189662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:12.190011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:12.204077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:12.205033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:12.205707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:12.208855 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:12.762607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:12.782946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8e746627-3c18-49aa-ae18-0bb5d259e7c6 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1526 microversion: 2.1 time: 0.822906 Oct 19 00:50:12.795411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 674/1431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:11 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1526 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:12.840992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb2dc1ed-33fc-401b-80d3-d5958c1684da tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af9332790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:12.904097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 79bfd31f-98ce-4bd1-8214-d862c74e8247 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:12.950063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c0cbb684-0a59-4e49-b1be-5e6807f73969 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 2036 microversion: 2.25 time: 0.786105 Oct 19 00:50:12.950912 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 758/1432] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:12 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 2036 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:12.985028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e82d6e4-5975-4949-93ba-c1c9076b5bce tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: .version_select at 0x7f2af4f200d0>, body: {"keypair": {"name": "tempest-keypair-946116781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOXif9Vxt5bKaFuKaCYnff4yLI287ZpMwb4LIr8b5ifYA8h5ahQdx+1ZPiC93N7QrASTFyEOSxA+7DQnzdStESd7Hnd8Ko/ljsRWmEhL+hbaqsvrjDkaNvWeHqsd8MS+RA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:13.015746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2e82d6e4-5975-4949-93ba-c1c9076b5bce tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:13.024304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2e82d6e4-5975-4949-93ba-c1c9076b5bce tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for user 5d0158da7efc485ebd6a1e1db617b5e7 and project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:13.057135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb2dc1ed-33fc-401b-80d3-d5958c1684da tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.220013 Oct 19 00:50:13.057746 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 675/1433] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:12 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:13.062417 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e82d6e4-5975-4949-93ba-c1c9076b5bce tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.082204 Oct 19 00:50:13.078073 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 759/1434] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 00:50:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:50:13.089794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:13.091943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:13.110101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.111883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.114047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:13.115013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.115605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.117058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:13.190151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c588b0a-6c46-4d69-86c8-cd2244ed7abb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:13.191546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c588b0a-6c46-4d69-86c8-cd2244ed7abb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:13.374875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c588b0a-6c46-4d69-86c8-cd2244ed7abb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:13.385884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c588b0a-6c46-4d69-86c8-cd2244ed7abb tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1226 microversion: 2.1 time: 0.198621 Oct 19 00:50:13.386580 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 760/1435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:13 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1226 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:13.607545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:13.621195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37015b3b-52c9-4191-987d-6da09b28e81b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1472 microversion: 2.1 time: 0.555947 Oct 19 00:50:13.623029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 676/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:13 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1472 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:13.824276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:13.825376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:13.850977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.851895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.852581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:13.854547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:13.855822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:13.856489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:14.081748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1c495ee2-d0cd-45ce-a493-e7ccc75e0624 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4f7a1f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:14.193032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1c495ee2-d0cd-45ce-a493-e7ccc75e0624 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.115532 Oct 19 00:50:14.193948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 677/1437] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:14 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:14.414500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:14.415591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:14.449936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:14.450857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:14.451333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:14.461415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:14.469154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:14.472276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:15.500545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:15.529838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c68e0303-6b5c-4227-bcac-be8941386f7d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1278 microversion: 2.1 time: 1.116056 Oct 19 00:50:15.548825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 678/1438] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:14 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1278 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:15.563073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:15.575950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:15.592390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:15.593619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:15.594430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:15.600419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:15.601759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:15.602500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.646030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:16.663001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b27b3a9-b2ab-4e48-86f7-3fa67e8fa385 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 200 len: 1526 microversion: 2.1 time: 2.844579 Oct 19 00:50:16.664051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 761/1439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:13 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 1526 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:16.669827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-064b788b-a73b-428f-8306-5e6705fe0908 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af570db80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:16.770341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-064b788b-a73b-428f-8306-5e6705fe0908 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.104935 Oct 19 00:50:16.770949 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 762/1440] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:16 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:16.777075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d36caa6-279a-427a-b584-794e5fc67754", "name": "network-vif-deleted", "tag": "e708a57f-7027-462d-9e98-aaf7ac1b5104"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:16.788476 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:16.802922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.809562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.810233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.850046 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] Creating event network-vif-deleted:e708a57f-7027-462d-9e98-aaf7ac1b5104 for instance 6d36caa6-279a-427a-b584-794e5fc67754 on n-h1-master-1 Oct 19 00:50:16.861393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:16.870701 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9e1f876b-d172-423d-bf4f-6d87bccba57c req-0d8552ad-e77d-45a8-8f63-70f441e9af28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098254 Oct 19 00:50:16.874122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82d4b95d-c18e-4dd0-a6bb-39096d39588e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1469 microversion: 2.1 time: 1.323625 Oct 19 00:50:16.875150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 763/1441] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:16.877349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 679/1442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:15 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1469 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:16.889358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:16.890316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:16.913489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:16.914929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:16.938384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.942113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.948226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.951219 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:16.955320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.956917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.959051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.960327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.970868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.972157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:16.982341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:16.983834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:16.985079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.340385 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11049d76-d621-4f7d-a098-24bc076699a8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "POST /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80/action" status: 202 len: 0 microversion: 2.1 time: 0.437270 Oct 19 00:50:17.342205 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 680/1443] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:50:16 2022] POST /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:17.373646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:17.374869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:17.375454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:17.383314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.384051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.384935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.386911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.387611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.388244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.397763 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-caa61deb-cfb9-4381-8652-03cc24bf8b3a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1284 microversion: 2.1 time: 0.520739 Oct 19 00:50:17.416677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 764/1444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:16 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1284 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:17.688482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-plugged", "status": "completed", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:17.704380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.705227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.706176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.730173 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Creating event network-vif-plugged:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h2-master-1 Oct 19 00:50:17.740707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:50:17.769181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e639fcc1-9ab5-42af-ac31-c725b20798a9 req-f43d6799-1db7-412d-b8cc-99d57353264f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085105 Oct 19 00:50:17.771611 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 765/1445] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:17.795078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:17.796474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:17.811144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.813776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.817387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.819228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:17.822894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:17.825971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:17.874254 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 HTTP/1.1 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6d36caa6-279a-427a-b584-794e5fc67754'} Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:17.880953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:17.897194 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:17.904850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:17.907692 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58f76d77-fb60-4032-9835-f83ac05ec6b8 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 404 len: 111 microversion: 2.1 time: 0.133398 Oct 19 00:50:17.921719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:17.934794 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 766/1446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:17 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:17.938735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5e56c83-fb6b-4306-a7ba-fb4d88aa72a4 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 0.580534 Oct 19 00:50:17.939566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 681/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:17 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:17.947611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d4765c0a-9dc2-480c-ae36-c57715524d5b tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af55229d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:18.096176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d4765c0a-9dc2-480c-ae36-c57715524d5b tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.159379 Oct 19 00:50:18.098932 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 767/1448] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:17 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:18.254576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1491610775", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:18.445308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:18.445583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:18.462491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] validate_networks() for [('71a16a2e-75bd-4080-b95d-7bbf65754e6a', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:50:18.477222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:18.482881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:18.483914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:18.488002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:18.490705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:18.491158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:18.721656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:18.745602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-45c4191c-657c-411f-b8ce-ceeb99858e5d tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1284 microversion: 2.1 time: 0.301788 Oct 19 00:50:18.745602 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 768/1449] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:18 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1284 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:18.756605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-923828016", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "696b9f21-afb6-4919-9bae-ea78136fef02"}], "block_device_mapping_v2": [{"uuid": "db9d8e08-0742-469e-b35f-fa79b12c6b20", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:18.938224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] validate_networks() for [('696b9f21-afb6-4919-9bae-ea78136fef02', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:50:19.801108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:50:19.802295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:50:19.803746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:50:19.804447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:50:19.805183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:50:19.822199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:19.824061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:19.825346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:19.828302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:19.829696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:19.830853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:19.916702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:19.932646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Getting quotas for user 2ab51886a81f4e1194e0c1ac50eef9d4 and project c89259ef29e04d5e87793ae9aafdcbf9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:19.968174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:50:19.981861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:50:20.093121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d9b60d12-afa6-4338-a81f-60f62127ac9e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.843759 Oct 19 00:50:20.103291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 682/1450] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:50:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:50:20.108863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:20.109961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:20.119172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:20.120048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:20.121303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:20.124301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:20.125281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:20.126171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:20.947045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:50:20.948331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:50:20.949708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:50:20.950379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:50:20.951047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:50:20.973570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:20.976501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:20.977138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:20.980792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:20.982322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:20.983813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.033345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:21.046646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Getting quotas for user a24b98f6af634c61af828bb20ce1e945 and project a0676f376817483389300f03ed99cced. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:21.125152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:21.137600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c742c1f6-fb9e-4aa7-8db8-76716b79335a tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 1.031610 Oct 19 00:50:21.140537 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 683/1451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:20 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.153280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ac4f1f5-97fc-4a62-a804-093ae5935412 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af936c4c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.231243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ac4f1f5-97fc-4a62-a804-093ae5935412 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.089127 Oct 19 00:50:21.233019 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 684/1452] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.238988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.241781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.250362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.251365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.252032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.253062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.253764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.254443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.281518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:50:21.284059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db9d8e08-0742-469e-b35f-fa79b12c6b20',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:50:21.312263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9d9f54f-577f-43cc-a0ad-583ad9edd18e tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077530 Oct 19 00:50:21.313594 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 685/1453] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:50:21.318728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.319655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.328901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.329667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.330587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.331555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.332256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.332946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.566236 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1ad5ee3-42c8-4ebe-8bf1-b43355a30acb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.820464 Oct 19 00:50:21.567588 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 769/1454] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:50:21.572932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.574170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.581939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.583390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.584079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.585163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.586796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.587591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.789194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:21.801828 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26785e76-da96-42c8-bc02-08ba2c3e5a3d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1229 microversion: 2.1 time: 0.232858 Oct 19 00:50:21.802885 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 770/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1229 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.811097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1347231", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "82c7aa9d-4226-40d4-9740-5580292913bc"}], "security_groups": [{"name": "tempest-securitygroup--1158577847"}], "key_name": "tempest-keypair-946116781", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:21.825106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:21.839257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-90fee073-865a-45a1-8720-665239f9db01 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.521144 Oct 19 00:50:21.841302 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 686/1456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:21.851738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.858859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:21.883182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.884578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.885301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.886272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:21.886952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:21.887602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:21.929728 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:21.940190 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b745667-7c3a-4dfa-bab1-e49cf80a8174 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097464 Oct 19 00:50:21.940970 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 687/1457] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:50:21.949126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63bbd9d0-11f1-4e67-8b49-70c8687f32ec tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:21.950296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63bbd9d0-11f1-4e67-8b49-70c8687f32ec tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:22.184743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-63bbd9d0-11f1-4e67-8b49-70c8687f32ec tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:22.204601 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63bbd9d0-11f1-4e67-8b49-70c8687f32ec tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1052 microversion: 2.1 time: 0.261982 Oct 19 00:50:22.205882 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 688/1458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:21 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1052 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:22.212311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:22.213228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:22.225625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:22.229895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:22.231206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:22.232148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:22.235841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:22.236556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:22.298443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:22.385595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] validate_networks() for [('82c7aa9d-4226-40d4-9740-5580292913bc', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:50:22.506340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9936f539-277c-4d94-a689-c333222f4d8c tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 204 len: 0 microversion: 2.1 time: 0.297520 Oct 19 00:50:22.508103 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 689/1459] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:22 2022] DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:22.526369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:22.529797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:22.574400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:22.575964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:22.576945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:22.578042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:22.578714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:22.580376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.005568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:23.023645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2af4e08f-47b8-4f29-9b0d-acf67ff51059 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 0.512151 Oct 19 00:50:23.030080 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 690/1460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:22 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:23.057746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-876da60f-f8c7-4822-ad0d-c534ca9e9b25 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4faf1f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.154906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-876da60f-f8c7-4822-ad0d-c534ca9e9b25 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.119060 Oct 19 00:50:23.155869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 691/1461] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:23.173531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.174433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:23.199257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.203728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.204686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.209501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.210410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.211152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.587732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:23.603155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:50:23.604870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:50:23.605588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:50:23.606201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:50:23.606807 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:50:23.616074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c73ef96d-030b-466f-bd1d-e7b23558734d tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1682 microversion: 2.1 time: 0.458014 Oct 19 00:50:23.619948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 692/1462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1682 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:23.628392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.629208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.629851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.630803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.631606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.632216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.636819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.637367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:23.646370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.648805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.650297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.653345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.654105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.655625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.676938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:23.683626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for user 5d0158da7efc485ebd6a1e1db617b5e7 and project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:23.699506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:50:23.702487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:50:23.745405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:23.756375 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-582990ea-3af6-41d4-b064-d6a32384a0dc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1283 microversion: 2.1 time: 0.127513 Oct 19 00:50:23.758143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 693/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1283 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:23.764374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.765485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:23.772321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.773356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.774069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.775468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.776122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.776766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.817698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cadd26a1-ff7d-4d89-a1c4-fbfed22a2ca6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.012619 Oct 19 00:50:23.827558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 771/1464] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:50:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:50:23.847863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2", "tag": "eeff2217-277c-45bd-81de-035ddd8ed3ef"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:23.870568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:23.873342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:23.873949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:23.960132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] Creating event network-changed:eeff2217-277c-45bd-81de-035ddd8ed3ef for instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 on n-h1-master-1 Oct 19 00:50:23.970593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-82ee2627-20ae-429f-804d-9428a2b8f333 req-a2e816b2-d009-4de8-baf7-5b657169fa3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138640 Oct 19 00:50:23.971558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 772/1465] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:23.986257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:23.987942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:24.000008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.000714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.001369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.002430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.003064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.003637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.091348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:24.117495 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-656783b3-de18-4c7a-a6f5-71e03da47b03 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.356166 Oct 19 00:50:24.136661 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 694/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:24.148637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:24.150156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:24.293155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:24.309309 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2caf6a09-e4ac-46b9-8c10-fe2d0b4de15c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1094 microversion: 2.1 time: 0.335300 Oct 19 00:50:24.312111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 773/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:23 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1094 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:24.326021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:24.330393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:24.344504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.347945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.348537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:24.349422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:24.351841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:24.353131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.061631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:25.077847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:25.079908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:25.082251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2364fab9-9202-41c8-a30e-5dfe95a27d9d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1282 microversion: 2.25 time: 0.957243 Oct 19 00:50:25.085084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 695/1468] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:24 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1282 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:25.096806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33910624-fd92-4704-8099-98eedc17a4f6 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ddf790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:25.184106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33910624-fd92-4704-8099-98eedc17a4f6 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.097576 Oct 19 00:50:25.204813 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 696/1469] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:25 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:25.226245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:25.229278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:25.253979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.254484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.267841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.270900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.273817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.281067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.713401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:25.728817 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07e82781-38bf-4622-9054-1773925ad23f tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 1.413824 Oct 19 00:50:25.733019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 774/1470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:24 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:25.759549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:25.760015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:25.788650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.789264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.789726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:25.791042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:25.791529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:25.791963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.071294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.094024 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28fec772-85d0-4ee3-84a6-05641c5915c9 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1682 microversion: 2.1 time: 0.878104 Oct 19 00:50:26.120849 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 697/1471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:25 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1682 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:26.120849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:26.120849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:26.124308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.125639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.127841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.129497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.135221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.136417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.192555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.203754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92a68c90-5259-43f5-b8f5-dede67044508 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1283 microversion: 2.1 time: 0.469572 Oct 19 00:50:26.216424 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 775/1472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:25 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1283 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:26.233794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:26.237135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:26.250942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.257222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.258213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.259559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.260351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.261067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.440923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.489998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d0bbbe1-a14c-48b4-9348-70a1e0225c5b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1168 microversion: 2.1 time: 0.268409 Oct 19 00:50:26.495085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 776/1473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:26 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1168 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:26.515068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:26.516179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:26.531055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.533904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.535289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.539061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:26.544101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:26.544566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:26.881325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.897196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.903671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:26.905246 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8c64e22-2f59-463c-a9f4-a26f944b8059 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1342 microversion: 2.25 time: 0.408618 Oct 19 00:50:26.905776 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 777/1474] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:26 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1342 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:26.923030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3aa1745-d62c-4600-8a73-01ced3038bdf tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af567b8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:27.023497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3aa1745-d62c-4600-8a73-01ced3038bdf tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.115997 Oct 19 00:50:27.026817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 778/1475] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:26 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:27.033353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:27.034302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:27.042171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.043019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.043728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:27.044773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.045453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.046095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:27.084414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:27.094233 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec407fd7-57eb-4c7f-b91e-f112bfa52720 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.988389 Oct 19 00:50:27.105439 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 698/1476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:26 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:27.128468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:27.130636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:27.138094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.138612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.150519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:27.151013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.151505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.151951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:27.439130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e43026c56e0462b976a840266ea8acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf3b8f8475874a7988dc35023a58d083', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:27.454662 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3088e374-90a1-40ed-89b3-1c00b4a38f7f tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 200 len: 1614 microversion: 2.1 time: 0.327700 Oct 19 00:50:27.475789 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 699/1477] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:27 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 1614 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:27.503700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:27.511193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:27.541968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.545761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.548828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:27.553235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:27.556924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:27.557770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:28.506954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:28.518659 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cca5c190-fc2b-447f-afa2-f03bcd22fef1 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 1.489558 Oct 19 00:50:28.524947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 779/1478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:27 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:28.533760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-unplugged", "status": "completed", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:28.557128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:28.557883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:28.558498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:28.589263 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Creating event network-vif-unplugged:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:50:28.608235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 00:50:28.643325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cfb19596-0421-4005-8539-bd4d547a6115 req-d720e1e9-6792-49c9-8754-2b24d5ccc909 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116807 Oct 19 00:50:28.643952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 780/1479] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:28.661675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c98cca62-8e30-4c84-a431-4a0c1138ac18", "name": "network-vif-deleted", "tag": "edda9ea9-a567-4cff-a6fb-0fb7e578d1bc"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:28.684079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:28.699463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:28.700096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:28.732378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] Creating event network-vif-deleted:edda9ea9-a567-4cff-a6fb-0fb7e578d1bc for instance c98cca62-8e30-4c84-a431-4a0c1138ac18 on n-h1-master-1 Oct 19 00:50:28.747726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e46c3120-7061-4e7e-8037-6c0f8e02f995 req-23015f35-afed-47dc-8b69-8bf13fcfc207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101554 Oct 19 00:50:28.751890 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 781/1480] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:28.767809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:28.769108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:28.787172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:28.793677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:28.795795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:28.799935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:28.800836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:28.802713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.070243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:29.090544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46caf5d9-151e-496e-b28b-3e6def1c074a tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 1.605275 Oct 19 00:50:29.095516 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 700/1481] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:27 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:29.106239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:29.117197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:29.131347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.131762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.134457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.135228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.135702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.136142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.208953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:29.220463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c06b6461-9591-40b4-8edf-f6bf75b064ad tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1168 microversion: 2.1 time: 0.465138 Oct 19 00:50:29.230149 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 782/1482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:28 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1168 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:29.269630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ddf85c3-1403-4a2d-86ec-3cf8ebf0b944 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af56cbb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:29.371286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ddf85c3-1403-4a2d-86ec-3cf8ebf0b944 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.131411 Oct 19 00:50:29.381112 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 783/1483] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:29 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:29.385981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:29.386324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:29.397199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.399810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.400279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.403265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.403793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.404244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.661776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:29.689340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:29.693812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:29.699899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1151d108-c4a7-4853-b6ad-ccbc8c1aa26d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1340 microversion: 2.25 time: 0.602919 Oct 19 00:50:29.705892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 701/1484] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:29 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1340 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:29.725310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:29.726367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:29.749170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.749682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.750142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.751247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.760206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.760854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.799302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] HTTP exception thrown: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Request method failure captured: Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 HTTP/1.1 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0kL2Cix3sMHBBCrVftDdO96T6GBNEpsYfJmpef8FIeEcvDI0QUwL4Tz5ll6Kxvj_ScX_JQc7GACoBkmS-SeucvdfPA-5LVPOSmWJuEkuCnQRVVGMfo9ohz6sBzs-jhXG964Auk9yznlR-mDGZOKr-C2kG_X4YfoiwQ5hNF39WVWKA4 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf3b8f8475874a7988dc35023a58d083", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}] Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1e43026c56e0462b976a840266ea8acf Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c98cca62-8e30-4c84-a431-4a0c1138ac18'} Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:29.806228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:29.811065 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:29.816011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Returning 404 to user: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:29.817288 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8724aecf-477e-41fd-8336-8335c745c104 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 404 len: 111 microversion: 2.1 time: 0.109948 Oct 19 00:50:29.818043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 702/1485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:29 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:29.837198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:29.840646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:29.852127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.855109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.858523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.859515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:29.860482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:29.861127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:29.937465 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:30.158844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:30.184703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1221ae3b-aea6-4bf4-9d86-b738b30ee372 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.802053 Oct 19 00:50:30.191086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 784/1486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:29 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:30.217683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c015ff33-58f9-4291-929d-092c66624fd5 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '.version_select at 0x7f2af56f4b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:30.266459 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c015ff33-58f9-4291-929d-092c66624fd5 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515828034" status: 202 len: 0 microversion: 2.1 time: 0.073566 Oct 19 00:50:30.269460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 785/1487] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:50:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1515828034 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:30.278950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:30.281666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:30.292094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:30.293748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:30.294822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:30.295894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:30.298032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:30.299338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:30.309641 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:30.976176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:30.992036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b06eec1-0fc3-48be-9a2d-ec0e554ff860 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 1.170793 Oct 19 00:50:30.993087 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 703/1488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:29 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:31.002920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:31.003594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:31.018539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:31.019066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:31.020535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:31.021527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:31.025208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:31.025893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:31.280479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:31.293158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08fdc6cf-a909-48f0-a77e-85a9304c5036 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 1.019995 Oct 19 00:50:31.293804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 786/1489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:30 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:31.331562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9c9cbca-ce51-481d-9c20-94d07bc1d1b7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af56f4ee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:31.407795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9c9cbca-ce51-481d-9c20-94d07bc1d1b7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.093514 Oct 19 00:50:31.409051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 787/1490] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:31 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:31.414550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:31.415697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:31.424107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:31.425034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:31.425848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:31.426788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:31.427616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:31.428264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:32.339601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:32.351643 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60d51061-d277-41a4-a06b-c5ddc8f739c8 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1210 microversion: 2.1 time: 1.356696 Oct 19 00:50:32.352284 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 704/1491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:30 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1210 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:32.366485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:32.373511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:32.391297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:32.394475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:32.395018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:32.398625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:32.399417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:32.399997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.017513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:33.032376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:33.033992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:33.035251 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32ff8885-b988-4272-8d63-fbb511698756 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 1.625014 Oct 19 00:50:33.035849 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 788/1492] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:31 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:33.055332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0", "tag": "f4d27491-00df-4758-9a2a-65e208ed340c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:33.083490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:33.083991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:33.084427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.116833 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] Creating event network-changed:f4d27491-00df-4758-9a2a-65e208ed340c for instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 on n-h2-master-1 Oct 19 00:50:33.135903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3c16d59b-4d49-4833-b656-4323cbdafa71 req-fc19eab9-a761-43f7-9e9b-3cd5664747f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098610 Oct 19 00:50:33.136374 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 789/1493] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:33.155432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:33.156176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:33.160002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:33.169308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:33.169811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:33.170259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.170984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:33.171446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:33.171875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.172560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e9633fb-8d03-429e-b265-013b720de811 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.809881 Oct 19 00:50:33.193237 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 705/1494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:32 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:33.200975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:33.201876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:33.208754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:33.210268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:33.210911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.212393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:33.213114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:33.213706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:33.665857 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:33.693796 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=20 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:33.997348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:34.015627 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5a6f756e-f583-44d6-864f-a6934a6a30fc tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 0.819583 Oct 19 00:50:34.024394 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 706/1495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:33 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:34.045162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-642621b5-4534-4554-8ae0-b4d092f97635 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af9383a60>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:34.229655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:34.248255 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-86dee245-c4fe-4222-b2b8-76b28ef1b53e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 1.095948 Oct 19 00:50:34.268243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 790/1496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:33 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:34.278294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:34.281724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:34.299826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:34.300309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:34.300815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:34.305959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:34.306462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:34.306908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:34.901879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:34.915645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c473fc1b-a99f-4e86-8dc0-2cd882cb1e64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1210 microversion: 2.1 time: 0.645702 Oct 19 00:50:34.916422 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 791/1497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:34 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1210 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:34.933191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:34.933828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:34.952488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:34.953085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:34.953563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:34.954308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:34.954765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:34.959569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:35.067434 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:35.453163 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-642621b5-4534-4554-8ae0-b4d092f97635 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 1.426717 Oct 19 00:50:35.453874 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 707/1498] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:34 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:35.482944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:35.484149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:35.548654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:35.553058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:35.556235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:35.558178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:35.558988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:35.559547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:35.559929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:35.568580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:35.576792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:35.578539 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db77d4bd-deba-4eb5-9b7d-60527c90d932 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.661052 Oct 19 00:50:35.583439 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 792/1499] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:34 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:35.598788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bca5a26-4f18-43f6-a92a-1583dd23cf16", "tag": "c148a844-6240-4da3-af4a-7a46efc2f72e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:35.654517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:35.657801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:35.663515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:35.694351 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:35.705002 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] Creating event network-changed:c148a844-6240-4da3-af4a-7a46efc2f72e for instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 on n-h2-master-1 Oct 19 00:50:35.720187 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-44bd5067-e159-417f-8d16-b9bcba32b643 req-f9eac12e-c49e-49d8-943a-7ad3199c48d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132176 Oct 19 00:50:35.725413 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 793/1500] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:35.737553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:35.761433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:35.781651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:35.782787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:35.783519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:35.784509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:35.790786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:35.791564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:36.369644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:36.378705 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37dec8bc-b9c2-44b1-a7be-b6eda99e5bae tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.918724 Oct 19 00:50:36.385467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 708/1501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:35 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:36.405639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:36.406573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:36.417831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:36.429132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:36.430224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:36.431126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:36.432347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:36.432885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3e44047-8f46-428b-b8c1-aab1ce8bb891 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 0.698124 Oct 19 00:50:36.433184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:36.433724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 794/1502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:35 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:36.448132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:36.470796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:36.534567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:36.536029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:36.536552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:36.588976 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] Creating event network-changed:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:50:36.616926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-80c029e3-3228-451e-b289-dd62fb68c961 req-0b0c7c91-164a-45e7-9e85-1b4af2ebb4d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179984 Oct 19 00:50:36.623705 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 795/1503] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:36.646497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:36.655993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:36.679081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:36.679567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:36.680051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:36.681247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:36.681709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:36.682227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:37.364415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:37.369440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:37.378707 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6cb4039f-f9d3-47a3-8f72-f01210c74e1e tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1468 microversion: 2.1 time: 0.988427 Oct 19 00:50:37.381583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d52df75-2ee7-47a5-b913-9d02f81aa559 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1210 microversion: 2.1 time: 0.753127 Oct 19 00:50:37.386544 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 796/1504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:36 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1210 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:37.389173 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 709/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:36 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1468 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:37.404902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:37.407315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-022d1b48-c406-4ff1-916f-05d9d86a20ad tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af93ff8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:37.410725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:37.439942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:37.443245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:37.444034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:37.446238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:37.446969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:37.449008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:37.524200 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-022d1b48-c406-4ff1-916f-05d9d86a20ad tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1429 microversion: 2.1 time: 0.135936 Oct 19 00:50:37.525259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 797/1506] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:37 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1429 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:37.559073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:37.562557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:37.580800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:37.582746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:37.583384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:37.586205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:37.588327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:37.589034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:38.714018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:38.729392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:38.740924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:38.742291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c20c16e5-611d-4619-a931-4ce86d642a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 1.351750 Oct 19 00:50:38.743007 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 710/1507] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:37 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:38.749668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:38.753110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:38.765594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:38.766200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:38.766752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:38.770988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:38.771579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:38.772219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:38.816896 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:38.837457 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17ec1f34-42db-4995-adf1-ebdf632a5e35 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 1.308084 Oct 19 00:50:38.858364 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 798/1508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:37 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:38.872832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:38.899890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:38.900650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:38.901299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:38.921372 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] Creating event network-changed:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h1-master-1 Oct 19 00:50:38.929542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-59e890a7-46cd-4bf3-aadd-f6ce5302e450 req-774264a1-1a18-4ff4-b1ac-30973a6fcae3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069747 Oct 19 00:50:38.932969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 799/1509] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:38.939614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:38.941956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:38.954925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:38.955743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:38.956576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:38.957803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:38.958570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:38.959190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:39.269129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:39.278210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15cc047b-b847-4ac9-884d-730f2175eb7d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 0.534058 Oct 19 00:50:39.300518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 711/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:38 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:39.313320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:39.319123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:39.340700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:39.342299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:39.343431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:39.353034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:39.353697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:39.354266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:39.435451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:39.456940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-19ea5ded-db75-420d-91b6-5fa95e224048 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.516978 Oct 19 00:50:39.459403 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 800/1511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:38 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:39.466833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d815ea23-9054-4779-805e-5a6fb696259e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4f6fee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:39.567854 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d815ea23-9054-4779-805e-5a6fb696259e tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1438 microversion: 2.1 time: 0.107360 Oct 19 00:50:39.568811 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 801/1512] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:39 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1438 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:39.574259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2", "name": "network-vif-plugged", "status": "completed", "tag": "eeff2217-277c-45bd-81de-035ddd8ed3ef"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:39.613170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:39.613947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:39.614622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:39.632781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] Creating event network-vif-plugged:eeff2217-277c-45bd-81de-035ddd8ed3ef for instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 on n-h1-master-1 Oct 19 00:50:39.641271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-270ccd97-7924-41cb-852c-483c739673e2 req-00ee634a-727b-41ba-ad5b-d3d28c826782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070760 Oct 19 00:50:39.642250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 802/1513] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:39.673073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f270e0f-8e29-421d-a71e-81d844a42959 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4f20310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:39.740915 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f270e0f-8e29-421d-a71e-81d844a42959 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 200 len: 1438 microversion: 2.1 time: 0.097122 Oct 19 00:50:39.742259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 803/1514] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:39 2022] GET /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 1438 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:39.761602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:39.763444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:39.796404 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:39.814130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:39.818076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:39.818670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:39.823065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:39.823885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:39.826322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:40.137446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.149684 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-59417cd2-cda2-459b-93b1-6dba2cd9d2b8 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1461 microversion: 2.1 time: 0.847147 Oct 19 00:50:40.178273 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 712/1515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:39 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1461 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:40.210110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:40.215994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:40.238479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:40.239011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:40.239467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:40.240197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:40.244702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:40.247343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:40.684763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.697123 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43ab24be-1929-4a03-850d-e94315b393c4 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1467 microversion: 2.1 time: 0.941832 Oct 19 00:50:40.705507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 804/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:39 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1467 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:40.714698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:40.720697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:40.737980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:40.738797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:40.739454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:40.741994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:40.743165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:40.743864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:40.809034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.826477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.831355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.837693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03d2e466-b211-4f58-8df6-737274f2662c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.657822 Oct 19 00:50:40.838666 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 713/1517] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:40 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:40.985761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:40.998257 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-029de84d-de9e-4cfa-bedb-e64e77c63791 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1351 microversion: 2.1 time: 0.291266 Oct 19 00:50:41.000641 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 805/1518] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:40 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1351 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:41.011554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:41.016539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:41.035136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.035690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.036144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.039153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.040224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.040224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.255950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:41.269241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58fb1146-c0d6-4834-b225-2ac73416544b tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 0.266560 Oct 19 00:50:41.270118 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 806/1519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:41 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:41.275850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:41.276547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:41.277328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:41.277471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:41.284214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.285185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.285790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.286812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.287434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.288136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.302948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.303461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.303915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.314442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.322313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.323998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.723308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:41.733008 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19fd72b1-8688-4340-8f12-f487898785f7 tempest-MigrationsAdminTest-2074028690 tempest-MigrationsAdminTest-2074028690-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1612 microversion: 2.1 time: 0.893053 Oct 19 00:50:41.735115 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 714/1520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:40 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1612 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:41.737884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5053097d-2530-41b6-8482-8cde0bc82a65 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.466384 Oct 19 00:50:41.738466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 807/1521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:41 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:41.740469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ba8c825-1287-405a-9153-5083a5b33198 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af4ddfd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:41.751252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0", "name": "network-vif-plugged", "status": "completed", "tag": "f4d27491-00df-4758-9a2a-65e208ed340c"}, {"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-plugged", "status": "completed", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:41.770520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.771011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.777986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.812497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Creating event network-vif-plugged:f4d27491-00df-4758-9a2a-65e208ed340c for instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 on n-h2-master-1 Oct 19 00:50:41.813061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] Creating event network-vif-plugged:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:50:41.854545 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e6ad94cd-c1c8-4e66-b586-048ca459f90b req-460f2401-5279-44ce-b7a6-433ed7c6b25d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114030 Oct 19 00:50:41.855191 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 808/1522] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:41.878297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:41.878976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:41.903868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.904303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.904781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:41.905508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:41.917980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:41.918850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.060406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:42.161953 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:42.277040 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2fdbb7c7-74e5-4a92-b593-18fd7208b41b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 204 len: 0 microversion: 2.1 time: 0.416613 Oct 19 00:50:42.278465 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 809/1523] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:41 2022] DELETE /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:42.292394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:42.293119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:42.309333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.310099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.311160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.312526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.313169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.314062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.491142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ba8c825-1287-405a-9153-5083a5b33198 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "DELETE /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4" status: 204 len: 0 microversion: 2.1 time: 0.754658 Oct 19 00:50:42.491810 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 715/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:41 2022] DELETE /compute/v2.1/images/ebbb0401-e9ff-4de0-a685-37005bf003b4 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:42.502430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:42.503487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:42.519044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.519545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.519996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.520761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.521426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.522031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.568370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.578709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.583734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.586558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8548467d-71b1-418b-b0fe-87d5fee8bb57 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.303467 Oct 19 00:50:42.587561 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 810/1525] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:42 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:42.610293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:42.611967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:42.619247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.620998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.622343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.624186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.625972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.626804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.748347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.757076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae99f22c-4c92-453e-b3e0-ab011b9c1c18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1541 microversion: 2.1 time: 0.260403 Oct 19 00:50:42.758169 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 716/1526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:42 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1541 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:42.769914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:42.770921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:42.779524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.780363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.781075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.782930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:42.783791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:42.784560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:42.848466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.858212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1dfd5d2-2941-4fe7-9a15-5b3a10d193b3 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1467 microversion: 2.1 time: 0.269457 Oct 19 00:50:42.859166 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 811/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:42 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1467 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:42.870513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57beab21-72bc-4cfe-b71e-57d32084ceda tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '.version_select at 0x7f2af546e940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:42.965271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-57beab21-72bc-4cfe-b71e-57d32084ceda tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] HTTP exception thrown: Image not found. Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57beab21-72bc-4cfe-b71e-57d32084ceda tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Request method failure captured: Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 HTTP/1.1 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0l2VGda7gByjv10PtypuoKEuziYHuI7GcngfVOMc_rl_xwUKZaB8HlrTYP-ipbxUj0ztq3ADJNscBRClRc8vTS-ARjHivHIfpidNC1xtTgDiSZVmz_9LAiofGi8qgab2Kwgz6AidkmmNhYWunyZkf58yYFsgw8Z0YAxGDpdXbWVlWo Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d60a9bdaee646508bf9f42d390191d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}] Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2a896789dc814debba3a0a8f8f0c8943 Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a8939b73-7f94-43bf-8a2c-5f359fce9d28'} Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8939b73-7f94-43bf-8a2c-5f359fce9d28 to delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8939b73-7f94-43bf-8a2c-5f359fce9d28 could not be found. Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.967646 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57beab21-72bc-4cfe-b71e-57d32084ceda tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57beab21-72bc-4cfe-b71e-57d32084ceda tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "DELETE /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28" status: 404 len: 62 microversion: 2.1 time: 0.108938 Oct 19 00:50:42.973448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 812/1528] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:42 2022] DELETE /compute/v2.1/images/a8939b73-7f94-43bf-8a2c-5f359fce9d28 => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:50:42.985168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:42.995491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc8a9c76-b349-4478-8500-925f40d8a621 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1325 microversion: 2.1 time: 0.235753 Oct 19 00:50:42.996092 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 717/1529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:42 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:43.001271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.002015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.008215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.009054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.009709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.010623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.011254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.011847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.038279 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] HTTP exception thrown: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Request method failure captured: Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 HTTP/1.1 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0kL2Cix3sMHBBCrVftDdO96T6GBNEpsYfJmpef8FIeEcvDI0QUwL4Tz5ll6Kxvj_ScX_JQc7GACoBkmS-SeucvdfPA-5LVPOSmWJuEkuCnQRVVGMfo9ohz6sBzs-jhXG964Auk9yznlR-mDGZOKr-C2kG_X4YfoiwQ5hNF39WVWKA4 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf3b8f8475874a7988dc35023a58d083", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}] Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1e43026c56e0462b976a840266ea8acf Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c98cca62-8e30-4c84-a431-4a0c1138ac18'} Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:43.042194 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.050127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.054019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Returning 404 to user: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:43.056388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0fd24779-2f97-43fb-9dcd-4074d8f98010 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 404 len: 111 microversion: 2.1 time: 0.058756 Oct 19 00:50:43.057994 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 718/1530] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:42 2022] DELETE /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:43.066648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.068002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.078097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-316af393-865b-4ecd-82c3-e0ae652d5f24 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4e58f70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-209741494", "description": "tempest-description-556541747"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:43.080281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.081365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.082803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.084390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.085444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.086457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.408462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:43.430817 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64cb97c2-5974-4a00-97fb-3fd3acf8d773 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.370795 Oct 19 00:50:43.431980 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 719/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:43 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:43.441071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.442055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.450672 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-316af393-865b-4ecd-82c3-e0ae652d5f24 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.479508 Oct 19 00:50:43.456805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.457330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.457789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.458532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.459002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.459748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.460585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 813/1532] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:50:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:43.467118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.467632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.487288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.487791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.488294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.489114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.489572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.490004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.527939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:43.581144 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d98346fd-b0be-40c1-9772-cb7a610ac473 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146435 Oct 19 00:50:43.583051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 720/1533] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:50:43 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:43.589490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.590539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] [instance: c98cca62-8e30-4c84-a431-4a0c1138ac18] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.592575 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:43.598633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.599362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.599989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.600737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.601970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.603635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.623241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] HTTP exception thrown: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Request method failure captured: Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 HTTP/1.1 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0kL2Cix3sMHBBCrVftDdO96T6GBNEpsYfJmpef8FIeEcvDI0QUwL4Tz5ll6Kxvj_ScX_JQc7GACoBkmS-SeucvdfPA-5LVPOSmWJuEkuCnQRVVGMfo9ohz6sBzs-jhXG964Auk9yznlR-mDGZOKr-C2kG_X4YfoiwQ5hNF39WVWKA4 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bf3b8f8475874a7988dc35023a58d083", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bf3b8f8475874a7988dc35023a58d083"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bf3b8f8475874a7988dc35023a58d083"}]}] Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: bf3b8f8475874a7988dc35023a58d083 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-330659454 Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1e43026c56e0462b976a840266ea8acf Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-330659454-project Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c98cca62-8e30-4c84-a431-4a0c1138ac18'} Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:43.625980 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. Oct 19 00:50:43.630206 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:43.632124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] Returning 404 to user: Instance c98cca62-8e30-4c84-a431-4a0c1138ac18 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:43.633513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b31165f8-e1ca-4104-bf0d-f89a7ad34519 tempest-AttachSCSIVolumeTestJSON-330659454 tempest-AttachSCSIVolumeTestJSON-330659454-project] 10.222.0.27 "GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18" status: 404 len: 111 microversion: 2.1 time: 0.049219 Oct 19 00:50:43.638618 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 721/1534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:43 2022] GET /compute/v2.1/servers/c98cca62-8e30-4c84-a431-4a0c1138ac18 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:43.644585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-352c6b63-4b23-40ed-991f-3c1b98568afd tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af93aa940>, body: {"security_group_rule": {"parent_group_id": "b3b81fdf-b960-45e8-b099-0c8f4335fb76", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:43.654823 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e93eabcc-342b-4c7f-87bd-2de8cf077e84 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "DELETE /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 204 len: 0 microversion: 2.1 time: 0.191994 Oct 19 00:50:43.657438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 814/1535] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:43 2022] DELETE /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:43.665087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:43.666239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:43.674629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.676134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.677093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:43.678106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:43.679004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:43.682072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.249199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:44.263191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:44.265015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:44.271025 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddb9a7a3-d3a2-46a6-954f-812c90165dc3 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.611662 Oct 19 00:50:44.292745 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 815/1536] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:43 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:44.298749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:44.300792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:44.309329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:44.310250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:44.310918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.311880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:44.313839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:44.314759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.897797 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:44.928362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b296ddcf-560d-4505-899d-4f25a2ef9cf7 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1473 microversion: 2.1 time: 0.633468 Oct 19 00:50:44.930774 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-352c6b63-4b23-40ed-991f-3c1b98568afd tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.290347 Oct 19 00:50:44.931944 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 722/1537] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:43 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:44.932584 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 816/1538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:44 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1473 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:44.937517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:44.938380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:44.945914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-unplugged", "status": "completed", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:44.952099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:44.959260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:44.959672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.960442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:44.961543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:44.962490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.963884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:44.964379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:44.965649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:44.987051 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] Creating event network-vif-unplugged:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:50:44.993583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4da5efa6-4306-47a6-b280-59cb26de4fe2 req-408b9c87-809f-479c-8bbc-b32efee2f231 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059461 Oct 19 00:50:44.994799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 817/1539] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:45.000922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:45.002383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:45.009515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:45.010217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:45.010857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:45.012346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:45.013026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:45.013637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:45.884850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:45.895479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9588705f-3028-46ed-a618-962a683a068c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 200 len: 1467 microversion: 2.1 time: 0.961858 Oct 19 00:50:45.901731 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 723/1540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:44 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 1467 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:45.921381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:45.923240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:45.932730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:45.948957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:45.953917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:45.961718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:45.964393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:45.975027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:45.976282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:45.981271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f03c451-26ab-42f4-8240-ae91b5abeede tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1521 microversion: 2.1 time: 0.966644 Oct 19 00:50:45.989489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 818/1541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:44 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1521 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:46.013767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cae1880-1d1f-41d5-b672-462b5eda206c tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4f6f0d0>, body: {"security_group_rule": {"parent_group_id": "b3b81fdf-b960-45e8-b099-0c8f4335fb76", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:46.517210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:46.532379 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5011a9a1-3b4d-44d9-b5fa-d8442bcb1303 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.628991 Oct 19 00:50:46.536049 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 724/1542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:45 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:46.551948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2", "tag": "eeff2217-277c-45bd-81de-035ddd8ed3ef"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:46.561821 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3cae1880-1d1f-41d5-b672-462b5eda206c tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cae1880-1d1f-41d5-b672-462b5eda206c tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 138 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: {"security_group_rule": {"parent_group_id": "b3b81fdf-b960-45e8-b099-0c8f4335fb76", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: exception: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b3b81fdf-b960-45e8-b099-0c8f4335fb76', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:46.566737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:46.571729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:46.571729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:46.571729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 Oct 19 00:50:46.571729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:46.571729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cae1880-1d1f-41d5-b672-462b5eda206c tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: This rule already exists in group b3b81fdf-b960-45e8-b099-0c8f4335fb76 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:46.574848 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3cae1880-1d1f-41d5-b672-462b5eda206c tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.582179 Oct 19 00:50:46.579204 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 819/1543] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:45 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 586 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:50:46.589672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:46.591205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:46.607353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:46.608510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:46.610162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:46.614627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:46.615151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:46.615970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:46.618736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:46.619584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:46.621176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:46.648036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] Creating event network-changed:eeff2217-277c-45bd-81de-035ddd8ed3ef for instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 on n-h1-master-1 Oct 19 00:50:46.668973 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-85d8848a-d4f7-4e66-a7e2-187cb85f8762 req-88ccf9f3-5a84-48f3-b1fe-dfab10ae0285 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130778 Oct 19 00:50:46.671213 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 725/1544] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:46.679081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:46.681850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:46.692063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:46.692756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:46.693279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:46.694278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:46.695013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:46.695802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.143678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:47.155790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:47.160134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:47.162359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:47.163554 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83f7ab71-1503-42f8-9be7-54fdbfd5e057 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.583850 Oct 19 00:50:47.166245 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 820/1545] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:46 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:47.173106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0a4a57a-e1c5-49e2-8ed9-c93c43c83d23 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1473 microversion: 2.1 time: 0.494842 Oct 19 00:50:47.175589 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 726/1546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:46 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1473 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:47.191371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:47.191371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:47.194348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.196984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.196984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.196984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.196984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.197428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.203918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0ba0b3-3dc8-4512-a210-e9e1102d2f80", "name": "network-vif-deleted", "tag": "fcc872b3-484f-4281-94b4-efc6d94b88a1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:47.218826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.219759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.220498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.245781 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] Creating event network-vif-deleted:fcc872b3-484f-4281-94b4-efc6d94b88a1 for instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 on n-h1-master-1 Oct 19 00:50:47.252549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-bee25b1b-4035-4dc8-90c3-1223782ae4a1 req-c65e92d2-85e5-4dbf-923f-d397bfc6d6cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057107 Oct 19 00:50:47.254076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 727/1547] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:47.257723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:47.261088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19cefc74-f3e9-4f59-837f-f2569369c69d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af4f79820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:47.487984 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1223d205-5ee7-4ed4-8806-1d3e91cc439e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 204 len: 0 microversion: 2.1 time: 0.313971 Oct 19 00:50:47.497048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 821/1548] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:47 2022] DELETE /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:47.525659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:47.526821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: df0ba0b3-3dc8-4512-a210-e9e1102d2f80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:47.537248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.538251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.539564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.541850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.543823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.545090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.576570 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] HTTP exception thrown: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Request method failure captured: Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 HTTP/1.1 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0heKTzQ0j4rNaHMESgFZirMxwWQUjFDY_9cS8FmIfbHfeb-z2cvAH-IRd2Dd_hK2J1ftylYzRz6ZeUzYZCI2cepwuLHzP-1EDM3E8ilfBRwaaULCD4B6gnWMiDlXXsxuc0TMXUqXPrMm_YULz-egF5YEbCCknFkALyF2-2zS9wPAVU Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd215e75fbda44c9a04e669cde1dfaa1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}] Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c5bef756c5c74e688ded867d98a6d29a Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: exception: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'df0ba0b3-3dc8-4512-a210-e9e1102d2f80'} Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:47.584548 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. Oct 19 00:50:47.593923 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:47.594919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Returning 404 to user: Instance df0ba0b3-3dc8-4512-a210-e9e1102d2f80 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:47.595778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1039babf-639d-47eb-9a07-90050f8ee262 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80" status: 404 len: 111 microversion: 2.1 time: 0.096571 Oct 19 00:50:47.599335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 822/1549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:47 2022] GET /compute/v2.1/servers/df0ba0b3-3dc8-4512-a210-e9e1102d2f80 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:47.603232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "name": "network-vif-plugged", "status": "completed", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:47.620150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.621027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.621646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.642488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] Creating event network-vif-plugged:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h1-master-1 Oct 19 00:50:47.648805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-86f8b2e2-e4e0-4d06-90ae-384745e88fa8 req-9e1289b1-747e-4fe0-b3c3-bd1fc35d5cf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049733 Oct 19 00:50:47.649493 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 823/1550] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:47.655382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:47.656373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:47.670356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.671130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.671762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.672736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.673369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.673972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.769909 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19cefc74-f3e9-4f59-837f-f2569369c69d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/fb287adf-2a2e-45bd-8424-55c2ba8b89b8" status: 202 len: 0 microversion: 2.1 time: 0.514117 Oct 19 00:50:47.770876 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 728/1551] 10.222.0.27 () {58 vars in 1287 bytes} [Wed Oct 19 00:50:47 2022] DELETE /compute/v2.1/os-security-group-rules/fb287adf-2a2e-45bd-8424-55c2ba8b89b8 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:47.779098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:47.779841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:47.787646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.788440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.789132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:47.790030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:47.790662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:47.791451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.374674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:48.393097 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04bfd687-2ba6-4a58-9b80-7949c899efc7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1527 microversion: 2.1 time: 0.741693 Oct 19 00:50:48.394209 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 824/1552] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:47 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1527 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:48.402762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:48.403418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:48.414558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.415445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.416254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.417887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.419254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.420167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.474442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:48.480186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:48.488773 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-89681da8-b4f6-4195-bbbf-f6e4526c9e67 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.716672 Oct 19 00:50:48.489391 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 729/1553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:47 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:48.505659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5fd41139-7b4f-4c75-8f3c-4927fb5828da tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af936c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1662243288", "description": "tempest-description-618400226"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:48.565498 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:48.655412 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77d0d0ae-8d0a-4217-a01f-563d46aa1624 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 204 len: 0 microversion: 2.1 time: 0.259650 Oct 19 00:50:48.656563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 825/1554] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:48 2022] DELETE /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:48.664006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:48.677296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:48.697884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.698915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.699366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:48.700097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:48.700613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:48.701105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.016340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5fd41139-7b4f-4c75-8f3c-4927fb5828da tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.525821 Oct 19 00:50:49.017779 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 730/1555] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:50:48 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:49.028967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:49.030431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:49.042939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.055792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.056543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.058377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.059128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.059776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.128137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:49.141394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:49.143498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:49.146215 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6c71465-5491-4b53-8489-ef9c4d5d2019 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1408 microversion: 2.25 time: 0.488496 Oct 19 00:50:49.160094 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 826/1556] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:48 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:49.169870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:49.170497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:49.177471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.178765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.179576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.180113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.180574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.181041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.209461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:49.219362 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-759bc5ec-78d6-4a70-99ba-22de5fe64c24 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1302 microversion: 2.1 time: 0.199889 Oct 19 00:50:49.220238 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 731/1557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:49 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1302 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:49.228786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799611dc-8d4a-45eb-97ef-04570a407208", "name": "network-vif-deleted", "tag": "4c66dcb5-3623-422b-a96a-15cb083a508b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:49.252205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.252890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.253181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.265938 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:49.269224 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] Creating event network-vif-deleted:4c66dcb5-3623-422b-a96a-15cb083a508b for instance 799611dc-8d4a-45eb-97ef-04570a407208 on n-h2-master-1 Oct 19 00:50:49.276770 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-90a62e27-dcfe-4c4c-8576-9196d6374c66 req-60b07f89-fcbf-4906-becb-1162ce5793cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054786 Oct 19 00:50:49.281524 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 732/1558] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:49.288035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba7d4b1-414f-4f3a-b123-4988f932185a tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4f79c10>, body: {"security_group_rule": {"parent_group_id": "c5abb07a-1f73-453d-bf1b-1f4b89a9a7de", "ip_protocol": "tcp", "from_port": 150631550, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:49.768166 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1ba7d4b1-414f-4f3a-b123-4988f932185a tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Invalid port range 150631550:22. Former value cannot be greater than the later Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba7d4b1-414f-4f3a-b123-4988f932185a tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 145 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: {"security_group_rule": {"parent_group_id": "c5abb07a-1f73-453d-bf1b-1f4b89a9a7de", "ip_protocol": "tcp", "from_port": 150631550, "to_port": 22}} Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid port range 150631550:22. Former value cannot be greater than the later Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c5abb07a-1f73-453d-bf1b-1f4b89a9a7de', 'ip_protocol': 'tcp', 'from_port': 150631550, 'to_port': 22}}} Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 150631550:22. Former value cannot be greater than the later Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 150631550:22. Former value cannot be greater than the later Oct 19 00:50:49.769904 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 150631550:22. Former value cannot be greater than the later Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba7d4b1-414f-4f3a-b123-4988f932185a tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: Invalid port range 150631550:22. Former value cannot be greater than the later {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:49.775436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ba7d4b1-414f-4f3a-b123-4988f932185a tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.488326 Oct 19 00:50:49.778062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 733/1559] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:49 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 496 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:50:49.783085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:49.783856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:49.809461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.809989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.810449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.811191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.811660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.812101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.871606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:49.897140 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea54d179-d37c-4486-ba59-cdcd92c145fb tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1534 microversion: 2.1 time: 0.735596 Oct 19 00:50:49.897738 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 827/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:49 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1534 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:49.928146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:49.929425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:49.938031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.938792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.939748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:49.940675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:49.941310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:49.941902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.151336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.164544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ef6b7fb-2aa2-4cce-9314-f3612188b20e tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1527 microversion: 2.1 time: 0.385261 Oct 19 00:50:50.167884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 734/1561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:49 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1527 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:50.183165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1eae5a5d-c018-4b29-a5eb-2583e4b25eaa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af9494820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-727692357", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:50.185735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1eae5a5d-c018-4b29-a5eb-2583e4b25eaa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Security group id should be uuid Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1eae5a5d-c018-4b29-a5eb-2583e4b25eaa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 130 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-727692357", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: exception: Security group id should be uuid Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-727692357', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:50.188087 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:50.194590 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 19 00:50:50.194590 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:50.196958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1eae5a5d-c018-4b29-a5eb-2583e4b25eaa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: Security group id should be uuid {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:50.198808 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1eae5a5d-c018-4b29-a5eb-2583e4b25eaa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027265 Oct 19 00:50:50.201066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 735/1562] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:50.208450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:50.209537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:50.217609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.218422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.219080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.220015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.220792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.222560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.251065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.261365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-467d2d03-decd-47bb-96b3-1ba0f7d0dc64 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.339457 Oct 19 00:50:50.262234 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 828/1563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:49 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:50.267796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84522b79-80f1-4757-b143-bb98b7897731 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4f6f4c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-313744021", "description": "tempest-description-1651251944"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:50.629450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.654158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.656169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.657468 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15b0ac6c-43a1-4e2f-bde5-d572208fc8ca tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1605 microversion: 2.25 time: 0.455475 Oct 19 00:50:50.658051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 736/1564] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:50:50 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1605 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:50:50.699888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:50.701040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:50.716351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.716907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.717392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.718231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.718729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.719183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.756712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.757226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.757755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.758544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lazy-loading 'fault' on Instance uuid 799611dc-8d4a-45eb-97ef-04570a407208 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:50.858052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a896789dc814debba3a0a8f8f0c8943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d60a9bdaee646508bf9f42d390191d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:50.891865 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c4ea115d-424d-478d-a236-c8893d04a05d tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 200 len: 1307 microversion: 2.1 time: 0.207325 Oct 19 00:50:50.908214 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 737/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:50 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:50.921165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:50.922546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:50.938971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.939960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.945440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.946954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:50.949814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:50.952780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:50.972809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84522b79-80f1-4757-b143-bb98b7897731 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.709148 Oct 19 00:50:50.973841 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 829/1566] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:50:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:50.979872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bca5a26-4f18-43f6-a92a-1583dd23cf16", "name": "network-vif-plugged", "status": "completed", "tag": "c148a844-6240-4da3-af4a-7a46efc2f72e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:51.008006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.018509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.018977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.043019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] Creating event network-vif-plugged:c148a844-6240-4da3-af4a-7a46efc2f72e for instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 on n-h2-master-1 Oct 19 00:50:51.066547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-eacd6a14-f90e-4703-9173-b54886816beb req-51dc0c2f-1fdf-49b7-8f3d-518c77ab261c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091201 Oct 19 00:50:51.070229 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 830/1567] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:51.095979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:51.102848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:51.119031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.133530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.134001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.134763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.140252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.141275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.249150 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c09dadeb-f1be-4949-befa-7705a0999a91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.343218 Oct 19 00:50:51.249763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 738/1568] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 00:50:50 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-interface => generated 285 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:50:51.255596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a0dc04-d15e-4016-82cd-8f7cf0bd4e51 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4f61a60>, body: {"security_group_rule": {"parent_group_id": "1f3a32c6-0677-473c-879a-bd5113a87290", "ip_protocol": "tempest-999-42726714", "from_port": 22, "to_port": 22}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:51.574878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a3a0dc04-d15e-4016-82cd-8f7cf0bd4e51 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Invalid IP protocol tempest-999-42726714. Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a0dc04-d15e-4016-82cd-8f7cf0bd4e51 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 155 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: {"security_group_rule": {"parent_group_id": "1f3a32c6-0677-473c-879a-bd5113a87290", "ip_protocol": "tempest-999-42726714", "from_port": 22, "to_port": 22}} Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid IP protocol tempest-999-42726714. Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1f3a32c6-0677-473c-879a-bd5113a87290', 'ip_protocol': 'tempest-999-42726714', 'from_port': 22, 'to_port': 22}}} Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-42726714. Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-42726714. Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:51.581639 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-42726714. Oct 19 00:50:51.587497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:51.598514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a0dc04-d15e-4016-82cd-8f7cf0bd4e51 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: Invalid IP protocol tempest-999-42726714. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:51.600306 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3a0dc04-d15e-4016-82cd-8f7cf0bd4e51 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.349462 Oct 19 00:50:51.604887 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 739/1569] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:51 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 354 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:50:51.611382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:51.612286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:51.622926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.623653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.624399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.625487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.626130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.626762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.670771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:51.673397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.673942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.674466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.675082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lazy-loading 'fault' on Instance uuid f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:51.679321 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eccf5d46-edbb-4ab1-8ccb-974f14d1f023 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1534 microversion: 2.1 time: 0.607739 Oct 19 00:50:51.679919 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 831/1570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:51 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1534 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:51.684430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:51.685197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:51.691612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.708509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.709041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.709816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:51.710285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:51.711290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:51.937633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:51.967181 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5f11dc3a-de34-486d-94f9-b68ef7a585af tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1315 microversion: 2.1 time: 0.360896 Oct 19 00:50:51.972410 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 740/1571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:51 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:51.981028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0", "name": "network-vif-deleted", "tag": "f4d27491-00df-4758-9a2a-65e208ed340c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:52.003584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.004454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.005149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.030855 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] Creating event network-vif-deleted:f4d27491-00df-4758-9a2a-65e208ed340c for instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 on n-h2-master-1 Oct 19 00:50:52.044347 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-160b1fa7-8fef-49df-a106-eb280626f2ca req-6aa078f0-9d50-407a-896b-fb0c6a9ee0b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069990 Oct 19 00:50:52.045642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 741/1572] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:52.056240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-416845c5-7342-498b-aeda-b4e4ec134c1b tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4ff4040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-956433064", "description": "tempest-description-1689441294"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:52.315340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:52.330317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9809f165-ef88-4cd5-92ef-c3505a6e2073 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1198 microversion: 2.1 time: 0.648997 Oct 19 00:50:52.334182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 832/1573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:51 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1198 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:52.340871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:52.341611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] [instance: 799611dc-8d4a-45eb-97ef-04570a407208] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:52.351443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.352410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.353089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.353977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.354834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.355437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.374952 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] HTTP exception thrown: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Request method failure captured: Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 HTTP/1.1 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0l2VGda7gByjv10PtypuoKEuziYHuI7GcngfVOMc_rl_xwUKZaB8HlrTYP-ipbxUj0ztq3ADJNscBRClRc8vTS-ARjHivHIfpidNC1xtTgDiSZVmz_9LAiofGi8qgab2Kwgz6AidkmmNhYWunyZkf58yYFsgw8Z0YAxGDpdXbWVlWo Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8d60a9bdaee646508bf9f42d390191d3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8d60a9bdaee646508bf9f42d390191d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8d60a9bdaee646508bf9f42d390191d3"}]}] Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8d60a9bdaee646508bf9f42d390191d3 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1303918321 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2a896789dc814debba3a0a8f8f0c8943 Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerTestJSON-1303918321-project Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '799611dc-8d4a-45eb-97ef-04570a407208'} Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.379136 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. Oct 19 00:50:52.384425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.386421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] Returning 404 to user: Instance 799611dc-8d4a-45eb-97ef-04570a407208 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:52.387666 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd4c049a-031c-445a-b4f6-a82135bca512 tempest-ImagesOneServerTestJSON-1303918321 tempest-ImagesOneServerTestJSON-1303918321-project] 10.222.0.27 "GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208" status: 404 len: 111 microversion: 2.1 time: 0.051818 Oct 19 00:50:52.388414 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 833/1574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:52 2022] GET /compute/v2.1/servers/799611dc-8d4a-45eb-97ef-04570a407208 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:52.400523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9b26b1-a2c0-4697-889d-b75e43679ab7", "name": "network-vif-deleted", "tag": "49716c5a-7764-4dd5-9eab-2e186f7c8b08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:52.414539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.415238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.415856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.432396 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] Creating event network-vif-deleted:49716c5a-7764-4dd5-9eab-2e186f7c8b08 for instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 on n-h2-master-1 Oct 19 00:50:52.438394 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-33f0546c-4f1c-4523-a954-2c6086fccc74 req-f9893370-e1c7-4586-a4d2-18e5f94883d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044797 Oct 19 00:50:52.439499 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 834/1575] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:52.690346 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-416845c5-7342-498b-aeda-b4e4ec134c1b tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.642029 Oct 19 00:50:52.691070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 742/1576] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:50:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:52.709204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eaf95838-2693-4dfb-baf4-3dac82aafb04 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af5572dc0>, body: {"security_group_rule": {"parent_group_id": "3b2df6de-e88e-4be5-a6ed-f032db9f9977", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:52.716651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:52.717915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:52.728180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.729115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.729787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.730738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.731966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.732614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.775913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:52.776778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:52.777582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:52.778251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lazy-loading 'fault' on Instance uuid fd9b26b1-a2c0-4697-889d-b75e43679ab7 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:52.876302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:52.887786 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e4a3508-315c-4f3f-a4fe-8fc1e64af369 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 200 len: 1369 microversion: 2.1 time: 0.185698 Oct 19 00:50:52.888976 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-eaf95838-2693-4dfb-baf4-3dac82aafb04 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eaf95838-2693-4dfb-baf4-3dac82aafb04 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 138 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: {"security_group_rule": {"parent_group_id": "3b2df6de-e88e-4be5-a6ed-f032db9f9977", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3b2df6de-e88e-4be5-a6ed-f032db9f9977', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 00:50:52.890870 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 19 00:50:52.895688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:52.897337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eaf95838-2693-4dfb-baf4-3dac82aafb04 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:52.898429 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eaf95838-2693-4dfb-baf4-3dac82aafb04 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.197997 Oct 19 00:50:52.899559 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 835/1577] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:52 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:50:52.908702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c99ac4d-662b-47b8-b9ab-04c0fe29431e tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af4da60d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-298647520", "description": "tempest-description-70541053"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:52.909621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 743/1578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:52 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:52.997653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:52.998595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:53.011702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:53.012237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:53.012716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:53.013471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:53.016170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:53.016805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:53.091063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:53.091566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:53.092107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:53.092494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lazy-loading 'fault' on Instance uuid f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:53.231388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ab51886a81f4e1194e0c1ac50eef9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89259ef29e04d5e87793ae9aafdcbf9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:53.243186 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b89ff1cd-06e2-4590-9999-16fe68048010 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 200 len: 1315 microversion: 2.1 time: 0.249120 Oct 19 00:50:53.258627 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 744/1579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:52 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:53.360488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:53.361505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:53.371054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:53.372601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:53.374923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:53.376067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:53.376775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:53.377542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:53.472351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c99ac4d-662b-47b8-b9ab-04c0fe29431e tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.567632 Oct 19 00:50:53.474024 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 836/1580] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:50:52 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:53.486715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08a25734-4dd6-4cc2-aee8-70b519d9fc4d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af9410b80>, body: {"security_group_rule": {"parent_group_id": "424ae70c-9541-4bde-83e6-752e72a99920", "ip_protocol": "tcp", "from_port": 22, "to_port": 292660148}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:53.625105 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-08a25734-4dd6-4cc2-aee8-70b519d9fc4d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08a25734-4dd6-4cc2-aee8-70b519d9fc4d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 145 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: {"security_group_rule": {"parent_group_id": "424ae70c-9541-4bde-83e6-752e72a99920", "ip_protocol": "tcp", "from_port": 22, "to_port": 292660148}} Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'security_group_rule': {'parent_group_id': '424ae70c-9541-4bde-83e6-752e72a99920', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 292660148}}} Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 Oct 19 00:50:53.627329 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08a25734-4dd6-4cc2-aee8-70b519d9fc4d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 400 to user: Invalid port range 22:292660148. Valid TCP ports should be between 1-65535 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:53.635664 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08a25734-4dd6-4cc2-aee8-70b519d9fc4d tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.146208 Oct 19 00:50:53.637257 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 837/1581] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:53 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:50:53.641391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Action: 'create', calling method: .version_select at 0x7f2af93cb820>, body: {"security_group_rule": {"parent_group_id": "cdb66a71-4171-4774-bc80-fe8b2cf858b2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:53.684927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:53.695947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ee51109-131c-43bd-a175-5744e6395faf tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1381 microversion: 2.1 time: 0.341130 Oct 19 00:50:53.696577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 745/1582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:53 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1381 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:53.715960 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:50:53.716576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Neutron security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:50:53.717213 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.717213 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 138 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: {"security_group_rule": {"parent_group_id": "cdb66a71-4171-4774-bc80-fe8b2cf858b2", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: exception: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cdb66a71-4171-4774-bc80-fe8b2cf858b2', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:50:53.720265 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 404 to user: Security group cdb66a71-4171-4774-bc80-fe8b2cf858b2 does not exist Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-efb94931-4b2c-4d71-b3f8-b3137eae47c8'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5118fc9-52e1-4640-98cf-945ed76043ea tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.084574 Oct 19 00:50:53.729897 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 838/1583] 10.222.0.27 () {60 vars in 1195 bytes} [Wed Oct 19 00:50:53 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:53.740596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af935cc10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:53.824328 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:50:53.825241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Neutron security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 not found {{(pid=131449) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 19 00:50:53.825995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] HTTP exception thrown: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.825995 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Request method failure captured: Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-group-rules/1ff435e1-cfd2-4eb1-9467-b729d3aa5180 HTTP/1.1 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0nivqF_tsQkwg2XVAKLGlQFlQbk4i_N9OmA7BuUm6YVGM7w385rpy9_a0gUHtEqli0C9Xd4aGSH0QEBCF1kYzylBAmP-a0zWKVQGt83FAzBtgLveB36VzPnBwYVwoONnqgAvVy_S_aQ9cW24zhqNVRaGBM8_EQv6TEZsersEuUu240 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a044d2a9e1a24070af00b9705381e4e7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a044d2a9e1a24070af00b9705381e4e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a044d2a9e1a24070af00b9705381e4e7"}]}] Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a044d2a9e1a24070af00b9705381e4e7 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6795756089364e3d81d0c7c1589d35a9 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: exception: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1ff435e1-cfd2-4eb1-9467-b729d3aa5180'} Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:50:53.828172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] Oct 19 00:50:53.832428 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:53.838956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Returning 404 to user: Security group rule 1ff435e1-cfd2-4eb1-9467-b729d3aa5180 does not exist Oct 19 00:50:53.838956 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-50f0fa20-cdd2-4eb4-ab75-eeeb67b5c672'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:53.838956 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d507303-715d-475a-8419-bc4b3bee7faa tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/1ff435e1-cfd2-4eb1-9467-b729d3aa5180" status: 404 len: 199 microversion: 2.1 time: 0.110679 Oct 19 00:50:53.839823 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 839/1584] 10.222.0.27 () {58 vars in 1287 bytes} [Wed Oct 19 00:50:53 2022] DELETE /compute/v2.1/os-security-group-rules/1ff435e1-cfd2-4eb1-9467-b729d3aa5180 => generated 199 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:53.848504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-168b75f4-9040-468b-bffa-32fd3e9093f8 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af9410790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.189045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.190509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:54.199829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.201233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.202150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.203261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.204070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.205465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.381773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-168b75f4-9040-468b-bffa-32fd3e9093f8 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/424ae70c-9541-4bde-83e6-752e72a99920" status: 202 len: 0 microversion: 2.1 time: 0.537900 Oct 19 00:50:54.382431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 840/1585] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:50:53 2022] DELETE /compute/v2.1/os-security-groups/424ae70c-9541-4bde-83e6-752e72a99920 => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:54.387684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.388835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: fd9b26b1-a2c0-4697-889d-b75e43679ab7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:54.397906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.398913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.399613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.400673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.401422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.402298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.420044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] HTTP exception thrown: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Request method failure captured: Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 HTTP/1.1 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0heKTzQ0j4rNaHMESgFZirMxwWQUjFDY_9cS8FmIfbHfeb-z2cvAH-IRd2Dd_hK2J1ftylYzRz6ZeUzYZCI2cepwuLHzP-1EDM3E8ilfBRwaaULCD4B6gnWMiDlXXsxuc0TMXUqXPrMm_YULz-egF5YEbCCknFkALyF2-2zS9wPAVU Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd215e75fbda44c9a04e669cde1dfaa1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}] Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c5bef756c5c74e688ded867d98a6d29a Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: exception: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'fd9b26b1-a2c0-4697-889d-b75e43679ab7'} Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.421764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Returning 404 to user: Instance fd9b26b1-a2c0-4697-889d-b75e43679ab7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:54.426224 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8599be0-1891-43b6-9567-255186bc0a73 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7" status: 404 len: 111 microversion: 2.1 time: 0.039763 Oct 19 00:50:54.427898 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 841/1586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:54 2022] GET /compute/v2.1/servers/fd9b26b1-a2c0-4697-889d-b75e43679ab7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:54.433178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.433860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:54.442044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.442847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.443491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.444216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.445358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.446047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.470876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 HTTP/1.1 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0'} Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.474723 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. Oct 19 00:50:54.485838 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.488875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:54.490176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d06c6c87-295f-449c-816f-2d7d579829a4 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0" status: 404 len: 111 microversion: 2.1 time: 0.061958 Oct 19 00:50:54.495023 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 842/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:54 2022] GET /compute/v2.1/servers/f60368c0-e1e3-4ef4-b3d7-c19c8adaeae0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:54.501181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2546e957-45f1-454c-8d51-4d4c1a32f7c7 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af93ff9d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.616047 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-505307b4-f1b9-4aee-84ad-c26cb9d28d21 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1532 microversion: 2.1 time: 0.900155 Oct 19 00:50:54.625278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 746/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:53 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1532 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:50:54.637196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-664b6426-1347-4c5b-b5d2-2a9796d41fcc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '.version_select at 0x7f2af4f61820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.667300 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-664b6426-1347-4c5b-b5d2-2a9796d41fcc tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564590760" status: 202 len: 0 microversion: 2.1 time: 0.040474 Oct 19 00:50:54.668561 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 747/1589] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564590760 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:54.687293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:54.716068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.718698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.719412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.747256 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] Creating event network-changed:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h1-master-1 Oct 19 00:50:54.756573 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8355849f-dac4-4938-ad7a-fbe25b028720 req-6bb32de7-d76d-4316-9f29-3eb2af6d43a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086364 Oct 19 00:50:54.758046 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 748/1590] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:54.763714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a35875ec-a0d8-4704-b822-5c79b581b84c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af4f7a040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.807276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a35875ec-a0d8-4704-b822-5c79b581b84c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Image not found. Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a35875ec-a0d8-4704-b822-5c79b581b84c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8 HTTP/1.1 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b4b9128e-5064-49e5-8b2c-30e032c41ef8'} Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b4b9128e-5064-49e5-8b2c-30e032c41ef8 to delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4b9128e-5064-49e5-8b2c-30e032c41ef8 could not be found. Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.809552 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a35875ec-a0d8-4704-b822-5c79b581b84c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a35875ec-a0d8-4704-b822-5c79b581b84c tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8" status: 404 len: 62 microversion: 2.1 time: 0.055189 Oct 19 00:50:54.815441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 749/1591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:54 2022] DELETE /compute/v2.1/images/b4b9128e-5064-49e5-8b2c-30e032c41ef8 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:50:54.828197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:54.828518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:54.841998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.842510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.842961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:54.843690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:54.844149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:54.844581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.465383 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43f0b012-9bc4-4e29-adbb-b1360ef84db8 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1532 microversion: 2.1 time: 0.649031 Oct 19 00:50:55.466567 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 750/1592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:54 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1532 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:55.583039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2546e957-45f1-454c-8d51-4d4c1a32f7c7 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/3b2df6de-e88e-4be5-a6ed-f032db9f9977" status: 202 len: 0 microversion: 2.1 time: 1.086172 Oct 19 00:50:55.584238 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 843/1593] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:50:54 2022] DELETE /compute/v2.1/os-security-groups/3b2df6de-e88e-4be5-a6ed-f032db9f9977 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:55.589757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.590641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:55.603323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d64d4050-2fb6-48a1-8b56-45482f178800 tempest-ListImageFiltersNegativeTestJSON-1698322348 tempest-ListImageFiltersNegativeTestJSON-1698322348-project] Calling method '.version_select at 0x7f2af94443a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.610365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.610908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.611412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.612486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.612592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.612995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.633840 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d64d4050-2fb6-48a1-8b56-45482f178800 tempest-ListImageFiltersNegativeTestJSON-1698322348 tempest-ListImageFiltersNegativeTestJSON-1698322348-project] HTTP exception thrown: Image not found. Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d64d4050-2fb6-48a1-8b56-45482f178800 tempest-ListImageFiltersNegativeTestJSON-1698322348 tempest-ListImageFiltersNegativeTestJSON-1698322348-project] Request method failure captured: Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/images/ae3097d3-aa11-4dc6-975f-3eb4ee338466 HTTP/1.1 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0nuYpszPxURhUBzUPiUkgyctFYQJlniOJ0F27qzWHolhaR6zBHz5A03z5SXmXGbRxfdWH-8QtDA6l_l-xiWaXBvobQ02_9uNCL30GbSRbdT4kZEeCcyTFhe-w3h_UP17hoSVFwHBYcAIoew09qvhzHI7Mo7ggEwR6BycgSZkdBpkKo Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 368fcef85f354a39ae2db155ed1efebc Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1698322348 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_368fcef85f354a39ae2db155ed1efebc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/368fcef85f354a39ae2db155ed1efebc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/368fcef85f354a39ae2db155ed1efebc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/368fcef85f354a39ae2db155ed1efebc"}]}] Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1698322348 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 368fcef85f354a39ae2db155ed1efebc Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1698322348 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ListImageFiltersNegativeTestJSON-1698322348-project Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d5c223545f214383ad8c867a233971de Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1698322348-project Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ae3097d3-aa11-4dc6-975f-3eb4ee338466'} Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae3097d3-aa11-4dc6-975f-3eb4ee338466 Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:50:55.636352 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae3097d3-aa11-4dc6-975f-3eb4ee338466 could not be found. Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:50:55.642942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 HTTP/1.1 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6d36caa6-279a-427a-b584-794e5fc67754'} Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:50:55.649625 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d3b1a1f-575f-4dbb-a9c0-77aa836b871d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 404 len: 111 microversion: 2.1 time: 0.063839 Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 844/1594] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:55 2022] DELETE /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.661104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:55.664409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d64d4050-2fb6-48a1-8b56-45482f178800 tempest-ListImageFiltersNegativeTestJSON-1698322348 tempest-ListImageFiltersNegativeTestJSON-1698322348-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:55.664909 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d64d4050-2fb6-48a1-8b56-45482f178800 tempest-ListImageFiltersNegativeTestJSON-1698322348 tempest-ListImageFiltersNegativeTestJSON-1698322348-project] 10.222.0.27 "GET /compute/v2.1/images/ae3097d3-aa11-4dc6-975f-3eb4ee338466" status: 404 len: 62 microversion: 2.1 time: 0.196978 Oct 19 00:50:55.665495 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 751/1595] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:50:55 2022] GET /compute/v2.1/images/ae3097d3-aa11-4dc6-975f-3eb4ee338466 => generated 62 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:50:55.668734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.669243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.669983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.670128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.672927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.673781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.674565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.675282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.675799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.676355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.677158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.677626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.678062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.705511 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2d2638c-efb4-44dc-a204-0e868bd90032 tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038829 Oct 19 00:50:55.706368 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 752/1596] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 00:50:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:55.711413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f848e3e0-0337-40bf-885c-361552d305da tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af9422af0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.723506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:50:55.816286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-defcaaf5-4e5d-4aab-87c1-f94d185dbd6b tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 204 len: 0 microversion: 2.1 time: 0.165114 Oct 19 00:50:55.821574 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 845/1597] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:55 2022] DELETE /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:50:55.833761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:55.839119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: 6d36caa6-279a-427a-b584-794e5fc67754] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:55.846182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.846791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.847343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.848266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.848999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.849652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.865868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 HTTP/1.1 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6d36caa6-279a-427a-b584-794e5fc67754'} Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.868596 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. Oct 19 00:50:55.874141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:55.876044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance 6d36caa6-279a-427a-b584-794e5fc67754 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:55.877022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0263f1cc-8843-4696-a846-c7ada3d9906d tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754" status: 404 len: 111 microversion: 2.1 time: 0.051584 Oct 19 00:50:55.883290 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 846/1598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:55 2022] GET /compute/v2.1/servers/6d36caa6-279a-427a-b584-794e5fc67754 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:55.890330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:55.892980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:55.899228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.899797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.900459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.901463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:55.902135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:55.902755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:55.933193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lazy-loading 'flavor' on Instance uuid 9bca5a26-4f18-43f6-a92a-1583dd23cf16 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:50:55.948981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Going to try to live migrate instance to n-h1-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:50:56.188287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f848e3e0-0337-40bf-885c-361552d305da tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1f3a32c6-0677-473c-879a-bd5113a87290" status: 202 len: 0 microversion: 2.1 time: 0.480808 Oct 19 00:50:56.193920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 753/1599] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:50:55 2022] DELETE /compute/v2.1/os-security-groups/1f3a32c6-0677-473c-879a-bd5113a87290 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:56.202567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:56.203666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:56.216156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:56.216973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:56.217676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:56.218645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:56.219313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:56.219959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:56.529543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:56.540228 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6d171e3-e6ec-4456-99d8-ec39a5ca6a88 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1468 microversion: 2.1 time: 0.344140 Oct 19 00:50:56.545018 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 754/1600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:56 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1468 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:56.567069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5d859ed-977b-47b2-9c9c-e1a87411e1fd tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af5639d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:56.628156 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5d859ed-977b-47b2-9c9c-e1a87411e1fd tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819995624" status: 202 len: 0 microversion: 2.1 time: 0.064664 Oct 19 00:50:56.629054 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 755/1601] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1819995624 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:56.635714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77381005-3581-484d-9a92-4f1e86ae5980 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af4f7a160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:57.296727 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77381005-3581-484d-9a92-4f1e86ae5980 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c5abb07a-1f73-453d-bf1b-1f4b89a9a7de" status: 202 len: 0 microversion: 2.1 time: 0.666294 Oct 19 00:50:57.297190 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 756/1602] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:50:56 2022] DELETE /compute/v2.1/os-security-groups/c5abb07a-1f73-453d-bf1b-1f4b89a9a7de => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:57.306245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b6e2b8b-d575-43e6-85ac-43d94e753d93 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] Calling method '.version_select at 0x7f2af5bd7670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:58.405427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b6e2b8b-d575-43e6-85ac-43d94e753d93 tempest-SecurityGroupRulesNegativeTestJSON-2078231714 tempest-SecurityGroupRulesNegativeTestJSON-2078231714-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b3b81fdf-b960-45e8-b099-0c8f4335fb76" status: 202 len: 0 microversion: 2.1 time: 1.103554 Oct 19 00:50:58.408873 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 757/1603] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:50:57 2022] DELETE /compute/v2.1/os-security-groups/b3b81fdf-b960-45e8-b099-0c8f4335fb76 => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:50:58.413236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:58.414261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:58.424547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:58.425311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:58.425928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:58.426897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:58.427578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:58.428162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.052989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:50:59.072241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3988d8b-41f1-4a0c-a987-79a91e834c85 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1468 microversion: 2.1 time: 0.663788 Oct 19 00:50:59.078903 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 758/1604] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:58 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1468 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:50:59.157333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee9d3317-a2af-4394-a686-382fd8599ce4 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af4f7a0d0>, body: {"keypair": {"name": "tempest-keypair-408324756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/4O3Ea5JMSAD5MTCtI2Xz7N6dlklSyWzQmhnUI1zgItoUO9Ldj15UhpqyRv6FpSzaLottP6A//zJ9cVOXEzoVacoYmL4nj1y0ERy4+ACsigxq1hB9KXGj9ZzvRkgY87Q=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:59.176848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ee9d3317-a2af-4394-a686-382fd8599ce4 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:59.189919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ee9d3317-a2af-4394-a686-382fd8599ce4 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:59.230497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee9d3317-a2af-4394-a686-382fd8599ce4 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.150149 Oct 19 00:50:59.231836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 759/1605] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:50:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:59.250259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b27efc1-a6e1-4801-b6d9-c34e68f23142 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '.version_select at 0x7f2af4d9e8b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.296371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6b27efc1-a6e1-4801-b6d9-c34e68f23142 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Image not found. Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b27efc1-a6e1-4801-b6d9-c34e68f23142 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/0a3ff272-6ed6-48b0-97b0-315097c96189 HTTP/1.1 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0a3ff272-6ed6-48b0-97b0-315097c96189'} Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0a3ff272-6ed6-48b0-97b0-315097c96189 to delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a3ff272-6ed6-48b0-97b0-315097c96189 could not be found. Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.299351 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:50:59.305750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.308569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b27efc1-a6e1-4801-b6d9-c34e68f23142 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:59.310405 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b27efc1-a6e1-4801-b6d9-c34e68f23142 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/images/0a3ff272-6ed6-48b0-97b0-315097c96189" status: 404 len: 62 microversion: 2.1 time: 0.076652 Oct 19 00:50:59.311582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 760/1606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:59 2022] DELETE /compute/v2.1/images/0a3ff272-6ed6-48b0-97b0-315097c96189 => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:50:59.324756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee3abc94-31b5-434e-8cf2-d7d8756a3698 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af4f7baf0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.340352 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee3abc94-31b5-434e-8cf2-d7d8756a3698 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-408324756" status: 200 len: 497 microversion: 2.1 time: 0.027414 Oct 19 00:50:59.341717 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 761/1607] 10.222.0.27 () {58 vars in 1215 bytes} [Wed Oct 19 00:50:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-408324756 => generated 497 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:59.360777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.361621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:59.376236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.377083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.377728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.378638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.379276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.379884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.403141 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a HTTP/1.1 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a'} Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:59.405093 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.410092 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.410934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:59.412675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c3e6c91-027a-4d35-834e-13496d2f93e7 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 404 len: 111 microversion: 2.1 time: 0.064068 Oct 19 00:50:59.414040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 762/1608] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:50:59 2022] DELETE /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:59.420797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f723617-4b40-4fdd-9160-e7141d0b1778 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af9494700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.456543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f723617-4b40-4fdd-9160-e7141d0b1778 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-408324756" status: 202 len: 0 microversion: 2.1 time: 0.040813 Oct 19 00:50:59.457583 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 763/1609] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-408324756 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:59.463092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8", "name": "network-vif-deleted", "tag": "3cd546cc-df74-4b8d-9a2f-1797f102c98c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:59.484196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.485870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.487672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.488377 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe038016-f9b8-4396-b2a7-7ee41d80b73c tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16/action" status: 202 len: 0 microversion: 2.1 time: 3.603404 Oct 19 00:50:59.489073 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 847/1610] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:50:55 2022] POST /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16/action => generated 0 bytes in 3605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:59.495455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.496088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] [instance: ca86d4f0-73e6-407c-b6a9-3b7f3048f09a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:59.505361 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] Creating event network-vif-deleted:3cd546cc-df74-4b8d-9a2f-1797f102c98c for instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 on n-h1-master-1 Oct 19 00:50:59.515693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d70081a3-0bf4-497f-ba52-8756a1380efe req-33bb63b3-252d-4057-af4d-b8aaa593c429 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056621 Oct 19 00:50:59.517820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 764/1611] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:59.527112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58583cd1-0534-4153-b14d-cce8ffaaa466 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af9444820>, body: {"keypair": {"name": "tempest-keypair-1088442617", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLo7EFltUUz1GhGGMZmYt2hTgGTIEnxvVtI9CEJNt6n6lnt3ZJsvfnR3P5eRROXlp56MxnM5IGfQ2fwmyD1GefLgCIalK2di/2VzLXRh4Ht/QQaBuEOV+tFTklkR3OOybQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:59.534153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.537175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.537659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.546277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.549224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.549714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.558487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-58583cd1-0534-4153-b14d-cce8ffaaa466 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:59.571223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] HTTP exception thrown: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.571913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-58583cd1-0534-4153-b14d-cce8ffaaa466 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Request method failure captured: Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a HTTP/1.1 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0lYvnKz351hEQNUyg-i0CvXUzydqzXrpFYqOPaT21Z-q03bOqDwCtbNazmqmSw8S8MbTjTTZurHSfBZ-771pHGqgqFoCsUvG222A78dLnT9QlmgVVI4UA089i9t42XVKj2Grb9MkuFmfS3UlBkHYfmrp0Dm2iz1VR--7hhrh2J2NcY Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c89259ef29e04d5e87793ae9aafdcbf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c89259ef29e04d5e87793ae9aafdcbf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c89259ef29e04d5e87793ae9aafdcbf9"}]}] Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c89259ef29e04d5e87793ae9aafdcbf9 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2ab51886a81f4e1194e0c1ac50eef9d4 Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1688569405-project Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ca86d4f0-73e6-407c-b6a9-3b7f3048f09a'} Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.573697 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. Oct 19 00:50:59.579020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:50:59.582134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] Returning 404 to user: Instance ca86d4f0-73e6-407c-b6a9-3b7f3048f09a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:50:59.583541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df0bcf4d-786c-480b-a17c-5e437d758968 tempest-ImagesOneServerNegativeTestJSON-1688569405 tempest-ImagesOneServerNegativeTestJSON-1688569405-project] 10.222.0.27 "GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a" status: 404 len: 111 microversion: 2.1 time: 0.093509 Oct 19 00:50:59.584717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 848/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:59 2022] GET /compute/v2.1/servers/ca86d4f0-73e6-407c-b6a9-3b7f3048f09a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:50:59.620545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.623912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:50:59.635621 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:59.637759 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58583cd1-0534-4153-b14d-cce8ffaaa466 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117221 Oct 19 00:50:59.638671 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 765/1613] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:50:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:59.653323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf200dfe-956b-4c49-b4bf-0d5d11bb0c83 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af93839d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.664371 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:50:59.673209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.674106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.674623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.676982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:50:59.684449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:50:59.684856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:50:59.688160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf200dfe-956b-4c49-b4bf-0d5d11bb0c83 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088442617" status: 202 len: 0 microversion: 2.1 time: 0.038807 Oct 19 00:50:59.689241 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 766/1614] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1088442617 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:59.711362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d2f420d-4703-4af6-8c62-f5a7a0df1937 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af9422ee0>, body: {"keypair": {"name": "tempest-keypair-1404878908", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:59.737502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0d2f420d-4703-4af6-8c62-f5a7a0df1937 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:59.745852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0d2f420d-4703-4af6-8c62-f5a7a0df1937 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:50:59.875738 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d2f420d-4703-4af6-8c62-f5a7a0df1937 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.176836 Oct 19 00:50:59.885276 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 767/1615] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:50:59 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:50:59.890771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2939b8b8-124b-470c-8f2f-2c214e3b548c tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af93329d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:50:59.921067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2939b8b8-124b-470c-8f2f-2c214e3b548c tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404878908" status: 202 len: 0 microversion: 2.1 time: 0.033747 Oct 19 00:50:59.932929 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 768/1616] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:50:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404878908 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:50:59.946610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-589d4ba8-b475-475f-a90e-6c9d1f8d24d0 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af555d4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1319987181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBXFGelYCpELPFEhuCd228xJC2T2eg37TK5raYcYAwnqnK/gnAKdLqsEL4rfRfBg+S+sI4McfyIpgpynutYs/4s5AhC7pVfqUwAaTSV0SC+EUYrGKntf92fAOFruMWQQYA=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:50:59.967115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-589d4ba8-b475-475f-a90e-6c9d1f8d24d0 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:50:59.981706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-589d4ba8-b475-475f-a90e-6c9d1f8d24d0 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:00.021728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-589d4ba8-b475-475f-a90e-6c9d1f8d24d0 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.087353 Oct 19 00:51:00.023286 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 769/1617] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:50:59 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:00.037618 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5505bdd6-95a9-42c0-ac73-e108cc524313 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af93aa820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2125851266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3QJPr58U+Ebqu2eLK7Ol1jOPfNgdpxDQ9Fym8oalytsqYFfEnNuX3ewlSj5zobOn98rYpsi3muacZ7tjOS1hm9eBkyaWkD//FSTHNc/vdf3vnT7BtvWy65YE0JPttgVQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:00.076184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5505bdd6-95a9-42c0-ac73-e108cc524313 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:00.084667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5505bdd6-95a9-42c0-ac73-e108cc524313 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:00.118455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5505bdd6-95a9-42c0-ac73-e108cc524313 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.085928 Oct 19 00:51:00.126682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 770/1618] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:51:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:51:00.126682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:00.127579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:00.139859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:00.140377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:00.141751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:00.142513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:00.145652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:00.146246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:00.189484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:00.190554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:00.191019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:00.192716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lazy-loading 'fault' on Instance uuid e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:00.304337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:00.304587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:00.319673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ecc2d890-a9bc-4377-83b3-0b80fa441aac tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 200 len: 1303 microversion: 2.1 time: 0.198902 Oct 19 00:51:00.320588 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 771/1619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:00 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:00.321726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1296b8e3-1aa6-485e-a3df-210fb82d2d02 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.733194 Oct 19 00:51:00.323506 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 849/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:50:59 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:00.341522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9365455-3380-466c-a551-600b8cf2ad5d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Action: 'create', calling method: .version_select at 0x7f2af4f61820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2050726127", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt+SPJpTON2z6zonQnQWqFQH8lClZ65iRwcopbfEJAV9MUP0U0uxktv1nKVtY+BTKbZh6IUE5D9Ns9okqXbrG8yV0LL221mZI4gHh/9Z/tcrz8uzRMYdZ0R4CpAhcW/Cg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:00.386172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f9365455-3380-466c-a551-600b8cf2ad5d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:00.398644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f9365455-3380-466c-a551-600b8cf2ad5d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Getting quotas for user e382623f1cf8489db5c5e75c65caef20 and project 400e1a39f12245c394ef6e85c5a514ae. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:00.438681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9365455-3380-466c-a551-600b8cf2ad5d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.117293 Oct 19 00:51:00.441953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 772/1621] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:51:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:00.462269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1009efe7-d52c-4d60-bd68-4de31f2e5458 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af93b1820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:00.488885 n-d-master-1 devstack@n-api.service[131449]: WARNING oslo_db.sqlalchemy.utils [None req-1009efe7-d52c-4d60-bd68-4de31f2e5458 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:51:00.507708 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1009efe7-d52c-4d60-bd68-4de31f2e5458 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.055599 Oct 19 00:51:00.510880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 850/1622] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:51:00 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:00.522336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-946086a8-6e41-41e2-8963-3759d3fbfe9e tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af555dd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:00.574339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-946086a8-6e41-41e2-8963-3759d3fbfe9e tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2050726127" status: 202 len: 0 microversion: 2.1 time: 0.056700 Oct 19 00:51:00.575176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 773/1623] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 00:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2050726127 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:51:00.585962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f5cb1e4-36dc-4a64-a3fd-d2606ca6eca5 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af93d3e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:00.618072 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f5cb1e4-36dc-4a64-a3fd-d2606ca6eca5 tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2125851266" status: 202 len: 0 microversion: 2.1 time: 0.037607 Oct 19 00:51:00.621201 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 851/1624] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 00:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2125851266 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:51:00.630034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c45d471e-ee67-43da-b392-964f8eaada0d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] Calling method '.version_select at 0x7f2af5f59550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:00.665879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c45d471e-ee67-43da-b392-964f8eaada0d tempest-KeyPairsV2TestJSON-1103209048 tempest-KeyPairsV2TestJSON-1103209048-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1319987181" status: 202 len: 0 microversion: 2.1 time: 0.036691 Oct 19 00:51:00.669172 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 774/1625] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 00:51:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1319987181 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:51:01.349750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:01.350982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:01.351358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:01.352080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:01.370402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.371545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.373283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.373626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.376598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.378130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.378833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.379626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.380364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.380862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.383136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.384110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.418619 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] HTTP exception thrown: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Request method failure captured: Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 HTTP/1.1 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0heKTzQ0j4rNaHMESgFZirMxwWQUjFDY_9cS8FmIfbHfeb-z2cvAH-IRd2Dd_hK2J1ftylYzRz6ZeUzYZCI2cepwuLHzP-1EDM3E8ilfBRwaaULCD4B6gnWMiDlXXsxuc0TMXUqXPrMm_YULz-egF5YEbCCknFkALyF2-2zS9wPAVU Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd215e75fbda44c9a04e669cde1dfaa1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}] Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c5bef756c5c74e688ded867d98a6d29a Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8'} Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:01.420186 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. Oct 19 00:51:01.425361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:01.428251 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:01.431231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Returning 404 to user: Instance e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:51:01.432805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8695b15e-6ecf-4a59-a811-9074fdaf3c8d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8" status: 404 len: 111 microversion: 2.1 time: 0.093269 Oct 19 00:51:01.436312 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 852/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:01 2022] GET /compute/v2.1/servers/e9cc0c8d-017d-4ec0-9ae9-fd648f2c6af8 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:51:01.449658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:01.452342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:01.465531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.466120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.467365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.469587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.471160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.471796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.511303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:51:01.554992 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:01.683191 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dffb7b15-5efd-4a5d-9bdd-4b8018357354 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 204 len: 0 microversion: 2.1 time: 0.241154 Oct 19 00:51:01.688048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 853/1627] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:51:01 2022] DELETE /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:51:01.698341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:01.700489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:01.709510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.711202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.712119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:01.713481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:01.714197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:01.714953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:02.176493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:02.193627 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d759fa39-5d09-42e4-a839-318f829e7f2d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.848223 Oct 19 00:51:02.196404 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 775/1628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:01 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:02.234049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:02.251279 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bfd4aac-26b6-4303-80a2-2c718510fd5d tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1468 microversion: 2.1 time: 0.560276 Oct 19 00:51:02.267282 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 854/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:01 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1468 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:03.222142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:03.222827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:03.249697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:03.250199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:03.250694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:03.251430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:03.261792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:03.262209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:03.283147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:03.283936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:03.294178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:03.294674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:03.295189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:03.295831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:03.296286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:03.300678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:04.670896 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:04.683855 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-90609262-479b-4396-abce-b4779f3c836c tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1468 microversion: 2.1 time: 1.405659 Oct 19 00:51:04.688468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:04.696733 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 855/1630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:03 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1468 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:04.698388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3451f544-5099-46b1-8660-46ab8a9e734c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.480079 Oct 19 00:51:04.703120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 776/1631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:03 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:04.888922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6586352-0a39-4899-96f3-8d10855a64fc", "name": "network-vif-deleted", "tag": "ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:04.911947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:04.914035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:04.914993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:04.950223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] Creating event network-vif-deleted:ab44cbf8-d8d8-45fb-84d8-f9ec7799eb82 for instance c6586352-0a39-4899-96f3-8d10855a64fc on n-h2-master-1 Oct 19 00:51:04.960268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b254872e-f4a6-48f3-8bf9-b2827e6c1d15 req-b617b466-426c-44a1-a0cf-0a143dc766f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076586 Oct 19 00:51:04.961619 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 856/1632] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:05.707982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:05.708932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:05.720587 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:05.724661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:05.729019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:05.729904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:05.734876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:05.735865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:05.747268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:05.747860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:05.748378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:05.749214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:05.749743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:05.749927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:05.750293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:05.752376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:05.753189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:05.846379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:05.859330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:05.859891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:05.860433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lazy-loading 'fault' on Instance uuid c6586352-0a39-4899-96f3-8d10855a64fc {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:06.113840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5bef756c5c74e688ded867d98a6d29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd215e75fbda44c9a04e669cde1dfaa1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:06.123728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-878dc2a7-a4c8-49fd-858f-95b01b2a7c32 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 200 len: 1303 microversion: 2.1 time: 0.420105 Oct 19 00:51:06.124420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 777/1633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:05 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 1303 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:06.388071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:06.397171 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e482e8ba-0d30-4ddc-9be2-00bc25af9580 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.673309 Oct 19 00:51:06.401208 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 857/1634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:05 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:07.153406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:07.157481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] [instance: c6586352-0a39-4899-96f3-8d10855a64fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:07.168570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:07.169414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:07.170476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:07.171991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:07.172654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:07.174120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:07.196731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] HTTP exception thrown: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Request method failure captured: Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc HTTP/1.1 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0heKTzQ0j4rNaHMESgFZirMxwWQUjFDY_9cS8FmIfbHfeb-z2cvAH-IRd2Dd_hK2J1ftylYzRz6ZeUzYZCI2cepwuLHzP-1EDM3E8ilfBRwaaULCD4B6gnWMiDlXXsxuc0TMXUqXPrMm_YULz-egF5YEbCCknFkALyF2-2zS9wPAVU Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fd215e75fbda44c9a04e669cde1dfaa1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fd215e75fbda44c9a04e669cde1dfaa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fd215e75fbda44c9a04e669cde1dfaa1"}]}] Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: fd215e75fbda44c9a04e669cde1dfaa1 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MigrationsAdminTest-1092925047 Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c5bef756c5c74e688ded867d98a6d29a Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MigrationsAdminTest-1092925047-project Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c6586352-0a39-4899-96f3-8d10855a64fc'} Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:07.199476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. Oct 19 00:51:07.206342 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:51:07.212419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] Returning 404 to user: Instance c6586352-0a39-4899-96f3-8d10855a64fc could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:51:07.214037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7fa7dd88-01c3-443d-9560-b7f21b9d31a9 tempest-MigrationsAdminTest-1092925047 tempest-MigrationsAdminTest-1092925047-project] 10.222.0.27 "GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc" status: 404 len: 111 microversion: 2.1 time: 0.066817 Oct 19 00:51:07.220735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 778/1635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:07 2022] GET /compute/v2.1/servers/c6586352-0a39-4899-96f3-8d10855a64fc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:51:07.447407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:07.451251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:07.482947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:07.483531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:07.485451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:07.489179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:07.494858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:07.495423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:08.080402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:08.098697 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09de5b46-5dfe-4461-972c-f82c7aa48f9b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.671144 Oct 19 00:51:08.103738 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 858/1636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:07 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:09.130917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:09.131593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:09.143194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:09.143736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:09.144217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:09.144942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:09.145383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:09.145829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:10.005279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:10.059606 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e83bb0e4-8d81-4f93-870e-8386f359e913 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.932690 Oct 19 00:51:10.060674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 779/1637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:09 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:11.110224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:11.110902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:11.121168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:11.127006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:11.131112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:11.133155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:11.133805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:11.135071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:12.265755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:12.284371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c8ef281-55e4-47ba-80e0-e6dbe1224699 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.177297 Oct 19 00:51:12.286842 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 859/1638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:11 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:13.320701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:13.322948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:13.330537 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=24 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:13.332907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:13.335133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:13.336157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:13.337565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:13.338379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:13.339051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:13.767506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:13.778344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ca20f67-38b0-4b24-beee-f35d68ee6622 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.466817 Oct 19 00:51:13.809979 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 780/1639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:13 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:14.815217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:14.816123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:14.829603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:14.837492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:14.839497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:14.841115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:14.842609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:14.844905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:15.130530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1743862341", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:15.297337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:15.449477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:15.458794 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a027256d-a62d-45bd-8712-d0701483e91b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.647347 Oct 19 00:51:15.459804 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 781/1640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:14 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:15.853887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eea13fa4-69e1-4ab2-b8c9-a5f86cd40a6a tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] Calling method '.version_select at 0x7f2af555ddc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:16.009646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eea13fa4-69e1-4ab2-b8c9-a5f86cd40a6a tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] 10.222.0.27 "GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340" status: 200 len: 784 microversion: 2.1 time: 0.345135 Oct 19 00:51:16.010687 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 782/1641] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:51:15 2022] GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340 => generated 784 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:51:16.031767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c9e0f71-7fc0-420d-9543-e42b09c718e3 tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] Calling method '.version_select at 0x7f2af5861dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:16.227032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c9e0f71-7fc0-420d-9543-e42b09c718e3 tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.203293 Oct 19 00:51:16.229145 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 783/1642] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:16 2022] GET /compute/v2.1/images => generated 445 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:16.245631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43d161ff-3544-45e6-b656-fab6b93a32a3 tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] Calling method '.version_select at 0x7f2af4ff48b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:16.280255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:16.280990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:16.281342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:16.281755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:16.282228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:16.321146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:16.321897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:16.323145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:16.325154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:16.325848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:16.326751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:16.336982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43d161ff-3544-45e6-b656-fab6b93a32a3 tempest-ListImagesTestJSON-860442360 tempest-ListImagesTestJSON-860442360-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.096146 Oct 19 00:51:16.339079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 784/1643] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:51:16 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:16.376312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:16.392505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:16.459858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:16.463985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:16.509029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:16.509724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:16.533350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:16.533968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:16.534426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:16.541257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:16.542934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:16.546610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:16.556001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c491d7af-cf71-4339-aeb2-13dd1c033df7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.155854 Oct 19 00:51:16.559759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 860/1644] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:51:16.574206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9e176c2-13c7-4906-9060-3c03512f2c3f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:16.575189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9e176c2-13c7-4906-9060-3c03512f2c3f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:16.707883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9e176c2-13c7-4906-9060-3c03512f2c3f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:16.725095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9e176c2-13c7-4906-9060-3c03512f2c3f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1217 microversion: 2.1 time: 0.155519 Oct 19 00:51:16.753050 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 861/1645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:16 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:17.056662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:17.073646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-874c47c7-346c-4727-ba27-453ac2fd857a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.570253 Oct 19 00:51:17.074362 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 785/1646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:16 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:17.755150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:17.756546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:17.777846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:17.781782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:17.781782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:17.781782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:17.781782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:17.781782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:17.983888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:18.000093 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f334e54-3ebe-4021-93a5-16bdf01c19e6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1221 microversion: 2.1 time: 0.250522 Oct 19 00:51:18.000665 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 862/1647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:17 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1221 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:18.100519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:18.101269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:18.115757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:18.116276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:18.116890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:18.117710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:18.118181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:18.129861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:18.512281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e92b762a-6cb7-4416-8ca7-524924eb9851 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Action: 'create', calling method: .version_select at 0x7f2af9370280>, body: {"keypair": {"name": "tempest-keypair-176673103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGQ9cFIxCdQZERD96cXzuss/1gEZn9T7BiJKvtTQljXkc3IZbOytBigdizhkeNJC+tTNWRfMEaktqITfM/B5GcLaA06oDFzfYWEctoa9HTT0EBR0+rxV+H+R8oOXaQEiQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:18.575738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e92b762a-6cb7-4416-8ca7-524924eb9851 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for project 3b47200f231b4ac0a9e658295916e32b. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:18.604658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e92b762a-6cb7-4416-8ca7-524924eb9851 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for user e1f203c2e330487e9a1bdfff7e60af3b and project 3b47200f231b4ac0a9e658295916e32b. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:18.653897 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e92b762a-6cb7-4416-8ca7-524924eb9851 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.452787 Oct 19 00:51:18.662273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 863/1648] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:51:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:51:18.858643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:18.873711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa1fc97b-ccc0-48c2-a106-f066738c07fc tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.778137 Oct 19 00:51:18.880177 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 786/1649] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:18 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:19.023986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:19.024633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:19.043418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:19.048135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:19.050208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:19.052101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:19.053889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:19.057568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:19.300091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:19.313213 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f993edd-c270-482c-a53d-026950674e22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1269 microversion: 2.1 time: 0.290712 Oct 19 00:51:19.322344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 864/1650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:19 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:19.686492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bca5a26-4f18-43f6-a92a-1583dd23cf16", "name": "network-vif-unplugged", "status": "completed", "tag": "c148a844-6240-4da3-af4a-7a46efc2f72e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:19.703099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:19.703585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:19.704022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:19.739825 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] Creating event network-vif-unplugged:c148a844-6240-4da3-af4a-7a46efc2f72e for instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 on n-h2-master-1 Oct 19 00:51:19.750610 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-13f839ba-5d54-48e8-bddf-11f4ef757aa5 req-3afeb745-8458-48be-8587-9114fce394a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067746 Oct 19 00:51:19.753934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 787/1651] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:19.904672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:19.905545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:19.920419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:19.923426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:19.924918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:19.931686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:19.932594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:19.934016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:20.351357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:20.352130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:20.371486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:20.372371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:20.372651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:20.373574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:20.374052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:20.374580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:21.307333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:21.317328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0eddc7c9-07fd-41b9-8711-1e91d5e61bc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1275 microversion: 2.1 time: 0.971819 Oct 19 00:51:21.326146 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 788/1652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:20 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1275 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:21.343225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:21.353919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a1788a7-2719-4e7e-8163-01dc927382e6 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.454560 Oct 19 00:51:21.360190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 865/1653] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:19 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:21.719156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Calling method '.version_select at 0x7f2af4e33310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:21.732868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:21.733373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:21.733825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:21.735089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:21.735577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:21.736021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:21.764721 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12880a15-bea0-474a-b3cc-ebf9a464d3d1 tempest-AbsoluteLimitsTestJSON-854363806 tempest-AbsoluteLimitsTestJSON-854363806-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.435916 Oct 19 00:51:21.765345 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 789/1654] 10.222.0.27 () {58 vars in 1122 bytes} [Wed Oct 19 00:51:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:21.989605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bca5a26-4f18-43f6-a92a-1583dd23cf16", "tag": "c148a844-6240-4da3-af4a-7a46efc2f72e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:22.061513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.065107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.072044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.116639 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] Creating event network-changed:c148a844-6240-4da3-af4a-7a46efc2f72e for instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 on n-h2-master-1 Oct 19 00:51:22.134715 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ed116343-31f7-4337-8511-b3d76add9fc4 req-89a183da-a392-4ac8-874c-151f02e093ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150931 Oct 19 00:51:22.140276 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 866/1655] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:22.355319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:22.356269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:22.391487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.396174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.397777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.398783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:22.400081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:22.401285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.403427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.404965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.414863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.415632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.416085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.417117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.420699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.421564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.726325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:22.738820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-911781f9-5417-4eaf-833f-868accfc6f96 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1275 microversion: 2.1 time: 0.389927 Oct 19 00:51:22.741301 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 790/1656] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:22 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:22.899006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:22.899825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:22.902290 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=4,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:22.923969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.924912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.926198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.928426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:22.929191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:22.929847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:22.983511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:51:23.231641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0ae669e-4cd2-4a34-86af-e730f5b17607 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 204 len: 0 microversion: 2.1 time: 0.336045 Oct 19 00:51:23.236590 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 791/1657] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:51:22 2022] DELETE /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:51:23.251805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:23.254360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:23.270849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:23.273438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:23.274250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:23.278845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:23.279710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:23.280379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:23.966960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:23.971222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:23.980787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6329b4d3-0e7b-488c-ac58-0ae515afc873 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1664 microversion: 2.1 time: 0.742097 Oct 19 00:51:23.988223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ca034909-98b5-49bb-81fb-2c450ffb6005 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.596340 Oct 19 00:51:23.991701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 867/1658] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:22 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:24.009568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 792/1659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:23 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1664 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:24.009857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:24.012754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:24.047717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:24.051238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:24.053775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:24.055003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:24.056228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:24.056969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:24.279656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:24.298612 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-776dcf5c-c542-4c3b-84d4-c8f5180381ed tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1275 microversion: 2.1 time: 0.305716 Oct 19 00:51:24.299970 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 868/1660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:23 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1275 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:25.006468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:25.007335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:25.016059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:25.017403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:25.028403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:25.029485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:25.031558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:25.032532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:25.033757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:25.038177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:25.038903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:25.041169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:25.045874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:25.048608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:25.050335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:25.051008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:26.158347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:26.181254 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13f34015-62de-43f1-8ee9-e72b7137492a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.169089 Oct 19 00:51:26.185713 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 869/1661] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:25 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:26.196536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:26.197687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:26.222057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:26.227010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:26.227756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:26.228808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:26.229472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:26.231456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:26.323579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:26.336318 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4108cfa3-3a5a-4d84-946a-7ee4c176416a tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1664 microversion: 2.1 time: 1.335444 Oct 19 00:51:26.337577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 793/1662] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:24 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1664 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:26.346626 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:26.637521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:26.639406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:26.640156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:26.640862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:26.642001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:26.642696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:26.644319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:26.703051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b532c748-dfa8-4cef-bf7b-c081f692b02c tempest-AZV2TestJSON-683358805 tempest-AZV2TestJSON-683358805-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.360532 Oct 19 00:51:26.705819 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 794/1663] 10.222.0.27 () {58 vars in 1164 bytes} [Wed Oct 19 00:51:26 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:51:26.719277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-20017404", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9a3b2fa3-91c4-46a7-9736-5238fda175f2"}], "security_groups": [{"name": "tempest-securitygroup--862937608"}], "key_name": "tempest-keypair-176673103", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:27.898408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:27.914216 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4f81340-797f-4ce6-a0bf-8fae5db612ad tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 1.726982 Oct 19 00:51:27.919358 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 870/1664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:26 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:27.941149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:27.942213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:27.981515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:27.982666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:27.983686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:27.989594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:27.990520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:27.994700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:28.504267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] validate_networks() for [('9a3b2fa3-91c4-46a7-9736-5238fda175f2', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:28.624056 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:29.738425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:29.760143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-773f0718-0e5f-447f-98ff-16675c64a223 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.839310 Oct 19 00:51:29.769989 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 871/1665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:27 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:29.789829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:29.792980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:29.804559 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:29.815960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:29.817222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:29.818267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:29.819228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:29.819814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:29.820425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:30.184097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85b59e131dd940b1b397f5ed429c814f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bd2de014bb94e17824f48a23cd16a65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:30.211080 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32d33059-9c8f-43ef-bd5c-fd229f5fcc04 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 200 len: 1597 microversion: 2.1 time: 0.439021 Oct 19 00:51:30.216708 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 872/1666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:29 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 1597 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:30.249441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:30.250751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:30.264017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:30.265057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:30.265808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:30.268635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:30.269535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:30.272169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:31.659103 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:31.678586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:31.732736 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:31.761718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for project 3b47200f231b4ac0a9e658295916e32b. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:31.768741 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e1ad36e-26cd-46b7-8766-1d376cce07da tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 2340 microversion: 2.25 time: 1.547155 Oct 19 00:51:31.773363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 873/1667] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:51:30 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 2340 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:51:31.778224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for user e1f203c2e330487e9a1bdfff7e60af3b and project 3b47200f231b4ac0a9e658295916e32b. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:31.795654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:31.796297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:31.811523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:31.812213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:31.813017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:31.815504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:31.816386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:31.819822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:31.825369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:31.826210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:31.827163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:31.827812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:31.828813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:31.847927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:31.848435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:31.849420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:31.858363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:31.859778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:31.860246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:31.877469 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:31.921332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for project 3b47200f231b4ac0a9e658295916e32b. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:31.939875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Getting quotas for user e1f203c2e330487e9a1bdfff7e60af3b and project 3b47200f231b4ac0a9e658295916e32b. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:31.979637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:31.982194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:32.110684 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2a8b190-0f98-48e8-be78-12e10a149c13 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 5.402592 Oct 19 00:51:32.111859 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 795/1668] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 5404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:51:32.118556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:32.119554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:32.128164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:32.129230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:32.129949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:32.131336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:32.132159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:32.132958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.258285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:33.276857 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00335448-7a7e-4120-90bf-bf998e49b6dc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 1.500844 Oct 19 00:51:33.279635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 874/1669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:31 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:33.295173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:33.297926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] [instance: ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:33.316534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.317479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.319011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.320538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.321349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.322481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.341457 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] HTTP exception thrown: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Request method failure captured: Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 HTTP/1.1 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0m37_KtbrDgw7Uq7iPuWhHnzcrCBiMLvTwQKgDog8AdMyE4zDt1Qd4mn4dPTlQhuAppB4tJVU88nb_FYRhGkIlgGKcHNtj3-K2JdqDC_Mb4ZWZ9GcjogLqWfLyI7ZfTDfcDpCTXe_7wsIChWEN0iwIuMVe7YrfPGG0UdVMp2s5yLp8 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9bd2de014bb94e17824f48a23cd16a65 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestFqdnHostnames-526300336 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9bd2de014bb94e17824f48a23cd16a65", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bd2de014bb94e17824f48a23cd16a65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9bd2de014bb94e17824f48a23cd16a65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9bd2de014bb94e17824f48a23cd16a65"}]}] Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestFqdnHostnames-526300336 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9bd2de014bb94e17824f48a23cd16a65 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-526300336 Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestFqdnHostnames-526300336-project Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 85b59e131dd940b1b397f5ed429c814f Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestFqdnHostnames-526300336-project Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2'} Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:51:33.343930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:51:33.352954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Returning 404 to user: Instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:51:33.354683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f66fb4d-d1a2-42e3-8e7d-93f6c7e60d18 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2" status: 404 len: 111 microversion: 2.1 time: 0.064671 Oct 19 00:51:33.356607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 875/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:33 2022] GET /compute/v2.1/servers/ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:51:33.365264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2", "name": "network-vif-deleted", "tag": "eeff2217-277c-45bd-81de-035ddd8ed3ef"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:33.380961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.381811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.382598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.403948 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] Creating event network-vif-deleted:eeff2217-277c-45bd-81de-035ddd8ed3ef for instance ec26b1e3-cd9c-4cc2-9f17-563a8ec4c1d2 on n-h1-master-1 Oct 19 00:51:33.410699 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f9e7bb31-3fc9-416a-b258-55fe71bc9972 req-4c00033c-70c9-4b8d-adb9-1d06263047f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052051 Oct 19 00:51:33.412138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 876/1671] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:33.419406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:33.426903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.428691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.429467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.430710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.431412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.432034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.487020 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aea92680-ad4e-4c9d-a36a-c65df208607b tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.073307 Oct 19 00:51:33.488561 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 877/1672] 10.222.0.27 () {60 vars in 1217 bytes} [Wed Oct 19 00:51:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:51:33.494903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:33.496040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:33.524230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.526516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.528565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.530362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:33.531580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:33.533756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:33.584819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:33.608901 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-75290c8e-5157-4c28-941b-9d2119c9a316 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.493130 Oct 19 00:51:33.610422 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 796/1673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:32 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:33.617209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0a58cb4-4ede-4851-8110-b828018aadf9 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] Calling method '.version_select at 0x7f2af572a5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:33.663006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0a58cb4-4ede-4851-8110-b828018aadf9 tempest-ServersTestFqdnHostnames-526300336 tempest-ServersTestFqdnHostnames-526300336-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409116758" status: 202 len: 0 microversion: 2.1 time: 0.047171 Oct 19 00:51:33.663881 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 797/1674] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:51:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409116758 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:51:33.937767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:33.966678 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dcbef2ab-70d3-4b59-94e6-275cf59c443a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1271 microversion: 2.1 time: 0.475859 Oct 19 00:51:33.969843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 878/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:33 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1271 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:34.308320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:34.309127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:34.321443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:34.321939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:34.326390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:34.329573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:34.330897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:34.332113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:34.790621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c83ec2f7-8761-4e58-ac13-eb19513afa66 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4f7bf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-193531228", "description": "tempest-description-673335068"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:35.259795 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c83ec2f7-8761-4e58-ac13-eb19513afa66 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.062224 Oct 19 00:51:35.261277 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 798/1676] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:51:34 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:51:35.266959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:35.267707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:35.281409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:35.288455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:35.289909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:35.291409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:35.294109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7dd631b0-2a92-49f0-9a28-161e334b9b53 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 0.991642 Oct 19 00:51:35.294609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:35.295229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:35.296407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:35.296743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 879/1677] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:34 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:35.324491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:35.330461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:35.346785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:35.347593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:35.349390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:35.355163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:35.355971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:35.356594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:35.619610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:35.634043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d0a4d80-dd58-4471-9cbd-fdf39b1a4d3d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1333 microversion: 2.1 time: 0.310975 Oct 19 00:51:35.635840 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 880/1678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:35 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1333 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:35.642934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-366cb50d-57e7-4003-81e3-cce4acb7e298 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af9364430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1498270687", "description": "tempest-description-33413840"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:35.851938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:35.862323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d62ba26-ae64-4a3e-a406-c19d329dc1a0 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 0.599793 Oct 19 00:51:35.863379 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 799/1679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:35 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:35.868182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60adecb6-1821-4de4-b712-ac428eda4096", "tag": "cbd33da5-634c-4218-9dcf-a6dfb6411e39"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:35.878344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:35.879081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:35.879710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:35.893704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] Creating event network-changed:cbd33da5-634c-4218-9dcf-a6dfb6411e39 for instance 60adecb6-1821-4de4-b712-ac428eda4096 on n-h1-master-1 Oct 19 00:51:35.900525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4bf0c258-f802-4a9f-a143-98c14d659976 req-20ff4516-ff17-4e7b-9adc-0be629a522ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035563 Oct 19 00:51:35.901875 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 800/1680] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:36.328795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:36.330002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:36.348292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:36.350588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:36.351308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:36.352106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:36.352578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:36.353054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:36.401658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-366cb50d-57e7-4003-81e3-cce4acb7e298 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.764062 Oct 19 00:51:36.402689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 881/1681] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:51:35 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:36.538697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-602046632", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ed5ff012-bc07-4d24-8fe9-54626c7b8a3f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:36.659441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] validate_networks() for [('ed5ff012-bc07-4d24-8fe9-54626c7b8a3f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:37.052534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:37.061271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e484f21-1a1a-4a0c-b2a8-fc44e9d3b061 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 0.738652 Oct 19 00:51:37.074597 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 801/1682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:36 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:37.079892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:37.080768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:37.103754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:37.104270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:37.104743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:37.105464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:37.105924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:37.106352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:37.350041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:37.359837 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b8e2b12-b822-429f-b9fe-801f41334b5c tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1333 microversion: 2.1 time: 0.283800 Oct 19 00:51:37.360439 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 802/1683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:37 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1333 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:37.367820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371f5679-021f-447e-9a22-29cc9392de7e", "device": "/dev/xvdb"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:37.371364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:37.386132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:37.387127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:37.387740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:37.389649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:37.390394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:37.390998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:38.096715 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c2a7c0ec-d0b3-4538-ae62-112404350f3e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.733974 Oct 19 00:51:38.105363 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 803/1684] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Oct 19 00:51:37 2022] POST /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:51:38.114204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:38.117527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:38.138367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:38.139547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:38.141953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:38.147493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:38.148249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:38.148934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:39.974362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:39.992388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ee3a5fd-3769-4981-abee-c6d2be33e710 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1391 microversion: 2.1 time: 1.883874 Oct 19 00:51:40.012113 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 804/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:38 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1391 bytes in 1905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:40.334709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-880a6eae-80f5-4767-bf47-ddef77bdd203 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Action: 'create', calling method: .version_select at 0x7f2af5639430>, body: {"keypair": {"name": "tempest-keypair-696671186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU6HD8URgO8kdPgGO7pdGUu2GhL5wXwp8uiNVuyUn+mUiJ4PXK0gjJ+U2pPbM4rwLDzWOLtsrSa7JCNAd4EtiXdO5ca7rB7qnKejS3NRcUfOzn1vh9KbmFQo3wv1rH+DQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:40.386787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-880a6eae-80f5-4767-bf47-ddef77bdd203 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:40.403177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-880a6eae-80f5-4767-bf47-ddef77bdd203 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for user 7323365b46824abfacf50c9435816bbf and project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:40.465483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-880a6eae-80f5-4767-bf47-ddef77bdd203 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.451988 Oct 19 00:51:40.469191 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 805/1686] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:51:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:40.484477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:40.485866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:40.502360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.503176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.504522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:40.505607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.506786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.510043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:40.521388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:40.522050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:40.522591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:40.523399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:40.523996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:40.561431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.561431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.561431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:40.571887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.574684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.576241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:40.667933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Getting quotas for project f69ef772c8bb45358f98bf5b8ff2e670. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:40.683953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Getting quotas for user 2f386bc9a48641a4bcd3b09ae45bea70 and project f69ef772c8bb45358f98bf5b8ff2e670. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:40.736585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:40.746547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:40.896304 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2e3277b-29da-4049-8db2-19bd81f927b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.364724 Oct 19 00:51:40.899660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 882/1687] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 4369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:51:40.909210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:40.914527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:40.933144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.933956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.934641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:40.938749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:40.939572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:40.940236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:41.422938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:41.433179 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53a7b1fa-fcd0-4e94-bbac-72d46091f229 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 0.962454 Oct 19 00:51:41.450859 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 806/1688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:40 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:41.463350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f523764d-e9e3-4e49-853c-99797db198d4 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:41.467668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f523764d-e9e3-4e49-853c-99797db198d4 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:41.705299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:41.714008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f523764d-e9e3-4e49-853c-99797db198d4 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:41.721644 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e483a5df-dea7-47a5-bfa5-95de6ccc6f96 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 0.820475 Oct 19 00:51:41.725603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 883/1689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:40 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:41.726148 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f523764d-e9e3-4e49-853c-99797db198d4 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1215 microversion: 2.1 time: 0.272496 Oct 19 00:51:41.742379 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 807/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:41 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1215 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:41.743897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:41.745722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:41.759365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:41.760779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:41.763263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:41.764236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:41.767531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:41.768162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:42.363863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:42.377450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-497962d8-636c-4da1-9649-3897d3a9e8c5 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1381 microversion: 2.1 time: 0.650019 Oct 19 00:51:42.386462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 884/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:41 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1381 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:42.414108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17142255-85f4-4bb7-80c5-5b6d4c24e11e tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '.version_select at 0x7f2af4d52160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:42.418306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17142255-85f4-4bb7-80c5-5b6d4c24e11e tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:42.420562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17142255-85f4-4bb7-80c5-5b6d4c24e11e tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:42.424003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17142255-85f4-4bb7-80c5-5b6d4c24e11e tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:42.430109 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:42.473312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17142255-85f4-4bb7-80c5-5b6d4c24e11e tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.063420 Oct 19 00:51:42.478156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 808/1692] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 00:51:42 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:42.478946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:42.479842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:42.496559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:42.498761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:42.500981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:42.501618 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:42.502384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:42.503094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:42.504358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:42.513944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:42.560782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:42.562142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:42.566967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:42.570188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:42.571373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:42.577226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:43.911706 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:43.971614 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b139255-f4c1-4300-98e1-ad64e1677154 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 1.496849 Oct 19 00:51:43.978923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 885/1693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:42 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:43.999617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:44.016576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:44.042591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.056167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.065185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.066760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.068599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.069688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.197327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-310eb1e7-9bdf-4a7f-acb2-104c9bd6728d tempest-LiveMigrationTest-202738864 tempest-LiveMigrationTest-202738864-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1532 microversion: 2.1 time: 1.707139 Oct 19 00:51:44.209788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 809/1694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:42 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1532 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:44.238346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:44.261418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:44.298496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.301411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.306649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.308289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.309290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.310002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.585559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:44.597768 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4891b162-70cc-47a0-8f68-006d254c0c3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1273 microversion: 2.1 time: 0.384919 Oct 19 00:51:44.607418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 810/1695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:44 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1273 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:44.621150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60adecb6-1821-4de4-b712-ac428eda4096", "name": "network-vif-plugged", "status": "completed", "tag": "cbd33da5-634c-4218-9dcf-a6dfb6411e39"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:44.660301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.661912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.679316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.701597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] Creating event network-vif-plugged:cbd33da5-634c-4218-9dcf-a6dfb6411e39 for instance 60adecb6-1821-4de4-b712-ac428eda4096 on n-h1-master-1 Oct 19 00:51:44.719594 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5649b2bd-48eb-4e75-88ba-81505f94084a req-328efb57-1581-4a07-b161-a552827395f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110420 Oct 19 00:51:44.720723 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 811/1696] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:44.726663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e2e0b3-2697-4a42-923f-f0998847efed", "tag": "d3113786-f74a-44b5-a826-7360217581c2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:44.748799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.749705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.759099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.800760 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] Creating event network-changed:d3113786-f74a-44b5-a826-7360217581c2 for instance b4e2e0b3-2697-4a42-923f-f0998847efed on n-h2-master-1 Oct 19 00:51:44.818072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2a914f43-610d-4fd6-abfa-5d4a824fa043 req-fe04124f-42b1-4d8e-9874-814e4b1d8cfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095463 Oct 19 00:51:44.823918 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 812/1697] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:44.845317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:44.846765 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:44.877904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.878736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.879563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.880934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:44.881687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:44.882471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:44.903566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:44.943409 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea8ddb39-d2f9-406d-ac29-4127507e6db5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 0.954280 Oct 19 00:51:44.948111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 886/1698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:43 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:44.967212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:51:45.005631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:45.006972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:45.054253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:45.055091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:45.056362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:45.059037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:45.060455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:45.061821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:45.193645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cbb5fa91-262b-4fda-ab61-99085f195b93 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 204 len: 0 microversion: 2.1 time: 0.367287 Oct 19 00:51:45.194550 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 813/1699] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:51:44 2022] DELETE /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:51:45.208926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:45.210828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:45.253302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:45.254065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:45.265569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:45.267143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:45.267839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:45.268466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:46.310087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:46.330341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f198f18f-b4b7-46e5-acb1-eca5d531151f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 1.329000 Oct 19 00:51:46.332396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 887/1700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:44 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:46.351598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:46.358961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:46.388877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:46.389389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:46.389838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:46.390674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:46.397997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:46.398491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:46.693770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:46.711571 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54f136e2-91bd-405c-86a8-982733b9c557 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1273 microversion: 2.1 time: 0.375566 Oct 19 00:51:46.727437 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 888/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:46 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1273 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:46.732832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:46.741205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:46.758599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:46.759384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:46.759996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:46.761026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:46.761690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:46.762294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:46.799615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:46.811680 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afe51625-1d4a-4a9d-9f5b-5964c97d3159 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1387 microversion: 2.1 time: 1.612204 Oct 19 00:51:46.821499 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 814/1702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:45 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1387 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:47.326158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:47.367668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e5cb5a1-8177-4789-bfa7-dfe5d49b1e51 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 0.611996 Oct 19 00:51:47.369329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 889/1703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:46 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:47.387957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:47.392995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:47.430957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:47.435778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:47.438238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:47.448102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:47.449876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:47.455808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:47.743477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:47.744099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:47.763766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:47.764597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:47.765231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:47.766135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:47.766803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:47.767433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:48.018921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:48.049723 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fea4e6bd-a56e-47f4-b503-3f23a4705c0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1273 microversion: 2.1 time: 0.310193 Oct 19 00:51:48.050427 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 890/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:47 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1273 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:48.071780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:48.073526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:48.094419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:48.095014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:48.095485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:48.107100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:48.112705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:48.115096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:48.857368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:48.872449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:48.890358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f8682e0-ccc7-47b9-bb73-301ff6183b5c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1387 microversion: 2.1 time: 0.836892 Oct 19 00:51:48.890944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 891/1705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:48 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1387 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:48.891423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-06222a5f-f243-4e84-8825-fbbade40cd34 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1317 microversion: 2.1 time: 1.517006 Oct 19 00:51:48.893328 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 815/1706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:47 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1317 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:48.906111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:48.907227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:48.923065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:48.925297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:48.926341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:48.928561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:48.931399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:48.932742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:49.078326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:49.079182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:49.096254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:49.097075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:49.097737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:49.098756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:49.099418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:49.100072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:49.139677 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:49.930211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:49.945944 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbf2d97f-c8c8-43f2-9f7e-081e157c41d7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 0.871990 Oct 19 00:51:49.946604 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 816/1707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:49 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:51:49.971853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:49.975346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:49.978291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:49.986353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e65cb0bd-88fc-4012-8ecd-f58ecec1bc31 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 1.094261 Oct 19 00:51:49.994026 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:49.995573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:49.996078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:49.996528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:50.008030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 892/1708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:48 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:50.008710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:50.009160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:50.009619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:50.022506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:50.026099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:50.040493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:50.042763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:50.044155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:50.046465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:50.047988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:50.049058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:50.640875 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:50.711114 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:50.982904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:50.994422 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:51.023391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d4c62dd1-4407-4415-a334-ac057a4db436 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1345 microversion: 2.1 time: 1.013772 Oct 19 00:51:51.026162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 893/1709] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:50 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1345 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:51.051411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:51.058047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:51.087691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:51.088456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:51.089160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:51.090262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:51.090971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:51.091637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:51.493514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:51.508697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60387261-6046-49e7-9968-358553056232 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1467 microversion: 2.1 time: 1.545611 Oct 19 00:51:51.537230 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 817/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:49 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1467 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:51.542363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:51.542992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:51.570055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:51.573022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:51.573654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:51.575278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:51.578277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:51.584492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:51.719222 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:52.170190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:52.186867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-514dfd1f-eadd-4104-837f-bdd7e55e6944 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 1.158516 Oct 19 00:51:52.187618 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 894/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:51 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:52.202748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bca5a26-4f18-43f6-a92a-1583dd23cf16", "name": "network-vif-deleted", "tag": "c148a844-6240-4da3-af4a-7a46efc2f72e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:52.263945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:52.277016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:52.277949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:52.301691 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] Creating event network-vif-deleted:c148a844-6240-4da3-af4a-7a46efc2f72e for instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 on n-h1-master-1 Oct 19 00:51:52.311786 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-134d2252-fce1-49f3-bc2f-af2a0ea6b76e req-2989b0b5-5f03-42fb-a4d4-705752c1a89d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122752 Oct 19 00:51:52.318892 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 895/1712] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:52.355152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:52.368019 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b19dd44-1b3e-4653-939f-66832773d6f5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 0.824520 Oct 19 00:51:52.368714 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 818/1713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:51 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:52.407216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:52.428233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:52.456542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:52.464706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:52.469768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:52.470783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:52.471543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:52.472198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:52.507600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:52.508654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:52.516760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:52.517549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:52.518186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:52.519094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:52.519736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:52.521114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:52.778034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:52.790823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-84241c9f-c22d-41f3-b6d5-86fd809e0b8c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1183 microversion: 2.1 time: 0.401559 Oct 19 00:51:52.806958 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 819/1714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:52 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1183 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:52.815568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-856444851", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ad970e27-e1ef-4751-80c2-1d5de6005294"}], "security_groups": [{"name": "tempest-securitygroup--1166991549"}], "key_name": "tempest-keypair-696671186", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:53.163015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] validate_networks() for [('ad970e27-e1ef-4751-80c2-1d5de6005294', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:53.858288 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20561819-37cd-4b78-8d22-7e5160c57378 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1618 microversion: 2.1 time: 1.537512 Oct 19 00:51:53.861858 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 896/1715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:52 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1618 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:53.975113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-174125040", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ee5219f5-db7a-44ce-ab2c-d09ce7de3cef"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:54.093400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] validate_networks() for [('ee5219f5-db7a-44ce-ab2c-d09ce7de3cef', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:54.518620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:54.520252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:54.521558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:54.522497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:54.523769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:54.568457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:54.577410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:54.578579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:54.580227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:54.581862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:54.584335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:54.638573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:54.675408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for user 7323365b46824abfacf50c9435816bbf and project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:54.763493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:54.772424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:54.925132 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3055c05-3bfb-4dba-93cf-4e81c2b748d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.116427 Oct 19 00:51:54.938127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 820/1716] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 2130 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:51:54.947320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:54.947970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:54.964488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:54.968276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:54.968775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:54.969551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:54.970026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:54.970465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.456954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:55.469512 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b02df98a-d05d-4949-896b-ca77b5e91984 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 0.529974 Oct 19 00:51:55.472511 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 821/1717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:54 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:55.481587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e2e0b3-2697-4a42-923f-f0998847efed", "name": "network-vif-plugged", "status": "completed", "tag": "d3113786-f74a-44b5-a826-7360217581c2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:55.523452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.525674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.527505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.569363 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] Creating event network-vif-plugged:d3113786-f74a-44b5-a826-7360217581c2 for instance b4e2e0b3-2697-4a42-923f-f0998847efed on n-h2-master-1 Oct 19 00:51:55.587572 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c4f655bd-2823-42fa-af72-eaba0a029eb8 req-e0ea8480-2863-4c91-9d49-9f316cf4281b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110996 Oct 19 00:51:55.590304 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 822/1718] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:55.607163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:55.610243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:55.648808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.652877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.654088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.658928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.661043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.664477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.726847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:55.728043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:55.728750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:55.729500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:55.730094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:55.740839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.741649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.742265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.750226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.750984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.752247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.819230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:55.836675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for user 2542aef0e4464018bf9d4563ffe9030d and project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:55.861835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:55.866089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:55.951985 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af61c326-50c3-4388-898e-c02f21520154 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.086233 Oct 19 00:51:55.956017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 897/1719] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:51:55.969180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:55.970939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:55.990312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.991825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.993222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:55.995011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:55.995913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:55.997046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:56.216340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:56.254959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3144ac86-d8a9-4a4d-b6c5-a867a617cc4f tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1400 microversion: 2.1 time: 0.659495 Oct 19 00:51:56.260571 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 823/1720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:55 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1400 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:56.279543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: .version_select at 0x7f2af5639790>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-458505518", "policies": ["affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:56.328805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:56.336115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:56.351492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:56.378619 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4760bf7-1694-4124-8cf9-1e3548b55a2b tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1183 microversion: 2.1 time: 0.414843 Oct 19 00:51:56.383825 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 898/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:55 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:56.395911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f670e59e-a8b4-4fed-9444-49c112a0b0b9", "tag": "969015d5-8bf4-4c33-930e-1792c7eb204a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:56.421608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:56.422441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:56.428494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:56.462337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:56.466913 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] Creating event network-changed:969015d5-8bf4-4c33-930e-1792c7eb204a for instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 on n-h1-master-1 Oct 19 00:51:56.472225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2c3ca26d-e5df-4361-8b7c-28418df61db2 req-d499ddc4-ae3e-4208-995c-f1aa01be829b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085433 Oct 19 00:51:56.477052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:56.477297 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 899/1722] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:56.483066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:56.484566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:56.493852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:56.494924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:56.495532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:56.497175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:56.498149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:56.499463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:56.546434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e8671164-525d-4525-b45c-fe769245d679 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.278979 Oct 19 00:51:56.553313 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 824/1723] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 00:51:56 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:51:56.575483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c13aab4e-065c-4f29-a43e-eaec82d1ad78 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:56.581897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c13aab4e-065c-4f29-a43e-eaec82d1ad78 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:56.669256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:56.682703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4cfef271-f38b-4efb-aef1-5fbad2cc4766 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1244 microversion: 2.1 time: 0.203553 Oct 19 00:51:56.695010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 900/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:56 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1244 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:56.711357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:56.712376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:56.722590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:56.723424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:56.725850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:56.727001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:56.728536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:56.729595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:57.681133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c13aab4e-065c-4f29-a43e-eaec82d1ad78 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:57.690093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c13aab4e-065c-4f29-a43e-eaec82d1ad78 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1217 microversion: 2.1 time: 1.134807 Oct 19 00:51:57.705955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 825/1725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:56 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1217 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:57.716442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-136913344", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0a27359a-4e9d-4bdb-93f8-63338d196704"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:57.804889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:51:58.134947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:58.148563 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aecab196-3760-4dad-ae37-27569fdf9f76 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 1.449677 Oct 19 00:51:58.155164 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 901/1726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:56 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:58.160906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:58.165247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:58.194148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.194877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.197142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.202367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.204056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.205679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.652938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:58.660934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:51:58.662385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:51:58.664215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:51:58.665474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:51:58.673788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:51:58.713995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8959885-815a-4317-9d15-1542005855ad tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 2418 microversion: 2.25 time: 0.551593 Oct 19 00:51:58.728178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 902/1727] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:51:58 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 2418 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:51:58.745087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:58.755143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.759248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:58.760154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.760856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.761987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.762620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.772127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.788293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.788848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.789301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.790043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:58.790506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:58.796200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:58.811238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:58.827265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:58.858606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 2 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:51:58.864998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:58.997469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131450) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 00:51:59.052323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:59.073004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:59.173773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:59.179950 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:51:59.197428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:59.236480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=f4c7163f-af4b-459d-9159-5d9113442701,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:51:59.359269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:59.370560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:59.403712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:59.417450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7de6b364-f718-47a8-858f-cb08eb0f0744 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1586 microversion: 2.1 time: 0.681180 Oct 19 00:51:59.429398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:51:59.429769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:51:59.437457 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 903/1728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:58 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1586 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:59.448881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:59.449436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:59.472331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.473472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.473920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.474729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.475340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.475775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.489268 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52d8e906-3329-4479-af45-d5ad7e36c1aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.780392 Oct 19 00:51:59.490360 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 826/1729] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:51:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 1784 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:51:59.496276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:59.498392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:59.508273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.508896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.509362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.510313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.510858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.511342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.581629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.585420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.586143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.586789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 9bca5a26-4f18-43f6-a92a-1583dd23cf16 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:59.644662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:59.659451 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ac008f1-1d0c-4eda-a317-7cdd3714424b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1298 microversion: 2.1 time: 0.167373 Oct 19 00:51:59.661179 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 827/1730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:59 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:59.673964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:51:59.675267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:59.691224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.694732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.698857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.700013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.700769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.702435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.765174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:59.779452 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c95fc6c7-6ab6-4dff-aa6e-583c1435745d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 200 len: 1188 microversion: 2.1 time: 0.340696 Oct 19 00:51:59.794501 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 904/1731] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:59 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 1188 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:51:59.815792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:51:59.825373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:51:59.843687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.844965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.847257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.850915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:51:59.851639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:51:59.852291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:51:59.921407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'flavor' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:51:59.975669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Going to try to live migrate instance to n-h2-master-1 {{(pid=131449) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:51:59.980460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:51:59.992769 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4239e4ea-3e8e-4f2c-aa1e-5ee66e146663 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1269 microversion: 2.1 time: 0.329328 Oct 19 00:51:59.995650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 828/1732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:59 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1269 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:00.024197 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:00.036310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:00.037102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:00.057026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:00.059428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:00.060124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:00.062385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:00.065495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:00.066102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:00.604239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:00.613552 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-acd90366-bc68-462e-b731-3b41277b2c20 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 0.597492 Oct 19 00:52:00.614163 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 829/1733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:51:59 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:00.624512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:00.626672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:00.642277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:00.645961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:00.646627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:00.647561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:00.648234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:00.649636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:00.856384 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63f0efe4-bce6-432e-8bd3-0d62c5cddc4e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238320 Oct 19 00:52:00.862222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 830/1734] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:52:00 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed/os-interface => generated 284 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:00.874259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:00.898012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:00.902227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Searching by: {'deleted': False, 'project_id': '5685c970486040e2bc073d3bc1a5e577'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:01.022385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:01.023073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:01.031403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:01.032416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:01.032999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:01.039273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:01.361712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:01.690486 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5ad686f-0123-4ec4-ab0e-0c4f16b840f3 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.826983 Oct 19 00:52:01.691144 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 831/1735] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:52:00 2022] GET /compute/v2.1/servers => generated 1002 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:01.699360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:01.705254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:01.712544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:01.713372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:01.713988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:01.715069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:01.715704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:01.716335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.153753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:02.194570 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83a629a4-e273-4460-b695-f6ad074c0951 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 0.494571 Oct 19 00:52:02.195703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 832/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:01 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:02.204957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:02.206358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 9bca5a26-4f18-43f6-a92a-1583dd23cf16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:02.231720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.235021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.237236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.240263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.241316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.243239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.277263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] HTTP exception thrown: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Request method failure captured: Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 HTTP/1.1 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h0xi4jABxHauPWw3wTQatz6skn_Kg7Og9D2JP0dJ2HlA4Q_2EY9O1SJWyahhpX5tqfW7d7TEQQQELxfPcLtSE4KF-6ER-IeacShE0PnN67cc4_IHl0B7o2_EnU7bmGLjQpVWw3cbvxNtmwcrlhjoFWzaBpVXuyE77CGbORAkyS4e8 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0676f376817483389300f03ed99cced", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0676f376817483389300f03ed99cced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}] Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveMigrationTest-556388811 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: a24b98f6af634c61af828bb20ce1e945 Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9bca5a26-4f18-43f6-a92a-1583dd23cf16'} Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:02.281655 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:02.287283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Returning 404 to user: Instance 9bca5a26-4f18-43f6-a92a-1583dd23cf16 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:02.288167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d901e77b-871a-4865-977f-1758a053b2ca tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16" status: 404 len: 111 microversion: 2.1 time: 0.087456 Oct 19 00:52:02.293709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 833/1737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:02 2022] GET /compute/v2.1/servers/9bca5a26-4f18-43f6-a92a-1583dd23cf16 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:02.302875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:02.303851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:02.312973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.313894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.314602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.315876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.317252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.317954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.529060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:02.541954 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bede25a9-0b57-4a99-a3ed-0f8ad8c36c45 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1275 microversion: 2.1 time: 0.245713 Oct 19 00:52:02.562078 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 834/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:02 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:02.580665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:02.581566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:02.604922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.606074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.611722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:02.616153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:02.616936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:02.617561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:03.872054 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:03.888014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbd1bb3d-6184-47d6-9149-0a761b508aa3 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 1.324180 Oct 19 00:52:03.925230 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 835/1739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:02 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:03.947290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:03.952314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:03.985338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:03.987047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:03.987524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:03.990373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:03.991465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:03.991947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:04.267405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:04.282475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fce26fc-6282-429f-a0ea-a8f246a5ae9e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1270 microversion: 2.1 time: 0.355253 Oct 19 00:52:04.291098 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 836/1740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:03 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1270 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:04.323112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:04.330585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:04.353699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:04.354295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:04.354844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:04.355667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:04.356219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:04.359139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:04.397717 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:05.353679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:05.401879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be3f35e7-5167-4d63-9b77-eb6d1932afc7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 1.108438 Oct 19 00:52:05.404820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 837/1741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:04 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:05.445842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:05.454785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:05.485105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:05.486415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:05.490601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:05.493018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:05.494425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:05.495471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:05.732793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:05.767146 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73ae1f6d-68af-46ca-b9ba-b8ce69b1fc1e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1275 microversion: 2.1 time: 0.355841 Oct 19 00:52:05.768237 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 838/1742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:05 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:05.774043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f670e59e-a8b4-4fed-9444-49c112a0b0b9", "name": "network-vif-plugged", "status": "completed", "tag": "969015d5-8bf4-4c33-930e-1792c7eb204a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:05.789325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:05.790132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:05.790765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:05.792572 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:05.807127 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] Creating event network-vif-plugged:969015d5-8bf4-4c33-930e-1792c7eb204a for instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 on n-h1-master-1 Oct 19 00:52:05.814326 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-03dfa182-0809-40d4-ba6b-389d103e7f36 req-eeb3d348-c704-4ee1-9902-8da2059f3565 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044736 Oct 19 00:52:05.815540 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 839/1743] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:05.829686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:05.830741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:05.845596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:05.846077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:05.846535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:05.849878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:05.850463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:05.850932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:05.851342 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:06.387284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:06.421829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5373361e-1792-4393-9ac5-539e158f7b03 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1315 microversion: 2.1 time: 0.601504 Oct 19 00:52:06.424711 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 840/1744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:05 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:06.450909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:06.454945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:06.467251 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3aa500e4-470d-4e9d-84bb-e51833787f60 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/action" status: 202 len: 0 microversion: 2.25 time: 6.671142 Oct 19 00:52:06.473734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 905/1745] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:51:59 2022] POST /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/action => generated 0 bytes in 6677 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:06.490997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799bdcc4-8682-46f3-ada7-eadb0baa311d", "tag": "3adb96e1-e4a5-4d02-9a9b-309c17c76577"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:06.497319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:06.499142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:06.501574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:06.506469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:06.507609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:06.509113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:06.527000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:06.528689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:06.531591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:06.558930 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] Creating event network-changed:3adb96e1-e4a5-4d02-9a9b-309c17c76577 for instance 799bdcc4-8682-46f3-ada7-eadb0baa311d on n-h2-master-1 Oct 19 00:52:06.570478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f2fb4aae-075a-4513-a1c8-67dbda2fb2c6 req-5861c1af-2ddc-450c-abbc-252116700ad5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094562 Oct 19 00:52:06.572187 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 906/1746] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:06.585022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:06.587801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:06.603783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:06.605157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:06.606131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:06.607674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:06.608737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:06.609739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:06.982869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:07.020655 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ee6f84c-9024-4f67-abc1-cf56f13756ac tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1276 microversion: 2.1 time: 0.592311 Oct 19 00:52:07.021776 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 841/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:06 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1276 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:07.057351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:07.059210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:07.081567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:07.082517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:07.083320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:07.084670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:07.093129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:07.093129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:08.182399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:08.192783 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79b4e3fb-8f8c-4c56-bf57-5f6339922f34 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 1.616746 Oct 19 00:52:08.199770 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 907/1748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:06 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:08.240293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:08.241392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:08.258711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:08.259543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:08.260222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:08.263100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:08.263848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:08.265196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:08.318520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:08.364588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:08.371828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:08.375072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-05141fe4-ae5e-4b2c-8329-1fca07ce1dcc tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 1.351733 Oct 19 00:52:08.399320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 842/1749] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:07 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:08.424736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:08.425595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:08.461059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:08.462591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:08.463766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:08.468045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:08.469540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:08.477344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.142765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:09.158212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e235f619-f27a-4a85-8e57-7e08e5f1d890 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.942536 Oct 19 00:52:09.159041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 908/1750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:08 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:09.167885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:09.168969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:09.188882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.190013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.190646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.191621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.192396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.193061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.371204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:09.408451 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc093759-39cd-4b23-8d8b-4b1061828045 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1503 microversion: 2.1 time: 1.007549 Oct 19 00:52:09.418103 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 843/1751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:08 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1503 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:09.430783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:09.432814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:09.454287 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=38 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:09.480039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.482597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.484042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.485752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.487885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.493072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.758927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:09.768160 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-557cbe00-5c65-4717-be02-d7cf5175cdd5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1586 microversion: 2.1 time: 0.606483 Oct 19 00:52:09.774832 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 909/1752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:09 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1586 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:09.787469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4e2e0b3-2697-4a42-923f-f0998847efed", "tag": "d3113786-f74a-44b5-a826-7360217581c2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:09.811815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.816528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.817447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.853900 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] Creating event network-changed:d3113786-f74a-44b5-a826-7360217581c2 for instance b4e2e0b3-2697-4a42-923f-f0998847efed on n-h2-master-1 Oct 19 00:52:09.861626 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bb4f5382-4415-4656-b658-0cfbb16af1e5 req-4c9a3df1-a284-449a-92a8-b1a2db9289a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084721 Oct 19 00:52:09.862417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 910/1753] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:09.875618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:09.880480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:09.896885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.902894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.903711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.904710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:09.907736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:09.908489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:09.983688 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:10.026495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:10.040875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-06049b79-b134-4c26-8372-055804eff806 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.621005 Oct 19 00:52:10.053071 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 844/1754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:09 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:10.059173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:10.060216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:10.070574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.081517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.082557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:10.083573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.084251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.084928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:10.779889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:10.789879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-546e6c8a-9a47-42fd-9301-cd2ee4e60613 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 0.924911 Oct 19 00:52:10.802758 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 911/1755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:09 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:10.808101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-193531228"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:10.808944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:10.823352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.823735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.824186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:10.824964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.825434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.832534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:10.942426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:10.970774 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:10.973378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:10.975844 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6efad52a-9a71-42bb-a032-c5faa00d9782 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.921464 Oct 19 00:52:10.976831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 845/1756] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:10 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:10.982458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:10.983351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:10.992755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.993663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.994347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:10.995843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:10.996887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:10.997862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:11.034686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:11.162682 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:11.183097 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-adc4b726-4570-429e-a216-d46d9850be9a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 204 len: 0 microversion: 2.1 time: 0.203856 Oct 19 00:52:11.184962 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 846/1757] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:52:10 2022] DELETE /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:11.192872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:11.194450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:11.202760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:11.203778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:11.204841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:11.206095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:11.207099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:11.207997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:12.110186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:12.129529 n-d-master-1 devstack@n-api.service[131449]: INFO nova.network.security_group_api [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Adding security group 48d66a47-285f-434f-9e46-aed09ab898a5 to port 969015d5-8bf4-4c33-930e-1792c7eb204a Oct 19 00:52:12.133058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e41f455e-13d2-46c6-9991-059a18c0c809 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.945545 Oct 19 00:52:12.135605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 847/1758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:11 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:12.145977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:12.148868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:12.201256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:12.202670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:12.203821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:12.205391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:12.206371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:12.207214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:12.954465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:12.963307 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ade136d-2fbe-4ae6-a0e3-b8392ab4faa6 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.825695 Oct 19 00:52:12.968223 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 848/1759] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:12 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:12.973769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:12.974394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:12.992454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:12.999705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:13.000476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:13.001462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:13.002121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:13.009819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:13.609654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:13.624501 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c8b513c-c965-440f-a113-ef8bc3de366c tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1668 microversion: 2.1 time: 0.648943 Oct 19 00:52:13.625269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 849/1760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:12 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1668 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:13.631875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:13.632509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:13.650244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:13.651096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:13.651802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:13.652834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:13.655631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:13.656400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.207690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:14.227644 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d6c86bc-ca72-4fa2-87a1-870582bea666 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 0.601034 Oct 19 00:52:14.240652 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 850/1761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:13 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:14.242264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:14.244728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:14.270166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:14.272277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:14.273623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.278357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:14.282705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:14.284310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.331034 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-992e05ce-6a17-481a-9c64-a3ded335274b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/action" status: 202 len: 0 microversion: 2.1 time: 3.526796 Oct 19 00:52:14.332908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 912/1762] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:10 2022] POST /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/action => generated 0 bytes in 3529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:14.339477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:14.340921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:14.367164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:14.369161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:14.369926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.374301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:14.375379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:14.376942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.898082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:14.907519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:14.909617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:14.911123 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d2a2aa5-41a2-4052-9dc6-4830aaf4800d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.681013 Oct 19 00:52:14.924660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 851/1763] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:14 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:14.924660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3236026c-f0e1-43f4-a2d6-063ce663801d", "tag": "19b61baf-1329-4bdd-a3e8-84eb43ba7c9d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:14.946065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:14.946581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:14.947287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:14.977021 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] Creating event network-changed:19b61baf-1329-4bdd-a3e8-84eb43ba7c9d for instance 3236026c-f0e1-43f4-a2d6-063ce663801d on n-h2-master-1 Oct 19 00:52:14.986340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff187afd-5ba9-486f-b350-45c74ca062ab req-b52f4413-7a63-4895-890f-8d6ba0a40680 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072692 Oct 19 00:52:14.986998 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 852/1764] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:15.000365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:15.005608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:15.017540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:15.018053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:15.018503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:15.019286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:15.020306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:15.020306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:15.221233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:15.233955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e5b7f68-88f8-451c-8491-3b564d68da22 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.899377 Oct 19 00:52:15.235412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 913/1765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:14 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:15.249820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1498270687"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:15.252210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:15.268437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:15.269537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:15.270319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:15.271386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:15.272918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:15.274287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:15.775826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:15.793627 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:15.802920 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0226088-7fbd-47f1-b55e-2036dd79f6e7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.805756 Oct 19 00:52:15.805873 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 853/1766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:14 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:15.816895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f670e59e-a8b4-4fed-9444-49c112a0b0b9", "tag": "969015d5-8bf4-4c33-930e-1792c7eb204a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:15.848038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:15.850165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:15.852709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:15.904749 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] Creating event network-changed:969015d5-8bf4-4c33-930e-1792c7eb204a for instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 on n-h1-master-1 Oct 19 00:52:15.924926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d77bb643-d3b4-4243-be68-1fd42d00b393 req-20af9a95-59c5-4ce9-bd8b-26864599363e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117171 Oct 19 00:52:15.940300 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 854/1767] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:15.977135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:15.983446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:16.023410 n-d-master-1 devstack@n-api.service[131449]: INFO nova.network.security_group_api [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Adding security group 92f8792a-925f-46a9-ac7e-50b07dd6236e to port 969015d5-8bf4-4c33-930e-1792c7eb204a Oct 19 00:52:16.035557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:16.036450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:16.037334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:16.045290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:16.046340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:16.046984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:16.352022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:16.377801 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f6a8f81-706f-4325-9a14-183e915790c3 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1601 microversion: 2.1 time: 0.431756 Oct 19 00:52:16.385096 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 855/1768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:15 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1601 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:16.407669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:16.409103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:16.425285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:16.426785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:16.427949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:16.429928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:16.432588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:16.434048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:17.188398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:17.200224 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80aa2e73-8506-4851-8004-dc476d3b680c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1366 microversion: 2.1 time: 0.813593 Oct 19 00:52:17.203805 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 856/1769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:16 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1366 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:17.209465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799bdcc4-8682-46f3-ada7-eadb0baa311d", "name": "network-vif-plugged", "status": "completed", "tag": "3adb96e1-e4a5-4d02-9a9b-309c17c76577"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:17.223791 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:17.226316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:17.231588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:17.232422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:17.260769 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] Creating event network-vif-plugged:3adb96e1-e4a5-4d02-9a9b-309c17c76577 for instance 799bdcc4-8682-46f3-ada7-eadb0baa311d on n-h2-master-1 Oct 19 00:52:17.275366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d2acd14d-42de-43d7-931e-2a9528cb57ed req-ee770d92-324f-40c6-92b3-41b83f7e9b52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069870 Oct 19 00:52:17.276696 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 857/1770] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:17.291209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:17.295516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:17.312726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:17.313166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:17.316899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:17.324810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:17.330083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:17.332931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:17.958892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:17.968318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:17.978381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:17.979980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66651adb-11c2-419b-b700-f95ef5c72991 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.701737 Oct 19 00:52:17.984681 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 858/1771] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:17 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:17.992268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:17.997795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:18.012983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:18.013809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:18.014446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:18.015375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:18.016024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:18.016695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:18.230775 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3c46058-7bc7-40f7-81c0-c006bd7cab47 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/action" status: 202 len: 0 microversion: 2.1 time: 2.992616 Oct 19 00:52:18.233738 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 914/1772] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:15 2022] POST /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/action => generated 0 bytes in 2996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:18.334784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1930053084", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "b9f8dd01-8147-4b0b-9510-035063818062"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:18.431420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] validate_networks() for [('b9f8dd01-8147-4b0b-9510-035063818062', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:52:18.584919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:18.594292 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a2e9f64-4478-424e-be4e-a379beab8e9b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.612256 Oct 19 00:52:18.595320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 859/1773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:17 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:18.604489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:18.605539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:18.620224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:18.625358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:18.626240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:18.627300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:18.628316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:18.630789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.041822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:19.062002 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e84a2af9-917f-4680-bf68-adc0443198a7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.464391 Oct 19 00:52:19.080809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 860/1774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:18 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:19.094920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8224761-768d-4fa3-b5d1-cf77735a2be0", "tag": "021e3676-581e-4552-bd2b-40731b3f0b37"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:19.106768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.107547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.108188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.124987 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] Creating event network-changed:021e3676-581e-4552-bd2b-40731b3f0b37 for instance f8224761-768d-4fa3-b5d1-cf77735a2be0 on n-h1-master-1 Oct 19 00:52:19.144098 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-33f52d32-10a5-4777-818b-ea1ab7ddec37 req-f4d6450a-ae47-471e-800e-994d3ad761ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060342 Oct 19 00:52:19.151945 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 861/1775] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:19.169349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:19.179395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:19.199579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.200481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.201650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.204538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.209766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.211750 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.318278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.318788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.320467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.321323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:19.390931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:19.393043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:19.393810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:19.397309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:19.400384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:19.401130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:19.409052 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4bd19d9-7d99-4b71-8b1d-e07d789f912e tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 200 len: 1324 microversion: 2.1 time: 0.252103 Oct 19 00:52:19.419217 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 862/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:19 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:19.426047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c7163f-af4b-459d-9159-5d9113442701", "tag": "945afe1c-8c35-4a40-b299-044ef48d3d88"}, {"server_uuid": "1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3", "name": "network-vif-deleted", "tag": "a4892e2b-a18a-4cd4-b8fa-e260da542eae"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:19.430327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.431145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.431831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.438502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.439406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.440414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.455389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.455895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.457389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.484378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Getting quotas for project 1a1c816191c44b799ffe501cad81ffba. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:19.489423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Creating event network-changed:945afe1c-8c35-4a40-b299-044ef48d3d88 for instance f4c7163f-af4b-459d-9159-5d9113442701 on n-h1-master-1 Oct 19 00:52:19.491854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] Creating event network-vif-deleted:a4892e2b-a18a-4cd4-b8fa-e260da542eae for instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 on n-h1-master-1 Oct 19 00:52:19.494870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Getting quotas for user 8b723ed2b79d4049ac0ee542d18b45c3 and project 1a1c816191c44b799ffe501cad81ffba. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:19.506465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-342e45ef-d1b7-49c0-bc98-7288c95370fd req-bd2f4c85-7d2e-4527-ae41-6cf5fd297bc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084703 Oct 19 00:52:19.507084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 863/1777] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:19.516974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:19.517526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:19.527318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:52:19.529931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:19.542368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.542751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.543250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.544266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.544434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.544903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.634950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64f1c263-3e13-4d89-8308-7c35175d9527 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.399863 Oct 19 00:52:19.635635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 915/1778] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1401 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:52:19.645922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:19.646558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:19.673409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.673823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.699801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:19.704588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:19.705232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:19.705702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.203673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26920caf-8243-4512-a689-5ff0cf217f6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.695198 Oct 19 00:52:20.205342 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 864/1779] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 00:52:19 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9/os-security-groups => generated 1155 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:20.212496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:20.217235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:20.249148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.251314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.255049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.256192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.257575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.261633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.385565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:20.399038 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a81afa8c-d140-4c0f-80f4-775ee39c5c86 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1555 microversion: 2.1 time: 0.759617 Oct 19 00:52:20.400041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 916/1780] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:19 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1555 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:20.432649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:20.436439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:20.452277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.452811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.453268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.458444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.458925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.463408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.931343 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:20.948983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:20.953017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:20.957778 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c4c730a-2953-4599-abc7-f9af0b45d904 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.751004 Oct 19 00:52:20.961291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 865/1781] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:20 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:20.974358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:20.975554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:20.982190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.990429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.991281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:20.992608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:20.993449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:20.994127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.179544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:21.182268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:21.192909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:21.195638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:21.197568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0126637-dfe3-4a17-bafc-63c0b4f5322e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.788740 Oct 19 00:52:21.198531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 917/1782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:20 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:21.200003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d18eda0a-172f-4307-8d00-e9f2f1e566c5 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1255 microversion: 2.21 time: 0.237593 Oct 19 00:52:21.204579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 866/1783] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:20 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1255 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:21.215029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c09c286-9788-41f9-abc7-79197aff2b5c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4bd3430>, body: {"security_group": {"name": " tempest-securitygroup -308450244 ", "description": "tempest-description-233791994"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:21.220833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:21.221530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:21.232282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.232896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.234512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.235715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.236678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.237303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.603448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:21.612796 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-868f3773-da89-470c-99e2-ceddefeb0f1b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.412607 Oct 19 00:52:21.623365 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 918/1784] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:21 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:21.635671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:21.636565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:21.645821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.646428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.646980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.647984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.648489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.648953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.859549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e2ecac61-2975-437f-af14-bf0bc0845763 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227727 Oct 19 00:52:21.866690 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 919/1785] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:52:21 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-interface => generated 284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:21.867964 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c09c286-9788-41f9-abc7-79197aff2b5c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.661216 Oct 19 00:52:21.869564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 867/1786] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:21 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:21.877235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:21.878126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:21.882833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3236026c-f0e1-43f4-a2d6-063ce663801d", "name": "network-vif-plugged", "status": "completed", "tag": "19b61baf-1329-4bdd-a3e8-84eb43ba7c9d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:21.888498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.889407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.892892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.895234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.908758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.909462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.916183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.918749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.919393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.931401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] HTTP exception thrown: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Request method failure captured: Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 HTTP/1.1 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0h0xi4jABxHauPWw3wTQatz6skn_Kg7Og9D2JP0dJ2HlA4Q_2EY9O1SJWyahhpX5tqfW7d7TEQQQELxfPcLtSE4KF-6ER-IeacShE0PnN67cc4_IHl0B7o2_EnU7bmGLjQpVWw3cbvxNtmwcrlhjoFWzaBpVXuyE77CGbORAkyS4e8 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0676f376817483389300f03ed99cced", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0676f376817483389300f03ed99cced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}] Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-LiveMigrationTest-556388811 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a24b98f6af634c61af828bb20ce1e945 Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3'} Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:21.933698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. Oct 19 00:52:21.939564 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:21.940361 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] Creating event network-vif-plugged:19b61baf-1329-4bdd-a3e8-84eb43ba7c9d for instance 3236026c-f0e1-43f4-a2d6-063ce663801d on n-h2-master-1 Oct 19 00:52:21.942969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Returning 404 to user: Instance 1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:21.944597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e68670e5-1d92-4c78-8fed-569939b31a51 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3" status: 404 len: 111 microversion: 2.1 time: 0.076039 Oct 19 00:52:21.945883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 920/1787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:21 2022] GET /compute/v2.1/servers/1ad05cd2-a9b2-4ef2-9c5c-9a4fabdcddb3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:21.952900 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a9e2bb7e-31da-4761-ba3c-356ec9899389 req-db99fe15-d138-4ab5-9e04-1f1b323a8433 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081043 Oct 19 00:52:21.953567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f670e59e-a8b4-4fed-9444-49c112a0b0b9", "tag": "969015d5-8bf4-4c33-930e-1792c7eb204a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:21.954165 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 868/1788] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:21.960307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50e66fca-7daf-4ecf-a74b-fcbdf1de3d1e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af5574a60>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:21.964407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:21.964919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:21.965355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:21.980424 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] Creating event network-changed:969015d5-8bf4-4c33-930e-1792c7eb204a for instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 on n-h1-master-1 Oct 19 00:52:21.986023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3ab73ae1-bd5b-4cdf-8ecc-5d5759c1e135 req-d71f30c3-8649-41e2-8000-7814d425134a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038691 Oct 19 00:52:21.987158 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 921/1789] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:21.995486 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e30b6241-11b9-415d-9639-be3980595440 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '.version_select at 0x7f2af4e7fb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:22.025178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e30b6241-11b9-415d-9639-be3980595440 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232955563" status: 202 len: 0 microversion: 2.1 time: 0.035050 Oct 19 00:52:22.026150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 922/1790] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 00:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1232955563 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:22.031357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:22.032499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:22.042813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.054412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.055081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:22.056171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.057543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.058608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:22.078464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50e66fca-7daf-4ecf-a74b-fcbdf1de3d1e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d" status: 200 len: 222 microversion: 2.1 time: 0.120279 Oct 19 00:52:22.080064 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 869/1791] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:52:21 2022] GET /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d => generated 222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:22.111309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6999d24a-17ca-48d8-8cf0-9a74ec7c2cdf tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4c228b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:22.537992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:22.556308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:22.559761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:22.562223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df943f8d-e6af-4aa1-9c8c-ce24e8543658 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.534486 Oct 19 00:52:22.577304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 923/1792] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:22 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:22.599925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:22.600884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:22.607971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.608739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.608945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:22.609940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.610621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.611052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:22.905919 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6999d24a-17ca-48d8-8cf0-9a74ec7c2cdf tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d" status: 202 len: 0 microversion: 2.1 time: 0.804086 Oct 19 00:52:22.908558 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 870/1793] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:22 2022] DELETE /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:22.925185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:22.927139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:22.944270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.949473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.950584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:22.951955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:22.953894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:22.954726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:23.015755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:23.028153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92cdbe5d-b561-402c-a311-cfee7c58ebdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1317 microversion: 2.1 time: 0.448530 Oct 19 00:52:23.039138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 924/1794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:22 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:23.052846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:23.054879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:23.064913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:23.066226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:23.067426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:23.069382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:23.071436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:23.075001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:23.126204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:23.143183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:23.147430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:23.150349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b6717644-c411-4986-8589-d95d094068bf tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1317 microversion: 2.21 time: 0.239219 Oct 19 00:52:23.166168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 871/1795] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:22 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:23.187403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4bf15e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:23.612077 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:23.613494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:52:23.614256 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.614256 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d HTTP/1.1 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: exception: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d'} Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:23.618867 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-0440742e-459e-4607-a07c-64e98e588aae'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d51ae0d4-eb0e-44bc-abe4-ffc368422922 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d" status: 404 len: 194 microversion: 2.1 time: 0.456611 Oct 19 00:52:23.633032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 872/1796] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:52:23 2022] GET /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d => generated 194 bytes in 458 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:23.648087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:23.649128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:23.663965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:23.664934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:23.665598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:23.666516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:23.668251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:23.669476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:23.823565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:23.832861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94c9338a-da87-45a8-abd6-02ca040eb7de tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.790438 Oct 19 00:52:23.833748 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 925/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:23 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:23.856062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c223583-0c70-49d8-83f1-a092a5956550 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af9410ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2090465577", "description": "tempest-description-1855247955"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:24.137946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.149768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.151746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.153475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-34245ae3-6fa7-4a42-abb7-0ad20520b857 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.527322 Oct 19 00:52:24.154686 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 873/1798] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:23 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:24.160815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8224761-768d-4fa3-b5d1-cf77735a2be0", "name": "network-vif-plugged", "status": "completed", "tag": "021e3676-581e-4552-bd2b-40731b3f0b37"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:24.172160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.173121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.174156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.197551 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] Creating event network-vif-plugged:021e3676-581e-4552-bd2b-40731b3f0b37 for instance f8224761-768d-4fa3-b5d1-cf77735a2be0 on n-h1-master-1 Oct 19 00:52:24.206614 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-15fa4070-aa5b-40f9-abc0-50cf659d9d0e req-ebf41748-3651-47e7-831a-61d3e36c73e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049816 Oct 19 00:52:24.208167 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 874/1799] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:24.215902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:24.216823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:24.227454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.228166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.229582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.230620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.231230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.231795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.453623 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c223583-0c70-49d8-83f1-a092a5956550 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.602432 Oct 19 00:52:24.454476 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 926/1800] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:23 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:24.465594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "799bdcc4-8682-46f3-ada7-eadb0baa311d", "tag": "3adb96e1-e4a5-4d02-9a9b-309c17c76577"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:24.477981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.481047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.482271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.495660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] Creating event network-changed:3adb96e1-e4a5-4d02-9a9b-309c17c76577 for instance 799bdcc4-8682-46f3-ada7-eadb0baa311d on n-h2-master-1 Oct 19 00:52:24.502919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-52e849d4-d8a7-420c-b78c-dda9bbfaed9b req-01a2dfc7-49fc-4761-ad22-4c5188798c83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046648 Oct 19 00:52:24.504122 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 927/1801] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:24.510814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:24.511517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:24.518693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.520461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.521179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.522249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.522736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.523250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.737284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.752929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62a81938-6226-4c0e-b6b4-1e727b061964 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1506 microversion: 2.1 time: 0.539227 Oct 19 00:52:24.773268 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 875/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:24 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:24.773268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57a04608-8dfe-45ff-84a9-19cff519033c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4c22f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1298597692", "description": "tempest-description-1239308852"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:24.838268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.864189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.868410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:24.869918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1babe142-9022-4361-a8b5-aebec56af145 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.364233 Oct 19 00:52:24.881104 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 928/1803] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:24 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:24.895170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:24.895694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:24.902938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.903732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.904357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.905326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:24.905988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:24.906653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:24.954576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:25.065093 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8eb93cec-5c55-4222-85a7-b9c18820b88d tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 204 len: 0 microversion: 2.1 time: 0.182234 Oct 19 00:52:25.066958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 929/1804] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:52:24 2022] DELETE /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:25.074178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:25.075295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:25.092418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.093421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.094158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.095252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.096092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.096874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.107658 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57a04608-8dfe-45ff-84a9-19cff519033c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.346092 Oct 19 00:52:25.108780 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 876/1805] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:24 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:25.121453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:25.122472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:25.133658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.134430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.135071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.135959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.136584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.137217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.404043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:25.416061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63bf9537-4597-4aa5-bd1e-1e6b403f2297 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1506 microversion: 2.1 time: 0.347578 Oct 19 00:52:25.417406 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 930/1806] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:25 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:25.420205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:25.431161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:25.433138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:25.436284 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a99c14d9-3df3-4e96-9fac-267dbf04ecef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1318 microversion: 2.1 time: 0.325827 Oct 19 00:52:25.437640 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 877/1807] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:25 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1318 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:25.443478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68ed4228-35ba-4418-a824-c7f2e50bf0dc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4b97b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-641238037", "description": "tempest-description-47626625"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:25.446224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.460338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.460835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.461595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.462091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.462518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.785208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:25.787911 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:25.806152 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-098f29b5-20af-4069-93aa-a95b318c98bb tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1484 microversion: 2.1 time: 0.386580 Oct 19 00:52:25.807021 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 931/1808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:25 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1484 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:25.811367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:25.811970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:25.829985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.830565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.841385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.843197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.844376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.845775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.968011 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68ed4228-35ba-4418-a824-c7f2e50bf0dc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.528963 Oct 19 00:52:25.976570 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 878/1809] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:25 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:25.976570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:25.978576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:25.985599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.986104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.986627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:25.987362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:25.988026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:25.988821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.085561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:26.085994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:26.086719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:26.087161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:26.087723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:26.113340 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:26.122504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.153183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.157207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.158818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f153002b-2009-437b-b396-c001d372d209 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.351133 Oct 19 00:52:26.173023 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 932/1810] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:25 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:26.185360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:26.186420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:26.193531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.194369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.195037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.196024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.196739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.196887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:26.197778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.215605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.217386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.218059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.220782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.221273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.221721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.294798 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32d25c5e-584e-4e07-96cb-a0e0aa7d0619 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "POST /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d/action" status: 202 len: 1108 microversion: 2.1 time: 0.324344 Oct 19 00:52:26.296242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 879/1811] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:25 2022] POST /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d/action => generated 1108 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 00:52:26.301566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-701275ed-8633-4e19-ac7a-50a4ccd504bd tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b97040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:26.517653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.536792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.540858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.553413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44531dfe-b8a1-478c-b94b-89ff9c61e777 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.378692 Oct 19 00:52:26.554857 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 933/1812] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:26 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:26.563953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c7163f-af4b-459d-9159-5d9113442701", "name": "network-vif-plugged", "status": "completed", "tag": "945afe1c-8c35-4a40-b299-044ef48d3d88"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:26.581286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.582567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.583475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.597847 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] Creating event network-vif-plugged:945afe1c-8c35-4a40-b299-044ef48d3d88 for instance f4c7163f-af4b-459d-9159-5d9113442701 on n-h1-master-1 Oct 19 00:52:26.603389 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f365889a-7d46-4990-b216-48b94652509a req-e7f7aa88-3a20-4edc-b7ae-5e77ab869a71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045932 Oct 19 00:52:26.604420 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 934/1813] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:26.609733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:26.610435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:26.617357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.617845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.618289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.618997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.619443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.619873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.885336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-701275ed-8633-4e19-ac7a-50a4ccd504bd tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.587681 Oct 19 00:52:26.895417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 880/1814] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:52:26 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:26.895417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:26.895417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:26.897213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:26.901982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.902661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.903226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.903978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.904462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.904910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.905261 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-199aaf14-8e54-4b09-a363-24620c038b46 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.299594 Oct 19 00:52:26.912840 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 935/1815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:26 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:26.912840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8420be42-a346-400b-8016-036059e86fe6", "name": "network-vif-deleted", "tag": "d8b53f91-19b7-464e-b0d7-2b6774f8a872"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:26.921035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.921566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.922004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.934168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] Creating event network-vif-deleted:d8b53f91-19b7-464e-b0d7-2b6774f8a872 for instance 8420be42-a346-400b-8016-036059e86fe6 on n-h2-master-1 Oct 19 00:52:26.939819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a94c41d7-a1c8-4bf4-8d24-205d63e0a385 req-6116eeb5-b164-4b24-bf44-1a576d724d2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Oct 19 00:52:26.940424 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 936/1816] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:26.946386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:26.947344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:26.953999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.954280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.954716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.955427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.955901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.956339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.990972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:26.991465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:26.992115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:26.992600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 8420be42-a346-400b-8016-036059e86fe6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:27.053563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.061501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3081590d-75fc-4485-9752-8a22a0dbad10 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1300 microversion: 2.1 time: 0.119162 Oct 19 00:52:27.062096 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 937/1817] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:26 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:27.067452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "951b4c86-9f12-4b5f-9882-bd73ce348e4d", "tag": "9787f728-22a3-4998-8861-2ffcd5f27879"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:27.079983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.080466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.080940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.083283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.091908 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-300e1e2a-9606-4169-8ab8-e0260b66a0be tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1467 microversion: 2.1 time: 0.204535 Oct 19 00:52:27.101274 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 881/1818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:26 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1467 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:27.101481 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] Creating event network-changed:9787f728-22a3-4998-8861-2ffcd5f27879 for instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d on n-h1-master-1 Oct 19 00:52:27.101606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d81da7e-a544-44dd-80b2-afd0b1bacb85 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b97c10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.101712 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ea7fa947-36bb-47cb-8a83-ad40319c5f32 req-3e70aa3a-5154-4afa-b58d-838ac3a99db0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037310 Oct 19 00:52:27.101712 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 938/1819] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:27.115966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.116710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:27.123134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.123627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.124064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.124804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.125265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.125724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.330368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.339051 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c17b81f-9dc3-43c2-9871-3166299cc209 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1318 microversion: 2.1 time: 0.227517 Oct 19 00:52:27.339651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 939/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:27.344419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.345065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:27.351560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.352048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.352486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.353250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.353706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.354342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.372304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d81da7e-a544-44dd-80b2-afd0b1bacb85 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781" status: 202 len: 0 microversion: 2.1 time: 0.278592 Oct 19 00:52:27.373165 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 882/1821] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:27 2022] DELETE /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:27.382786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b974c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.436090 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:27.436734 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:52:27.437272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.437272 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781 HTTP/1.1 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: exception: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f26f568b-334f-4ede-a1e4-d2e4b1a9e781'} Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:27.439291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-c0988e14-5e95-45c6-943e-74ac712b4f99'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c244acca-cae7-4f55-8a66-266fe2b5ed73 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781" status: 404 len: 194 microversion: 2.1 time: 0.063716 Oct 19 00:52:27.448048 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 883/1822] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781 => generated 194 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:27.453100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f53ff01-eb6f-4b91-ba62-8bb59ada6713 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4c2b700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.547890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.557703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.559163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.560354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7979631d-ca7a-42c5-8bd2-077eba40e88d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.219771 Oct 19 00:52:27.560958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 940/1823] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:27.583832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.584475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:27.590964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.591454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.591892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.592690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.593149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.593576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.730130 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f53ff01-eb6f-4b91-ba62-8bb59ada6713 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729" status: 202 len: 0 microversion: 2.1 time: 0.283426 Oct 19 00:52:27.731069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 884/1824] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:27 2022] DELETE /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:27.740105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b93b80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.779530 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:27.780400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group 72aed06c-0748-4f7f-9860-54c8b770f729 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:52:27.781960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.781960 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.783886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729 HTTP/1.1 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: exception: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '72aed06c-0748-4f7f-9860-54c8b770f729'} Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:27.787756 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] Oct 19 00:52:27.793245 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:27.800820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.800820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:27.800820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c495fc40-86ee-4109-9683-05de623e1d5f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.216587 Oct 19 00:52:27.800820 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 941/1825] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:52:27.801948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:52:27.801948 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d03ba297-f823-4fe9-bcca-e596865182c0'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:27.801948 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d41c2953-1c50-4c69-beba-ad60a643c278 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729" status: 404 len: 194 microversion: 2.1 time: 0.064433 Oct 19 00:52:27.804139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 885/1826] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:52:27.809803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ef13e0e-fe7c-4277-8fc2-d14282db6a6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af93905e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.932955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:27.934170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:27.943188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.944483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.944981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:27.945703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:27.946590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:27.947665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.082713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ef13e0e-fe7c-4277-8fc2-d14282db6a6e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564" status: 202 len: 0 microversion: 2.1 time: 0.277273 Oct 19 00:52:28.083534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 942/1827] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:27 2022] DELETE /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:28.088093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.088816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:28.100191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.101007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.101624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.103756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.104581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.105058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.154933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.155442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.156440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.156943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 8420be42-a346-400b-8016-036059e86fe6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:28.163671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.171493 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a5859ca-0ed4-458e-8ee5-8de4e3d9b1ed tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.243477 Oct 19 00:52:28.185043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 886/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:27 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:28.192794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4d67670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.208846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.218467 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:28.219072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:52:28.219599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.219599 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.221521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9ee47778-b63e-4dda-9914-46e8a4d857df tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 200 len: 1300 microversion: 2.1 time: 0.137138 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564 HTTP/1.1 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: exception: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ad5a3ff3-4817-44a2-9a25-baaa772d9564'} Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:28.221784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] Oct 19 00:52:28.227939 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:28.232424 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 943/1829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 1300 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:28.233863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:52:28.233863 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-9a101983-cc94-4322-b7e9-1b277b7bb7d8'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:28.236942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-961e4c07-8d21-498b-9b54-b9c5a0e9604e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564" status: 404 len: 194 microversion: 2.1 time: 0.047816 Oct 19 00:52:28.237792 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 887/1830] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:28.248246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6b37781-aab5-4272-8657-8fec2f811cfa tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af93904c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.367995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.368697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:28.379419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.380544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.381260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.382273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.382952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.383622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.500955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6b37781-aab5-4272-8657-8fec2f811cfa tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.256683 Oct 19 00:52:28.501606 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 944/1831] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:28.518005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a25c1e09-4b3a-4ef7-8a63-afa02a839a63 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af9374d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-699252970", "description": "tempest-description-306442730"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:28.586359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.597137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e96fa0c5-476d-41d3-980c-e27f5f6a9678 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1467 microversion: 2.1 time: 0.238830 Oct 19 00:52:28.598448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 888/1832] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1467 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:28.603383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.604296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:28.611033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.612176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.612995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.613960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.614654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.615338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.760192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a25c1e09-4b3a-4ef7-8a63-afa02a839a63 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.246060 Oct 19 00:52:28.761094 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 945/1833] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:28 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:28.776659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:28.783205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.784314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Searching by: {'reservation_id': 'r-jsxncwa4', 'deleted': False, 'project_id': '5685c970486040e2bc073d3bc1a5e577'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:28.786006 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:28.790375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.791452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.791987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.793053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:28.793780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:28.794373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:28.823470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.835867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.837948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:28.839381 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b0451e50-f078-42c9-a064-c401768f2790 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.239748 Oct 19 00:52:28.840104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 889/1834] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:28.848563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d6e0fb2-e177-4162-8d32-96ff8f212106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4bd3310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-161161415", "description": "tempest-description-56680441"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:28.959000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:29.027681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d6e0fb2-e177-4162-8d32-96ff8f212106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.186319 Oct 19 00:52:29.029128 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 890/1835] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:52:28 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:29.034119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.035081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:29.062358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.062851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.064088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.067664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.068150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.068591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.071330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:29.079935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.080317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.081092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.310823 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ce65fc1-d4b0-40da-ae22-d875bd977137 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-jsxncwa4" status: 200 len: 2927 microversion: 2.1 time: 0.538407 Oct 19 00:52:29.313126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 946/1836] 10.222.0.27 () {58 vars in 1197 bytes} [Wed Oct 19 00:52:28 2022] GET /compute/v2.1/servers/detail?reservation_id=r-jsxncwa4 => generated 2927 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:29.321349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1178749447", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ed5ff012-bc07-4d24-8fe9-54626c7b8a3f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:29.327309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:29.336379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:29.337985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:29.339213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b78cd03d-052f-43e6-8985-beedf8485918 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.309134 Oct 19 00:52:29.340059 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 891/1837] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:29.344688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.345425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:29.352157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.352749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.353267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.354075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.354900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.355595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.394632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] validate_networks() for [('ed5ff012-bc07-4d24-8fe9-54626c7b8a3f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:52:29.583174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:29.591965 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04af0f82-c4bf-4cac-8503-ee790ffdb690 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.250988 Oct 19 00:52:29.592706 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 892/1838] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:29.599004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "name": "network-vif-unplugged", "status": "completed", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:29.609186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.609840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.610376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.624252 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] Creating event network-vif-unplugged:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h1-master-1 Oct 19 00:52:29.630445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3aff3b3e-583b-4d56-944f-3ef2dbcb1cb0 req-dac925c0-28de-430c-bf15-5cf81760d508 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036074 Oct 19 00:52:29.631556 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 893/1839] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:29.637546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.638357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 8420be42-a346-400b-8016-036059e86fe6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:29.645193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.646107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.646822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.647606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.648132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.648846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.666132 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] HTTP exception thrown: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Request method failure captured: Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 HTTP/1.1 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0h0xi4jABxHauPWw3wTQatz6skn_Kg7Og9D2JP0dJ2HlA4Q_2EY9O1SJWyahhpX5tqfW7d7TEQQQELxfPcLtSE4KF-6ER-IeacShE0PnN67cc4_IHl0B7o2_EnU7bmGLjQpVWw3cbvxNtmwcrlhjoFWzaBpVXuyE77CGbORAkyS4e8 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0676f376817483389300f03ed99cced", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0676f376817483389300f03ed99cced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}] Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveMigrationTest-556388811 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: a24b98f6af634c61af828bb20ce1e945 Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '8420be42-a346-400b-8016-036059e86fe6'} Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:29.667877 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Returning 404 to user: Instance 8420be42-a346-400b-8016-036059e86fe6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a20a9a05-8554-497c-83dd-444295aca413 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6" status: 404 len: 111 microversion: 2.1 time: 0.036659 Oct 19 00:52:29.672650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 894/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/servers/8420be42-a346-400b-8016-036059e86fe6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:29.678340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.693956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_groups [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Querying cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) for 2 instances {{(pid=131450) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 00:52:29.694682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.695165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.695605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.729304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60b929b2-5db2-4068-8c61-924094a50c43 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/0a27359a-4e9d-4bdb-93f8-63338d196704" status: 200 len: 265 microversion: 2.1 time: 0.057824 Oct 19 00:52:29.729886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 895/1841] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/os-server-groups/0a27359a-4e9d-4bdb-93f8-63338d196704 => generated 265 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:29.734437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.734933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:29.741566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.742055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.742499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.743204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.743661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.744089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.770101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:29.860061 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-71b1265f-95c9-413a-bb04-386f3c922d30 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "DELETE /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 204 len: 0 microversion: 2.1 time: 0.128649 Oct 19 00:52:29.863916 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 896/1842] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:52:29 2022] DELETE /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:29.868800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:29.869790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:29.875767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.876333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.876825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.877951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.878089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.878480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.886737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:29.887504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:29.888225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:29.888782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:29.889864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:29.899566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.900779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.901413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.902175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:29.902635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:29.903856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:29.923122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Getting quotas for project f69ef772c8bb45358f98bf5b8ff2e670. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:29.930000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Getting quotas for user 2f386bc9a48641a4bcd3b09ae45bea70 and project f69ef772c8bb45358f98bf5b8ff2e670. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:29.943858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:52:29.946435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:29.995169 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4fd00f20-b7ee-4984-b1ef-6254e6d80d64 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680670 Oct 19 00:52:29.996152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 947/1843] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:52:30.006325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.006957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.014666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.015200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.015604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.016329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.016820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.017382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.031816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c76209ba-fd93-42a6-b720-2b2ef5c1796f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 200 len: 1618 microversion: 2.1 time: 0.168933 Oct 19 00:52:30.032887 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 897/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 1618 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:30.055190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.055820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.062631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.063128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.063575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.064283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.064787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.065225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.233552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.245171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.246812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.248175 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e66a8c01-89ae-4350-ab6a-7b9bacf1d7e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.251129 Oct 19 00:52:30.248762 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 948/1845] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:29 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:30.274188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5bf05669-7e7f-4110-9507-6131a21c15d0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.274502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.275579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5bf05669-7e7f-4110-9507-6131a21c15d0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.287389 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2eb25ca-6c77-49c9-984f-d572aa79edc1 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1500 microversion: 2.1 time: 0.244848 Oct 19 00:52:30.302412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 898/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:30 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1500 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:30.320729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.321353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.335361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5bf05669-7e7f-4110-9507-6131a21c15d0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.340094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.340851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.341555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.342326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.343134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.343691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.352118 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5bf05669-7e7f-4110-9507-6131a21c15d0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1216 microversion: 2.1 time: 0.086086 Oct 19 00:52:30.369777 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 949/1847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:30 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:30.382800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.383453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.393152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.393968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.394581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.395489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.396150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.396822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.579733 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4effd93-2b98-4873-8f77-aee9cfc8a695 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1618 microversion: 2.1 time: 0.276039 Oct 19 00:52:30.580327 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 899/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:30 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1618 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:30.605788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: .version_select at 0x7f2af4e33d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-515405707", "policies": ["anti-affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:30.609401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.626085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.627692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.629739 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ebae4a31-6742-49a2-abee-9f48fc07d1b6 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.258689 Oct 19 00:52:30.630304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 950/1849] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:30 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:30.634303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:30.641390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:30.645870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:30.647866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:30.665882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.666845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.667518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.669052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:30.669830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:30.670909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:30.726511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:30.732587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:30.747701 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6317fc53-7858-4d49-b450-a8da20ad6635 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.145886 Oct 19 00:52:30.748606 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 900/1850] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 00:52:30 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:30.839958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:30.850809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77073961-2563-4cdc-adf0-ab3f1f78ccdb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.217829 Oct 19 00:52:30.851847 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 951/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:30 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:30.890087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1074363429", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2f70bd14-fda0-4715-8a9a-a52577a20a4f"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:30.901560 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:30.949859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:52:31.207192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:31.207908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:31.208094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:31.209233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:31.209868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:31.226287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.226801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.227632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.228560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.229152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.229655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.247391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:31.253781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:31.266863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 2 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:52:31.269374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:31.279101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.279866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:31.288969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.289554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.290065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.290844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.291373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.291897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.319580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:31.325074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:31.360747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:31.365902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:31.379875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=c32edf59-dcf2-4e71-b7f7-28ee0db9c80a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:31.435531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:31.441837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:31.445884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.460714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.462596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.464206 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5cdf4eda-b419-4ca4-81d0-075779b87024 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.189560 Oct 19 00:52:31.466952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 952/1852] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:52:31.477479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.477479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:31.481713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.482209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.482868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.483584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.484048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.484483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.494010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:31.500547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'server_group_members'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:31.531786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.532270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.532740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.533198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 505afe68-f76e-4a63-9e4a-ee2de533db5a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:31.539205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9efdca1-5c45-47a6-8d0f-6d0eacf05f32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.652928 Oct 19 00:52:31.542883 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 901/1853] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:52:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:52:31.545194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.545838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:31.546671 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:31.553252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.554146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.554285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.554922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.555512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.555823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.616780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.626701 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-274bb746-a103-407e-a265-883e7157d54a tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1301 microversion: 2.1 time: 0.156459 Oct 19 00:52:31.628130 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 953/1854] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1301 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:31.640105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.647942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.648948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Searching by: {'deleted': False, 'project_id': '5685c970486040e2bc073d3bc1a5e577'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:31.673832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.674490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.675030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.676574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.677591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.678256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.682903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:31.699980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26cfaad6-2234-4e6f-8af1-d47e5cea3f15 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1268 microversion: 2.1 time: 0.158486 Oct 19 00:52:31.701752 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 902/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:31.706400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}, {"server_uuid": "505afe68-f76e-4a63-9e4a-ee2de533db5a", "name": "network-vif-deleted", "tag": "9630d069-1da0-4c40-ad15-19f23f6bf9f6"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:31.725169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.725817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.727704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.740336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Creating event network-changed:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h1-master-1 Oct 19 00:52:31.741142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] Creating event network-vif-deleted:9630d069-1da0-4c40-ad15-19f23f6bf9f6 for instance 505afe68-f76e-4a63-9e4a-ee2de533db5a on n-h2-master-1 Oct 19 00:52:31.758050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c12074b5-a55f-4ebd-a09b-0d8641029b94 req-98b0abae-78d8-4df3-943e-f19ef1bda369 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.054965 Oct 19 00:52:31.759021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 903/1856] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:31.764835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.770915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:31.786603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.787274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.788082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.789047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:31.789713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:31.790249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:31.808772 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:31.896613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:31.986734 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cae39d6a-b39d-465a-a9a5-8c5df45ee300 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.354400 Oct 19 00:52:31.989327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 954/1857] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers => generated 1664 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:31.994549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:31.995502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:32.007462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.008107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.009490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.010426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.011098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.011804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.047249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.057966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.059465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.060697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3c6f11b2-5e18-4f9c-a5f6-d61fff9a070f tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.300541 Oct 19 00:52:32.076519 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 904/1858] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:32.085303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3f5ec6f-f7f2-42e9-a4e7-74260d892dc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:32.086023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3f5ec6f-f7f2-42e9-a4e7-74260d892dc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:32.174007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3f5ec6f-f7f2-42e9-a4e7-74260d892dc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.187685 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3f5ec6f-f7f2-42e9-a4e7-74260d892dc0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1219 microversion: 2.1 time: 0.108356 Oct 19 00:52:32.188885 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 905/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:32 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:32.259064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.271103 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4af7627f-6a71-4c42-8707-19756fe2a941 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.280074 Oct 19 00:52:32.271864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 955/1860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:31 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:32.494087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:32.494695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:32.501543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.502267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.502891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.503975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.504613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.505247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.651809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:32.653046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:32.665608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.666025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.666201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.666858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.669308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.670179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.672191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.677194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.678701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.679937 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1b7f7cf-bcec-4792-aada-e39857f978da tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.190138 Oct 19 00:52:32.692655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 906/1861] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:32 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:52:32.727167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:32.727833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:32.734530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.735031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.735473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.735864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.736446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.736775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:32.736944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.737454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lazy-loading 'fault' on Instance uuid 505afe68-f76e-4a63-9e4a-ee2de533db5a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:32.738474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:32.739245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:32.792209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24b98f6af634c61af828bb20ce1e945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0676f376817483389300f03ed99cced', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.807793 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f7573c6-1b9e-41bb-b10f-cc8ae108c545 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 200 len: 1301 microversion: 2.1 time: 0.160007 Oct 19 00:52:32.809114 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 956/1862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:32 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:32.838608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:32.857867 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbcb17be-3a0d-4014-be7f-6244b584bf57 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1274 microversion: 2.1 time: 0.134659 Oct 19 00:52:32.858894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 907/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:32 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:33.087559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.089681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.099742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.100451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.101112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.102121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.102955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.103689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.211968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.216133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.225722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.228435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.229154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.234079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.235058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.236791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.360041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:33.371410 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5efa44a0-5ea3-40ab-b2e1-3b372dd33d39 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1271 microversion: 2.1 time: 0.163894 Oct 19 00:52:33.389896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 908/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:33.399843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.400776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.408744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.410012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.411229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.412142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.412814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.413451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.674155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:33.688247 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01139340-2770-4a29-a6fe-dc2581d1150a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.296739 Oct 19 00:52:33.692703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 909/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:33.701288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:33.711870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.712950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.713983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:33.717262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:33.719520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0776e6d-e53b-44cb-bf8e-30988196cf14 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.636187 Oct 19 00:52:33.720677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 957/1866] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:33.738301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.738986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.739553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.740396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.741601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.742043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.836158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.837025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] [instance: 505afe68-f76e-4a63-9e4a-ee2de533db5a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.845876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.846681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.847284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.848195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.848806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.849349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.865704 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] HTTP exception thrown: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Request method failure captured: Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a HTTP/1.1 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0h0xi4jABxHauPWw3wTQatz6skn_Kg7Og9D2JP0dJ2HlA4Q_2EY9O1SJWyahhpX5tqfW7d7TEQQQELxfPcLtSE4KF-6ER-IeacShE0PnN67cc4_IHl0B7o2_EnU7bmGLjQpVWw3cbvxNtmwcrlhjoFWzaBpVXuyE77CGbORAkyS4e8 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a0676f376817483389300f03ed99cced", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a0676f376817483389300f03ed99cced"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a0676f376817483389300f03ed99cced"}]}] Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-LiveMigrationTest-556388811 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a0676f376817483389300f03ed99cced Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-LiveMigrationTest-556388811 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a24b98f6af634c61af828bb20ce1e945 Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-LiveMigrationTest-556388811-project Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '505afe68-f76e-4a63-9e4a-ee2de533db5a'} Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:33.868019 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:33.873932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] Returning 404 to user: Instance 505afe68-f76e-4a63-9e4a-ee2de533db5a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:33.876919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fea56526-5096-4501-8cd9-abafe3681ed4 tempest-LiveMigrationTest-556388811 tempest-LiveMigrationTest-556388811-project] 10.222.0.27 "GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a" status: 404 len: 111 microversion: 2.1 time: 0.043439 Oct 19 00:52:33.876919 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 958/1867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/505afe68-f76e-4a63-9e4a-ee2de533db5a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:52:33.883505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:33.884422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:33.892270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.903132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.904127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:33.905405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:33.906155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:33.907529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.356736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:34.375471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:34.377286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:34.379624 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c66a39a5-836c-46b3-89cd-0f029cf5b1bd tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.671848 Oct 19 00:52:34.380531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 910/1868] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:52:34.403384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:34.404079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:34.412267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.417149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.417717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.418539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.419381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.419645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.467578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:34.478322 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12b61c38-567c-4510-b543-35218e8bf393 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.600104 Oct 19 00:52:34.489031 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 959/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:33 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:34.531079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19788717-483a-45ae-9bb8-28331035b6cf", "tag": "e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:34.545641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.546321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.547098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.560506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] Creating event network-changed:e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 for instance 19788717-483a-45ae-9bb8-28331035b6cf on n-h2-master-1 Oct 19 00:52:34.570882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4d69738a-53bd-4b2a-9bc3-dd05d3be5cc4 req-be69f837-b687-4e09-bcb6-a891a341361c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043340 Oct 19 00:52:34.571988 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 960/1870] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:52:34.584767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:34.597062 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4bdc1aec-05fb-478a-8400-89bf1622529b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1277 microversion: 2.1 time: 0.197171 Oct 19 00:52:34.599129 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 911/1871] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:34 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:34.713368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:34.714891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:34.721423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.722512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.723055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.724029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.724712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.725220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.748786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:34.750209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:34.757720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.758815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.759563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:34.760751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:34.761477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:34.762276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.010542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.019976 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-24acbd8d-a696-4d43-ad17-0942d7ef410d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.310496 Oct 19 00:52:35.020916 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 961/1872] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:34 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:35.055835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.065407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.067268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.068456 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca755854-6316-48e9-952d-e41fbbdbc70e tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.323543 Oct 19 00:52:35.069064 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 912/1873] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:34 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:35.434359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:35.438490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:35.461482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.462133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.464342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.466271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.467457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.468436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.509685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:35.510833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:35.518316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.519047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.520270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.521456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.522136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.522738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.862191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.871769 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17e9c9fc-378a-4a8b-b7ef-a482d9118abc tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.369857 Oct 19 00:52:35.876188 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 913/1874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:35 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:35.889040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:35.889332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.890452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:35.898385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.902195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.906452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.907173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.907632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.908283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.909141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:35.911757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:35.916675 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c10346c6-c692-4466-8316-73babb874cc9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.508492 Oct 19 00:52:35.943668 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 962/1875] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:35 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:35.957615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951b4c86-9f12-4b5f-9882-bd73ce348e4d", "name": "network-vif-plugged", "status": "completed", "tag": "9787f728-22a3-4998-8861-2ffcd5f27879"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:35.983051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:35.985796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:35.986918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.005859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] Creating event network-vif-plugged:9787f728-22a3-4998-8861-2ffcd5f27879 for instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d on n-h1-master-1 Oct 19 00:52:36.011808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1525a057-c92c-4336-b0f8-6bde2ee54d66 req-18debd59-4c49-4e03-b982-60bc1674286e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066603 Oct 19 00:52:36.013663 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 963/1876] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:36.049529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.054045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:36.055703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:36.071295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18533246-0de9-4439-bf2b-d04bfb519d18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1277 microversion: 2.1 time: 0.193618 Oct 19 00:52:36.073820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.075582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 914/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:35 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:36.077402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.079248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.082085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.086435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:36.091938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.093346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.108962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.110940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Searching by: {'deleted': False, 'project_id': '3b47200f231b4ac0a9e658295916e32b'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:36.119509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.123279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.123982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.125015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.125707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.126351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.200970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:36.289425 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55e96375-089f-4ab4-a7f5-ef751bc0a3f2 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.210626 Oct 19 00:52:36.292204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 915/1878] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:52:36 2022] GET /compute/v2.1/servers => generated 338 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:36.306766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:36.309602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:36.322614 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:36.328518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.329814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.330922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.332342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.332972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.334061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.527249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.542032 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5dbf9fc6-99ca-4bba-a648-d18169b301fc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.501161 Oct 19 00:52:36.546150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 964/1879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:36 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:36.558112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:36.563176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.569451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Searching by: {'deleted': False, 'project_id': '3b47200f231b4ac0a9e658295916e32b'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:36.586760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.587567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.589772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.593354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.594525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.595148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.667421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:36.723066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.742673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.744703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.746238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02681f24-a0f6-4737-b233-8261a349ade8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1359 microversion: 2.21 time: 0.452600 Oct 19 00:52:36.748762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 916/1880] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:36 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1359 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:36.764998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:36.775533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.777733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.778673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.902968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:36.904244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:36.921960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.922480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.922932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:36.923669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:36.924123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:36.924552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.207640 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aac32d05-b02a-4973-a473-f39226fc1aae tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1708 microversion: 2.1 time: 0.659922 Oct 19 00:52:37.208227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 965/1881] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:52:36 2022] GET /compute/v2.1/servers/detail => generated 1708 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:37.212808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:37.213637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:37.226410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.229128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.237415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.238953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.239435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.239872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.386993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.397391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81a0ea81-3801-4c33-a9f1-1feda3c48e53 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.501168 Oct 19 00:52:37.417484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 917/1882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:36 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:37.433270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:37.434184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:37.440781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.441988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.442599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.443488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.452423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.453194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.549187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.567519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.569603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.574625 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11320c37-7aa6-4ffb-b7c9-62d5b14cd2a9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.365006 Oct 19 00:52:37.576438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 966/1883] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:37 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:37.585205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1342fe5-6847-4135-a9c5-8ef8ed3f190e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:37.605267 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1342fe5-6847-4135-a9c5-8ef8ed3f190e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026690 Oct 19 00:52:37.606448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 967/1884] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:52:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:37.620506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:37.621323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:37.632052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.632976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.633548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.634389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.634957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.635748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.941987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.952773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4c2511c3-97ee-48b3-a59b-5285a64d4596 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.337953 Oct 19 00:52:37.973886 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 968/1885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:37 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:37.977061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:37.982381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:37.983390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:37.987106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02edf02f-01f9-4a0f-8b3b-6bd9608112ca tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.568393 Oct 19 00:52:37.992295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.993143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.993843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:37.994804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:37.995488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:37.996175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.002718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 918/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:37 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:38.012655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c32edf59-dcf2-4e71-b7f7-28ee0db9c80a", "tag": "453af2ef-4c55-4f45-862a-bc3d831666f7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:38.024534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.025061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.025500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.041212 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] Creating event network-changed:453af2ef-4c55-4f45-862a-bc3d831666f7 for instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a on n-h2-master-1 Oct 19 00:52:38.056327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-51fc48a3-06b0-42ea-a581-ebf8a9a983b3 req-0678e4d8-6a80-4bee-80ba-945d62a2d034 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052091 Oct 19 00:52:38.062085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 919/1887] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:38.185249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.199862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.202022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.203867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5140d7a6-b8fa-4015-937c-565916110636 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1551 microversion: 2.21 time: 0.227490 Oct 19 00:52:38.217904 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 969/1888] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:37 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1551 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:38.233656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:38.234925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:38.242542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.243433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.244146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.245123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.245768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.247018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.281691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:38.353244 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:38.413035 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad84a68a-b326-45f9-a3ed-c4f1c596fdc1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "DELETE /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 204 len: 0 microversion: 2.21 time: 0.181993 Oct 19 00:52:38.417045 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 920/1889] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:52:38 2022] DELETE /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:52:38.424286 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:38.426637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:38.437989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.442950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.443167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:38.443933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.445644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:38.449073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.450044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.450754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.460554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.465249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.466424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.467322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.467751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.468192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.892818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.900982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a7d552d-bfbf-48d2-925c-bd1e4baec0b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.479522 Oct 19 00:52:38.901579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 921/1890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:38 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:38.914092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.920203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:38.920203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:38.928014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.929511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:38.930736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ec1db74-5b87-4832-8583-184a76f75603 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1557 microversion: 2.21 time: 0.512443 Oct 19 00:52:38.937587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.938076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.938512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.939321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.939677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.940105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.942582 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 970/1891] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:38 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1557 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:38.948510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:38.948979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:38.963886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.964485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.964858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:38.965610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:38.966066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:38.966498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.019527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:39.023281 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:39.173672 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dcf25caa-49d0-4860-821f-ffed52b3776a tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 204 len: 0 microversion: 2.1 time: 0.229363 Oct 19 00:52:39.177383 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 971/1892] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:52:38 2022] DELETE /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:39.192485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:39.193463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:39.202659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.203396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.212507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.213716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.214367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.215165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.247100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.257303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.258748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.261501 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08063bc0-0e83-41d8-9c11-5eb6d03b7e97 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.358402 Oct 19 00:52:39.262658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 922/1893] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:38 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:39.267412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:39.268241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:39.275282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.276038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.277503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.278437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.279079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.280330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.496161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.510200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.520381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be47771b-aaf9-4c4d-8ea6-38866b73bf34 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.333764 Oct 19 00:52:39.521401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 972/1894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:39 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:39.527711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9c036eb-2f47-4096-a2d8-94c4d950467b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.263685 Oct 19 00:52:39.533317 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 923/1895] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:39 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:39.536257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:39.537402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:39.543932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.544425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.545366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.546108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.546819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.547268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.699036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:39.708652 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e434307-f2df-4cc9-bff5-2bca2105b5a5 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1711 microversion: 2.1 time: 0.179426 Oct 19 00:52:39.710539 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 973/1896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:39 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1711 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:39.780226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a82de8-3025-495c-b4a1-3173250c497f", "tag": "687bb940-b707-4221-ac61-c58dafaa2e14"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:39.808841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.809698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.810375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.825824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] Creating event network-changed:687bb940-b707-4221-ac61-c58dafaa2e14 for instance d7a82de8-3025-495c-b4a1-3173250c497f on n-h1-master-1 Oct 19 00:52:39.831080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-fd316999-f0b0-465a-a3f3-53398abb9f98 req-622c31c2-53d0-4f0c-bdb2-ea02b690431e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063508 Oct 19 00:52:39.831924 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 924/1897] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:39.932985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:39.935543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:39.945220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.946224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.947060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.948373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.949034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.949618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.971584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:39.972930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:39.982034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.982823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.983370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:39.985116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:39.985747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:39.986278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:40.359812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:40.380253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e77f172-5c71-4db8-a931-1f93f7468ea7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.451829 Oct 19 00:52:40.386757 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 974/1898] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:39 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:40.400146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:40.405645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:40.420784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:40.422029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:40.427598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:40.429958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:40.431462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:40.433681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:40.436630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:40.459247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:40.461319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:40.463125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce2e0ce2-b959-4728-8456-17170a93f7bd tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1557 microversion: 2.21 time: 0.496171 Oct 19 00:52:40.464142 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 925/1899] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:39 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1557 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:40.543636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:40.544270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:40.552102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:40.552596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:40.558191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:40.558956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:40.559430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:40.559860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:41.463191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:41.481559 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0154af0f-3efa-4f34-8417-0f7b8ec0d2a5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.941554 Oct 19 00:52:41.486764 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 926/1900] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:40 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:41.495176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:41.497120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:41.498064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:41.507685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:41.508277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:41.509893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:41.511024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:41.511671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:41.512678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:41.516278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:41.517830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:41.519726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16a80818-ce3f-4d0c-89db-22190d2faa65 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 1.129988 Oct 19 00:52:41.520483 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 975/1901] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:40 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:41.528083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:41.533592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:41.546084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:41.557388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:41.558137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:41.559096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:41.559743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:41.560182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.005111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.013814 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5095041-589b-41dc-abdf-d23f69c28a4d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.524021 Oct 19 00:52:42.014522 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 927/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:41 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:42.035252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:42.036793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:42.037457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.044028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.044880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.045323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.046044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.046500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.046927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.060602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92253f90-9411-42a7-9229-297330931eaf tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1711 microversion: 2.1 time: 0.538329 Oct 19 00:52:42.062101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 976/1903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:41 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1711 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:42.071045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:42.074609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:42.086174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.087097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.088023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.089486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.092664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.093393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.183622 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=32 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:42.274960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.284590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.286110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.287388 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-988847b6-2fa8-4df3-90fb-c2089cc2f7a1 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1515 microversion: 2.21 time: 0.223859 Oct 19 00:52:42.288340 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 977/1904] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:42 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:42.293260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19788717-483a-45ae-9bb8-28331035b6cf", "name": "network-vif-plugged", "status": "completed", "tag": "e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:42.303635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.304511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.305215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.324236 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] Creating event network-vif-plugged:e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 for instance 19788717-483a-45ae-9bb8-28331035b6cf on n-h2-master-1 Oct 19 00:52:42.330250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3a4e9a01-32a9-4ae2-9fd9-99eb0c3396fc req-9600605e-c6af-4ca6-a329-f8d3918adf3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040465 Oct 19 00:52:42.331259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 978/1905] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:42.338648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "951b4c86-9f12-4b5f-9882-bd73ce348e4d", "name": "network-vif-deleted", "tag": "9787f728-22a3-4998-8861-2ffcd5f27879"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:42.350160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.350830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.351498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.363730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.366193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] Creating event network-vif-deleted:9787f728-22a3-4998-8861-2ffcd5f27879 for instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d on n-h1-master-1 Oct 19 00:52:42.373096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0d2ce8ea-65e4-43d4-9a0d-12e358a3fefc req-55121edf-a058-4fbb-8e90-bbc92e4a5453 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039477 Oct 19 00:52:42.374140 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 979/1906] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:42.374777 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e23b646-5b2e-4361-847c-5772986352ef tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.344275 Oct 19 00:52:42.375741 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 928/1907] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:42 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:42.516820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:42.518094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:42.524680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.525173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.525612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.526381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.526839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.527267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.556190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:42.556835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:42.563970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.564885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.565710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.567187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:42.567803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:42.568243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:42.859161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.895182 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92a685b3-6640-467e-8721-b3437ff87908 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.385119 Oct 19 00:52:42.899805 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 980/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:42 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:42.912725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.925684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.927944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:42.932927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96edaa21-a2fc-48c8-8890-a7750f70ac32 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.377673 Oct 19 00:52:42.945224 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 929/1909] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:42 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:43.053208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.054372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.058304 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:43.078101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.078779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.079304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.080967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.080967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.088093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.089569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.096615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.100168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.103329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.104888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.110598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.111361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.112997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.263404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.277114 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1816a51-888e-4a25-b19b-cdec2e8b840d tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1644 microversion: 2.1 time: 0.193783 Oct 19 00:52:43.278797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 930/1910] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1644 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:43.299641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4e2e0b3-2697-4a42-923f-f0998847efed", "name": "network-vif-deleted", "tag": "d3113786-f74a-44b5-a826-7360217581c2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:43.310805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.311668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.312289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.327032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] Creating event network-vif-deleted:d3113786-f74a-44b5-a826-7360217581c2 for instance b4e2e0b3-2697-4a42-923f-f0998847efed on n-h2-master-1 Oct 19 00:52:43.335664 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c4e39413-a5ef-4b3f-8ea6-9d2273411a9d req-45ad87dc-4b7e-40ab-aa2a-a61c09fff4b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041122 Oct 19 00:52:43.337333 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 931/1911] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:43.343336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.344746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.352974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.354154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.354830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.355836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.356719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.357532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.400739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.401412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.402029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.402657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lazy-loading 'fault' on Instance uuid 951b4c86-9f12-4b5f-9882-bd73ce348e4d {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:43.544015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.556607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.559325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b723ed2b79d4049ac0ee542d18b45c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a1c816191c44b799ffe501cad81ffba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.560822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8fa25b28-ec87-44e7-aa4f-972d5092bbf0 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 200 len: 1349 microversion: 2.21 time: 0.222038 Oct 19 00:52:43.561985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 932/1912] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 1349 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:43.569031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.569675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.577684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.578503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.579103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.580023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.580675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.582534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.624009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.632694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21961dd3-8d5c-4b77-a170-07c51760c037 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.596700 Oct 19 00:52:43.633900 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 981/1913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:43.789333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:43.798264 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e97b8b91-7796-4452-915c-3fcf2c19b0f0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.234968 Oct 19 00:52:43.809785 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 933/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:43.932265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.933184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.948796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.951487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.951990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.953435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.955676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.961443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:43.962278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:43.965308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.980249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.981878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.982525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:43.983467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:43.986357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:43.987041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.355877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.363137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.367801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.370214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.372891 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-034571bd-1548-40e2-98c8-715d2f1876a7 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.415177 Oct 19 00:52:44.374344 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 934/1915] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:52:44.381418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:44.382531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2fc413ad-c3a7-474d-a943-9290a5d52724 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.461336 Oct 19 00:52:44.382829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:44.384306 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 982/1916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:43 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:44.392766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.393445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.394056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.394870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.395456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.396113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.478799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.479503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.480133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.480827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lazy-loading 'fault' on Instance uuid b4e2e0b3-2697-4a42-923f-f0998847efed {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:44.547339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.558859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11f1ae19-dedc-438f-b452-7f50166e646e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1365 microversion: 2.1 time: 0.182917 Oct 19 00:52:44.560787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 935/1917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:44 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:44.589667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:44.590276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:44.596422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.597479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.597922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.598636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.599095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.599522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.618509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] HTTP exception thrown: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Request method failure captured: Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d HTTP/1.1 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0o_7UoWM5bUVOMKUORycdwIAixmyiHmKGLJnykYOkm87CU20IISdmCLHlgmOYvoqC_8jVUyF0v7WwUTfQBkFmYECpVfPefw8P-SJf798uBO1GyLPYZqgv0CnlO1mCnmI76gVieIi4oqKFZpYj8I6HxjJARYKlLoxwUEotsmhH-Az8s Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1c816191c44b799ffe501cad81ffba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}] Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8b723ed2b79d4049ac0ee542d18b45c3 Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '951b4c86-9f12-4b5f-9882-bd73ce348e4d'} Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:44.620176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:44.626399 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:44.628324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Returning 404 to user: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:44.629338 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-01ae9daf-6f42-4246-9664-a3bc074525e4 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 404 len: 111 microversion: 2.21 time: 0.043648 Oct 19 00:52:44.630444 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 983/1918] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:44 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:44.639317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '.version_select at 0x7f2af4b9fdc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:44.640039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:44.665941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.666556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.667009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.669494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:44.670118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:44.670984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.671995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.673697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.695354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.695888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.698153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.699430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.699911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.700363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.906120 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb26e133-203b-490a-8223-0e5c6f22ed8b tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.271488 Oct 19 00:52:44.906733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 936/1919] 10.222.0.27 () {60 vars in 1337 bytes} [Wed Oct 19 00:52:44 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d/os-instance-actions => generated 611 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:44.917637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:44.917637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:44.930983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.931493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.931947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.932768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:44.933236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:44.933676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:44.988337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:44.996782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5077ace7-f063-4363-8985-e59c29f5ec17 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.340321 Oct 19 00:52:45.009745 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 984/1920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:44 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:45.017606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:45.020361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:45.031975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.032777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.033476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.035162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.035867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.036551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.056978 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] HTTP exception thrown: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Request method failure captured: Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d HTTP/1.1 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0o_7UoWM5bUVOMKUORycdwIAixmyiHmKGLJnykYOkm87CU20IISdmCLHlgmOYvoqC_8jVUyF0v7WwUTfQBkFmYECpVfPefw8P-SJf798uBO1GyLPYZqgv0CnlO1mCnmI76gVieIi4oqKFZpYj8I6HxjJARYKlLoxwUEotsmhH-Az8s Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1c816191c44b799ffe501cad81ffba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}] Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8b723ed2b79d4049ac0ee542d18b45c3 Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '951b4c86-9f12-4b5f-9882-bd73ce348e4d'} Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:45.059694 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.065307 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.067342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Returning 404 to user: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:45.068416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-debad77d-728e-4ee6-a8c9-a4d6e9fac4f8 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "DELETE /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 404 len: 111 microversion: 2.21 time: 0.056154 Oct 19 00:52:45.069535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 985/1921] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:52:45 2022] DELETE /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:45.084490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:45.086879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] [instance: 951b4c86-9f12-4b5f-9882-bd73ce348e4d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:45.095686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.096445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.097490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.098214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.098665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.099311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.115277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:45.123768 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f11f3ad-80a6-43bf-bd40-8e208cd9888d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1316 microversion: 2.1 time: 0.215943 Oct 19 00:52:45.125280 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 937/1922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:44 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:45.133803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] HTTP exception thrown: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Request method failure captured: Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d HTTP/1.1 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0o_7UoWM5bUVOMKUORycdwIAixmyiHmKGLJnykYOkm87CU20IISdmCLHlgmOYvoqC_8jVUyF0v7WwUTfQBkFmYECpVfPefw8P-SJf798uBO1GyLPYZqgv0CnlO1mCnmI76gVieIi4oqKFZpYj8I6HxjJARYKlLoxwUEotsmhH-Az8s Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.21 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1a1c816191c44b799ffe501cad81ffba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1a1c816191c44b799ffe501cad81ffba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1a1c816191c44b799ffe501cad81ffba"}]}] Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1a1c816191c44b799ffe501cad81ffba Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1290395499 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8b723ed2b79d4049ac0ee542d18b45c3 Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsV221TestJSON-1290395499-project Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '951b4c86-9f12-4b5f-9882-bd73ce348e4d'} Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.135390 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] Returning 404 to user: Instance 951b4c86-9f12-4b5f-9882-bd73ce348e4d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8609f7b4-4d2a-40e2-b4b6-46abeacf2363 tempest-InstanceActionsV221TestJSON-1290395499 tempest-InstanceActionsV221TestJSON-1290395499-project] 10.222.0.27 "GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d" status: 404 len: 111 microversion: 2.21 time: 0.062051 Oct 19 00:52:45.140141 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 986/1923] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:45 2022] GET /compute/v2.1/servers/951b4c86-9f12-4b5f-9882-bd73ce348e4d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:52:45.403221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:45.404548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:45.409951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:45.411030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:45.419793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.420297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.420768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.421916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.422619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.423250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.423895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.432792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.433378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.433520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.434245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.434889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.438867 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:45.887521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:45.902417 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-049ee93b-6e58-43e9-9f3c-30217468dcb9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.496668 Oct 19 00:52:45.903337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 987/1924] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:45 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:45.908146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:45.908718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:45.935453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.935964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.936395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:45.937192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:45.948834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:45.949523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.018475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.020026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.020599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.021513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lazy-loading 'fault' on Instance uuid b4e2e0b3-2697-4a42-923f-f0998847efed {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:46.133424 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:46.143733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.160236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.167421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.169423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af66c1c1-3fdf-4113-8939-fbea6a4c107f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1812 microversion: 2.25 time: 0.770432 Oct 19 00:52:46.172300 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 938/1925] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:45 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1812 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:46.184434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:46.185483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:46.212015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.213074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.217080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.218095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.218803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.219512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.305524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1f203c2e330487e9a1bdfff7e60af3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b47200f231b4ac0a9e658295916e32b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.326995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef37c2d0-f5c8-432b-8fe7-b8b9cff9815e tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 200 len: 1365 microversion: 2.1 time: 0.410203 Oct 19 00:52:46.327921 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 988/1926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:45 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:46.338295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:46.343158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:46.360577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.361550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.362256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.363583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.364296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.371537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.603741 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:46.634314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.645799 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d1b32dbc-e41f-4b93-961f-20cac3451ec1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.472012 Oct 19 00:52:46.661430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 939/1927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:46 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:46.762928 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=18 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:46.873752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:46.876027 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:46.898215 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f54ba6b-873a-4b70-b6a9-2e49d3c7e8f2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1505 microversion: 2.1 time: 0.562924 Oct 19 00:52:46.899549 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 989/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:46 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:46.929846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:46.930394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:46.934676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-699252970"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:46.935393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:46.958584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.959117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.959578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.961219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.964694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.965819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.966575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.968209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.969593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:46.970294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:46.973209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:46.975377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:47.458619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:47.477176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Adding security group 30559406-1109-49d6-a5b7-a0bcc51d902d to port e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 Oct 19 00:52:47.482262 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7fece01b-aab2-48ae-99ab-b6374b24fb84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.557401 Oct 19 00:52:47.483913 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 990/1929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:46 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:47.491426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:47.492554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:47.501727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:47.502652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:47.503899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:47.506836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:47.507534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:47.508442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:48.320541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:48.342717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:48.355455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:48.359581 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3865895-5ac9-4d34-a085-55c6a6e4745d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1802 microversion: 2.25 time: 0.874186 Oct 19 00:52:48.362086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 991/1930] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:47 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1802 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:48.399574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:48.400269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] [instance: b4e2e0b3-2697-4a42-923f-f0998847efed] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:48.415782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:48.416283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:48.416812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:48.417502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:48.417974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:48.418410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:48.458025 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] HTTP exception thrown: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Request method failure captured: Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed HTTP/1.1 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oGKgStucU2sbU1s4HiQzkm-sSjUnKihnvSaSCMABHU_3GHSnkrP7uP4VCNmIWY1tvRDih36dBw25YqgdRa3_fxdWu46zttb1mfz-9S4GIlErUkVW3-sXV3DZ0AM_WdM5SQt5Xye4BOhbvRWifeNWQep_WaP1C6QoF21cu4xqjXL7A Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3b47200f231b4ac0a9e658295916e32b Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestManualDisk-852212389 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3b47200f231b4ac0a9e658295916e32b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b47200f231b4ac0a9e658295916e32b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3b47200f231b4ac0a9e658295916e32b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3b47200f231b4ac0a9e658295916e32b"}]}] Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestManualDisk-852212389 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3b47200f231b4ac0a9e658295916e32b Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestManualDisk-852212389 Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestManualDisk-852212389-project Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e1f203c2e330487e9a1bdfff7e60af3b Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestManualDisk-852212389-project Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b4e2e0b3-2697-4a42-923f-f0998847efed'} Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:48.459631 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:48.465499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Returning 404 to user: Instance b4e2e0b3-2697-4a42-923f-f0998847efed could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:48.468900 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13bf6c35-3924-4660-b377-e09db2745985 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed" status: 404 len: 111 microversion: 2.1 time: 0.075304 Oct 19 00:52:48.469889 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 992/1931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:48 2022] GET /compute/v2.1/servers/b4e2e0b3-2697-4a42-923f-f0998847efed => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:52:48.482267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:48.482917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:48.494226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:48.494654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:48.495104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:48.495878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:48.496342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:48.501872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.182304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:49.191889 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36912bd6-43f6-4dd3-8d25-a906d847f016 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.720769 Oct 19 00:52:49.207560 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 993/1932] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:48 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:49.207560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a82de8-3025-495c-b4a1-3173250c497f", "name": "network-vif-plugged", "status": "completed", "tag": "687bb940-b707-4221-ac61-c58dafaa2e14"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:49.244215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.244944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.245305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.265568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] Creating event network-vif-plugged:687bb940-b707-4221-ac61-c58dafaa2e14 for instance d7a82de8-3025-495c-b4a1-3173250c497f on n-h1-master-1 Oct 19 00:52:49.276034 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-06f8081f-3c43-4da8-abc1-62915c289713 req-7824b2a6-694b-4fbb-9685-0d5c076f92d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078651 Oct 19 00:52:49.276672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 994/1933] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:49.284933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38b8c4e8-719a-44a8-9f9a-bf8bc8d9e76c tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '.version_select at 0x7f2af931f160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:49.290443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38b8c4e8-719a-44a8-9f9a-bf8bc8d9e76c tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.291218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38b8c4e8-719a-44a8-9f9a-bf8bc8d9e76c tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.291670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38b8c4e8-719a-44a8-9f9a-bf8bc8d9e76c tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.303874 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38b8c4e8-719a-44a8-9f9a-bf8bc8d9e76c tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1277 microversion: 2.25 time: 0.025314 Oct 19 00:52:49.316030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 995/1934] 10.222.0.27 () {60 vars in 1184 bytes} [Wed Oct 19 00:52:49 2022] GET /compute/v2.1/os-migrations => generated 1277 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:49.324110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10e9b6ae-41cc-4deb-bb76-40e7868586a9 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] Calling method '.version_select at 0x7f2af47615e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:49.354008 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10e9b6ae-41cc-4deb-bb76-40e7868586a9 tempest-ServersTestManualDisk-852212389 tempest-ServersTestManualDisk-852212389-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176673103" status: 202 len: 0 microversion: 2.1 time: 0.036242 Oct 19 00:52:49.354937 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 996/1935] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:52:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176673103 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:49.367973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:49.370991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:49.383330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.384184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.384888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.385846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.387317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.387982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.457088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aa7ad48d-19a7-435d-a5e8-cd566e7871c9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action" status: 202 len: 0 microversion: 2.1 time: 2.537274 Oct 19 00:52:49.459567 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 940/1936] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:46 2022] POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action => generated 0 bytes in 2541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:49.467743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:49.473087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:49.482796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.483570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.484409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:49.485746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:49.486421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:49.487531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.098634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:50.111169 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d674c6a-b023-42f3-8dbe-abe2eb55d597 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.749147 Oct 19 00:52:50.111355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:50.124872 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 997/1937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:49 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:50.124872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af9364dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:50.156381 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7572b6d-0e30-4b2c-b693-53777cfe62c0 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 2418 microversion: 2.25 time: 0.694877 Oct 19 00:52:50.170864 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 941/1938] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:49 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 2418 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:50.189760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19788717-483a-45ae-9bb8-28331035b6cf", "tag": "e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:50.207484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.207967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.208403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.220919 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] Creating event network-changed:e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 for instance 19788717-483a-45ae-9bb8-28331035b6cf on n-h2-master-1 Oct 19 00:52:50.227522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-228a4f1d-4625-47c6-ac72-b5f252a98298 req-9b068d9a-2674-4f61-99f5-f46bccb91192 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054766 Oct 19 00:52:50.229032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 942/1939] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:50.239958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:50.241560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:50.249848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.250588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.251256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.254394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.255818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.256488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.400648 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use.", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:50.401442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.401442 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d HTTP/1.1 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: exception: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '30559406-1109-49d6-a5b7-a0bcc51d902d'} Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:50.404156 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 400 to user: Security Group 30559406-1109-49d6-a5b7-a0bcc51d902d in use. Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-915b2ffa-1e90-4c9f-bb84-3d217c623ae0'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c230ffcb-558f-4c9f-bc75-b5056c40516b tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d" status: 400 len: 185 microversion: 2.1 time: 0.289083 Oct 19 00:52:50.412208 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 998/1940] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:50 2022] DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d => generated 185 bytes in 294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:50.422515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:50.429404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:50.442478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.449584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.450203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.451078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.451637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.452172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.639336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:50.668025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98a67f23-b321-426f-9e56-fe2da78df756 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 2418 microversion: 2.25 time: 0.436581 Oct 19 00:52:50.668634 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 943/1941] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:50 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 2418 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:50.719877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:50.743617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:50.749998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:50.772614 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77c9594a-e9d4-4341-bb9a-44de31c3b59a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1319 microversion: 2.1 time: 0.361104 Oct 19 00:52:50.782259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 999/1942] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:50 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:50.785069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.788135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.788713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.790518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.791858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.792523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.870422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:50.870924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:50.882097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.882539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.882980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.883689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:50.884141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:50.884661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:50.969731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d96ce789-83e1-4a3f-931c-532a7685c122 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action" status: 202 len: 0 microversion: 2.1 time: 0.287030 Oct 19 00:52:50.971966 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 944/1943] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:50 2022] POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:50.994490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:50.995691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:51.002190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.002594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.004387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.005378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.006039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.006634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.071638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lazy-loading 'services' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:52:51.225291 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bad8de10-db0a-4916-a5f7-0a79c02393c8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments/371f5679-021f-447e-9a22-29cc9392de7e" status: 202 len: 0 microversion: 2.25 time: 0.360055 Oct 19 00:52:51.226257 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1000/1944] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Oct 19 00:52:50 2022] DELETE /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments/371f5679-021f-447e-9a22-29cc9392de7e => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:51.231893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:51.240316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:51.256907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.257390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.257857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.258534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.259191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.259782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.629231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:51.638688 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-852e9c20-65b3-4da9-a7f6-489df4305895 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1575 microversion: 2.1 time: 0.662689 Oct 19 00:52:51.656648 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 945/1945] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:50 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1575 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:51.657450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:51.665753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:51.684457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.685391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.685848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.686589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.687047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.687477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.759874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6f017d02-94da-4383-9ee6-47847400d228 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.113327 Oct 19 00:52:51.760822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 946/1946] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:51 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:51.765589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32edf59-dcf2-4e71-b7f7-28ee0db9c80a", "name": "network-vif-plugged", "status": "completed", "tag": "453af2ef-4c55-4f45-862a-bc3d831666f7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:51.777093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.777566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.778200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.793289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] Creating event network-vif-plugged:453af2ef-4c55-4f45-862a-bc3d831666f7 for instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a on n-h2-master-1 Oct 19 00:52:51.798670 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2ee541bc-8c08-4371-a867-724551b0d6c6 req-4183e45c-adea-46c7-9918-d9d259faa957 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036474 Oct 19 00:52:51.799755 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 947/1947] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:51.809296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:51.810009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:51.821163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.822013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.822778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.823705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:51.824366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:51.825180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:51.861942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:51.878812 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ce6605a-ef78-4ba6-b976-7ddebd505dcb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.651036 Oct 19 00:52:51.894817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1001/1948] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:51 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:52.126507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:52.141434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b83dcdc5-12a2-41fa-a0e7-46f00750f093 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1469 microversion: 2.1 time: 0.337377 Oct 19 00:52:52.142362 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 948/1949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:51 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1469 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:52.171817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:52.172430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:52.186170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.186984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.191917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.192991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.193671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.194314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.497717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:52.508120 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77524b97-42a6-4e0a-95e6-02e4740627ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 200 len: 1319 microversion: 2.1 time: 0.340169 Oct 19 00:52:52.510775 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1002/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:52 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:52.672482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:52.673174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:52.685327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.686084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.687138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.688035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.688683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.689360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.775728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:52.778808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:52.787767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.788672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.789360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.790301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.791108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.792357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.852808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-855b8525-5398-41ad-bebd-737e51fab314 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.082880 Oct 19 00:52:52.863493 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1003/1951] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:52 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:52.905299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:52.908826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:52.925888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.928548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.929201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:52.929905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:52.930372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:52.930805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.205143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:53.228758 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dde31f06-b0d3-4de5-b595-e484f8088154 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1575 microversion: 2.1 time: 0.549772 Oct 19 00:52:53.230078 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 949/1952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:52 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1575 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:53.406877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:53.417190 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84fba3aa-fb3d-4129-a782-49e22b9b6490 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.515533 Oct 19 00:52:53.422690 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1004/1953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:52 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:53.444614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4b293a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:53.449716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.450549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.451147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.461110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.461811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.462359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.481604 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] HTTP exception thrown: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Request method failure captured: Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d HTTP/1.1 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 56 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0pkXUjTgbOrxtlit8q0vzJzdZW_MZ4m8auW2g-P2YLRSvXnPIOcORw_AtmSOgYCRO8ZAEHCrFtohhYgjTMQiFaW2eW-ap0SQyr9RjtnMY-S_z0nVnzNbn6O6FX9FSQp2eUOr5WlyQwN-Le0fpELieV5FRFFBzvfnmEgL57E64cntIk Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66fc5d7296674627a26a14e49ca98ec0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}] Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 4f8ac94b437047d0b025e77a28ab889b Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: exception: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dd2883ac-82b5-4f75-a58f-333ea693af9d', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:52:53.483745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.489777 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.490900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Returning 404 to user: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:53.492071 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f36e8b29-9fef-4015-a448-385b5ee07c18 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d" status: 404 len: 110 microversion: 2.53 time: 0.260422 Oct 19 00:52:53.498630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 950/1954] 10.222.0.27 () {62 vars in 1309 bytes} [Wed Oct 19 00:52:53 2022] PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d => generated 110 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:53.506353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4871310>, body: {"status": "disabled"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:53.523450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.528096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.528719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.541725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.547612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:53.548056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.548575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.549976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.559664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.560335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.561103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.561934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.562513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.563335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.563601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] HTTP exception thrown: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Request method failure captured: Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d HTTP/1.1 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 22 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0pkXUjTgbOrxtlit8q0vzJzdZW_MZ4m8auW2g-P2YLRSvXnPIOcORw_AtmSOgYCRO8ZAEHCrFtohhYgjTMQiFaW2eW-ap0SQyr9RjtnMY-S_z0nVnzNbn6O6FX9FSQp2eUOr5WlyQwN-Le0fpELieV5FRFFBzvfnmEgL57E64cntIk Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66fc5d7296674627a26a14e49ca98ec0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}] Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4f8ac94b437047d0b025e77a28ab889b Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: {"status": "disabled"} Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: exception: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'dd2883ac-82b5-4f75-a58f-333ea693af9d', 'body': {'status': 'disabled'}} Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:52:53.571454 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.578853 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.582100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Returning 404 to user: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:53.583807 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79ff6783-03dd-4828-92ae-a3c6a5b4124f tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d" status: 404 len: 110 microversion: 2.53 time: 0.083591 Oct 19 00:52:53.587568 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1005/1955] 10.222.0.27 () {62 vars in 1309 bytes} [Wed Oct 19 00:52:53 2022] PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d => generated 110 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:53.604708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Action: 'update', calling method: .version_select at 0x7f2af93b18b0>, body: {"status": "enabled"} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:53.608266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.617308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.617826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.628419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.630654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.631309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.637472 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] HTTP exception thrown: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Request method failure captured: Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d HTTP/1.1 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 21 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0pkXUjTgbOrxtlit8q0vzJzdZW_MZ4m8auW2g-P2YLRSvXnPIOcORw_AtmSOgYCRO8ZAEHCrFtohhYgjTMQiFaW2eW-ap0SQyr9RjtnMY-S_z0nVnzNbn6O6FX9FSQp2eUOr5WlyQwN-Le0fpELieV5FRFFBzvfnmEgL57E64cntIk Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_66fc5d7296674627a26a14e49ca98ec0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/66fc5d7296674627a26a14e49ca98ec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/66fc5d7296674627a26a14e49ca98ec0"}]}] Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 66fc5d7296674627a26a14e49ca98ec0 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512 Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4f8ac94b437047d0b025e77a28ab889b Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: {"status": "enabled"} Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: exception: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'dd2883ac-82b5-4f75-a58f-333ea693af9d', 'body': {'status': 'enabled'}} Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:52:53.639600 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. Oct 19 00:52:53.646491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:53.649718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Returning 404 to user: Service dd2883ac-82b5-4f75-a58f-333ea693af9d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:53.663914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-becb4910-da0c-473c-b219-1b166cf42468 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d" status: 404 len: 110 microversion: 2.53 time: 0.070126 Oct 19 00:52:53.665611 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1006/1956] 10.222.0.27 () {62 vars in 1309 bytes} [Wed Oct 19 00:52:53 2022] PUT /compute/v2.1/os-services/dd2883ac-82b5-4f75-a58f-333ea693af9d => generated 110 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:53.676994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.681365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.682796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.683460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.684433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.685138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.685781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.719705 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10a85407-e130-4551-ba95-ad6c251b22d8 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.048954 Oct 19 00:52:53.721260 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1007/1957] 10.222.0.27 () {60 vars in 1178 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:53.734290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.738350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.738856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.739304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.740065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.741378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.741826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.772247 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ec27f9a-d886-479c-8269-756b046f910c tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.042030 Oct 19 00:52:53.773389 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1008/1958] 10.222.0.27 () {60 vars in 1211 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:53.794809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.799218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.800649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.802560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.805802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.806586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.807290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.840762 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d802b510-6232-4ee8-b1db-ee7dd4939bb1 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.057321 Oct 19 00:52:53.844804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1009/1959] 10.222.0.27 () {60 vars in 1178 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:53.857600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.866916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.867652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.868968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.870919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.871464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.871964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.920820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b669dffa-a890-4145-b4a2-db6ff6d3ae4b tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.067448 Oct 19 00:52:53.922340 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1010/1960] 10.222.0.27 () {60 vars in 1235 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/os-services?host=n-d-master-1&binary=xxx => generated 16 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:53.928865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.931906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:53.938986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.939482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.941311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.942245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.942717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.943156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.975972 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e706a18f-accd-44b8-851f-1738c44f1936 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.052022 Oct 19 00:52:53.976568 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1011/1961] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:53.981306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:53.984889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.985383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.985886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:53.986662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:53.987133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:53.988261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.015351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c0caaca-47ac-49c4-b7d9-8bc7d074b5ab tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037336 Oct 19 00:52:54.016348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1012/1962] 10.222.0.27 () {60 vars in 1178 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:54.028413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:54.032200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.032725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.033391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.034409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.035069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.035670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.064977 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e8cc173-c524-4d3a-988c-94b1ed586c28 tempest-ServicesAdminNegativeV253TestJSON-265887512 tempest-ServicesAdminNegativeV253TestJSON-265887512-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.040276 Oct 19 00:52:54.074286 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1013/1963] 10.222.0.27 () {60 vars in 1239 bytes} [Wed Oct 19 00:52:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:54.210020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-674a7e72-e292-41fd-a931-160659b460ba tempest-ServicesAdminNegativeV253TestJSON-738810319 tempest-ServicesAdminNegativeV253TestJSON-738810319-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:54.213695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-674a7e72-e292-41fd-a931-160659b460ba tempest-ServicesAdminNegativeV253TestJSON-738810319 tempest-ServicesAdminNegativeV253TestJSON-738810319-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '2afe56c7bd2d43e79ece511774f6f876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77e5631b0954981b2b18b1372df6608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-674a7e72-e292-41fd-a931-160659b460ba tempest-ServicesAdminNegativeV253TestJSON-738810319 tempest-ServicesAdminNegativeV253TestJSON-738810319-project] Request method failure captured: Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0pkuQteyitwu6vv9xBKvsLCf4i2BzqS1zJg7a4Fw9ys0oMT1VlbVrbtJU7WjJ6scWDRuFObfFXX_Rz62qQcPamdgPhzWUee2mLLzIAbUJJ-OrEbgiKKrPDhi9KgEFsYlOTdwijRGbxgiiqqNE7KY9TJ5VaiOCr9CUHsrJQhALME_aE Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.53 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: b77e5631b0954981b2b18b1372df6608 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-738810319 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b77e5631b0954981b2b18b1372df6608", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b77e5631b0954981b2b18b1372df6608"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b77e5631b0954981b2b18b1372df6608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b77e5631b0954981b2b18b1372df6608"}]}] Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-738810319 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: b77e5631b0954981b2b18b1372df6608 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-738810319 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServicesAdminNegativeV253TestJSON-738810319-project Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2afe56c7bd2d43e79ece511774f6f876 Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-738810319-project Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: action_args: {} Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 19 00:52:54.215461 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 19 00:52:54.220371 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:54.223728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-674a7e72-e292-41fd-a931-160659b460ba tempest-ServicesAdminNegativeV253TestJSON-738810319 tempest-ServicesAdminNegativeV253TestJSON-738810319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:54.224859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-674a7e72-e292-41fd-a931-160659b460ba tempest-ServicesAdminNegativeV253TestJSON-738810319 tempest-ServicesAdminNegativeV253TestJSON-738810319-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.149121 Oct 19 00:52:54.225422 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1014/1964] 10.222.0.27 () {60 vars in 1178 bytes} [Wed Oct 19 00:52:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:54.258952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:54.260031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:54.269075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.269928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.270656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.271571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.272226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.272894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.355534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:54.370599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7156870-819f-4fc7-9411-32e3b1801f22 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 200 len: 1319 microversion: 2.1 time: 0.833067 Oct 19 00:52:54.381925 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 951/1965] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:53 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:54.439885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:54.441000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:54.449725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.450983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.457699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.459209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:54.459868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:54.460483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:54.841755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:54.856289 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bd98e41-9dc5-4a79-ac75-8d658566c63e tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1580 microversion: 2.1 time: 0.603120 Oct 19 00:52:54.856929 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1015/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:54 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1580 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:54.988068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:54.990449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:55.000719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.001420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.001865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.003341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.003907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.004607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.009679 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:55.062479 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60ac73e2-ad7b-41d8-af89-87529dc26470 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078370 Oct 19 00:52:55.070159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1016/1967] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:54 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 00:52:55.173623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:55.183832 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20c5ff2c-5b96-4697-b84b-b2c4d820abdc tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.748347 Oct 19 00:52:55.184426 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 952/1968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:54 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:55.398031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:55.399528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:55.419921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.424962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.426080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.426931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.427526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.427971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.632230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:55.648680 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a364312-077a-4baa-8fa4-05d56db8cacd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 200 len: 1469 microversion: 2.1 time: 0.256934 Oct 19 00:52:55.649303 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1017/1969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:55 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:55.677821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:55.702146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:55.706769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Searching by: {'reservation_id': 'r-o1uw79pd', 'deleted': False, 'project_id': '5685c970486040e2bc073d3bc1a5e577'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:52:55.716687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.717148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.717841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.718913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.719590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.720242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.882180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:55.883334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:55.888371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:52:55.905559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.906316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.907103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:55.908246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:55.909597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:55.910702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.063694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:56.083717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.084459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.085240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.435822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:56.446415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5998a2df-e7e7-4ddf-8a6a-ae7c92adf781 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1573 microversion: 2.1 time: 0.570540 Oct 19 00:52:56.451942 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1018/1970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:55 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1573 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:52:56.463869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:56.466695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:56.488836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.489341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.489788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.490516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.492523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.493075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.529360 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8838c53-3b4a-4bf6-972b-e1a58f88f708 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.076033 Oct 19 00:52:56.536234 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1019/1971] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:56 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:56.541815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:56.542774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:56.551114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.551805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.552416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.553409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.554043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.554642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.555160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5183fda6-cc10-424d-a4c7-1955d096d85d tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-o1uw79pd" status: 200 len: 2931 microversion: 2.1 time: 0.882710 Oct 19 00:52:56.555769 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 953/1972] 10.222.0.27 () {58 vars in 1197 bytes} [Wed Oct 19 00:52:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-o1uw79pd => generated 2931 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:56.571950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-161161415"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:56.575992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:56.601229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.601818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.602284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.603112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.603577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.604016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.769673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:56.783133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11ab4705-5871-4eea-8498-55697d3bc540 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.244849 Oct 19 00:52:56.790223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1020/1973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:56 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:56.803141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:56.895513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.compute.server_groups [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Querying cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) for 2 instances {{(pid=131449) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 00:52:56.901442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.902342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.902974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.960657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a361c796-be4b-4618-bca0-f36ee13b97f0 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/2f70bd14-fda0-4715-8a9a-a52577a20a4f" status: 200 len: 270 microversion: 2.1 time: 0.168351 Oct 19 00:52:56.962579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1021/1974] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:52:56 2022] GET /compute/v2.1/os-server-groups/2f70bd14-fda0-4715-8a9a-a52577a20a4f => generated 270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:56.967749 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Adding security group 1a33bf01-db59-4461-87f2-e2b00270fed0 to port e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 Oct 19 00:52:56.978507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:56.980100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:56.997170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.997675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:56.998183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:56.998967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:56.999429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:57.000754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:57.303496 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39677fd1-55ac-4149-a980-3ce66deca999 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 200 len: 1620 microversion: 2.1 time: 0.330034 Oct 19 00:52:57.304122 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1022/1975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:56 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 1620 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:57.330296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:57.332978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:57.344506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:57.345425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:57.347489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:57.348898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:57.349674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:57.350282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:57.862023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-53240337-e4d9-4056-a5fb-031c5c3113dc tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1620 microversion: 2.1 time: 0.535096 Oct 19 00:52:57.868887 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1023/1976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:57 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1620 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:57.872561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:57.877916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:57.900514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:57.901782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:57.902494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:57.915840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:57.919498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:57.920739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:57.943104 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3c5520c-b843-4e34-b9ec-9c3dc3b59033 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action" status: 202 len: 0 microversion: 2.1 time: 1.386216 Oct 19 00:52:57.949045 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 954/1977] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:52:56 2022] POST /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf/action => generated 0 bytes in 1393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:52:58.010143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe31c029-4c00-4918-b169-6a0963cf73f6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.139942 Oct 19 00:52:58.013833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1024/1978] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:57 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:58.022081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:58.025352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:58.042062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:58.062992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:58.063659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:58.064428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:58.064921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:58.065411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:58.386768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:58.396884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-527b6a00-82bf-44e2-b239-7ac6f31835db tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.381449 Oct 19 00:52:58.398096 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1025/1979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:58 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:58.404036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19788717-483a-45ae-9bb8-28331035b6cf", "tag": "e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:58.416180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:58.417031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:58.417646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:58.438802 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] Creating event network-changed:e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 for instance 19788717-483a-45ae-9bb8-28331035b6cf on n-h2-master-1 Oct 19 00:52:58.444707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6ea2a2aa-e53e-4c3f-a450-5e0055653bde req-a6ef5131-9278-418c-ba1a-2a60f29334fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045086 Oct 19 00:52:58.446126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1026/1980] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:52:58.452702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af94103a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:58.646832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1407453005", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:58.702728 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use.", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:52:58.703668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.703668 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0 HTTP/1.1 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: exception: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1a33bf01-db59-4461-87f2-e2b00270fed0'} Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:52:58.706889 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 400 to user: Security Group 1a33bf01-db59-4461-87f2-e2b00270fed0 in use. Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-373594d8-9840-4e9d-aba3-160f9c3f307a'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:52:58.711529 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-872d7755-9de6-4368-afba-14861f92e03d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0" status: 400 len: 185 microversion: 2.1 time: 0.260713 Oct 19 00:52:58.721894 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1027/1981] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:52:58 2022] DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0 => generated 185 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:52:58.727511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-235468360", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "60adecb6-1821-4de4-b712-ac428eda4096"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:52:58.758404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:58.758944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:58.760095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:58.760591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:58.761407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:58.763187 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:58.786978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:58.787800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:58.788459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:58.789390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:58.790043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:58.790703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:58.802373 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:58.849141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:52:58.863496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Getting quotas for project 248e481eb8de408fbb0e819a5a1f136e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:58.882183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Getting quotas for user 60cdb88d047841efb92e55cd533edab9 and project 248e481eb8de408fbb0e819a5a1f136e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:58.916338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:52:58.918825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:58.931828 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:52:59.057186 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad56efd8-1298-457a-9d9c-1deb5e245289 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.105401 Oct 19 00:52:59.059843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 955/1982] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:52:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:52:59.078206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.080778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.098577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.099098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.099556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.100759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.101235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.101671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.173918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:52:59.257548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:52:59.258960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:52:59.259684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:52:59.260264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:52:59.260892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:52:59.273779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.274746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.275618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.276564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.277393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.278186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.309890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:52:59.324568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:52:59.343696 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1549cbcf-a40e-41ce-b097-1e2522d46ee9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 204 len: 0 microversion: 2.1 time: 0.282236 Oct 19 00:52:59.344612 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 956/1983] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:52:59 2022] DELETE /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:52:59.354502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:52:59.355872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.359048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.361208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:52:59.367145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.367721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.368252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.369555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.370601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.371702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.411084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aeb27f2b-6de2-41ab-85a7-683f196d1aeb tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.060374 Oct 19 00:52:59.411934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 957/1984] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:52:59 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:52:59.421432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.422903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.457270 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e65cdb1-714b-4210-9ed5-5dcd48009c4a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740666 Oct 19 00:52:59.461402 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1028/1985] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:52:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:52:59.482358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.483005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.500754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.501249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.501678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.502393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.502847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.504122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.542531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:59.550679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:59.552180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:59.553382 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1462ad78-779f-4e29-b21a-ceb8c15b4f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1278 microversion: 2.57 time: 0.135947 Oct 19 00:52:59.553955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 958/1986] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:52:59 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:52:59.558502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.559119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.585297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.585999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.586646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.592763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:52:59.593251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:52:59.593771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:52:59.914052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:59.916787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:52:59.928736 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f41af9dc-0d17-4c3c-895f-0706d88f4b59 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.373064 Oct 19 00:52:59.930860 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 959/1987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:59 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:52:59.941198 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a48ffc0-9a0d-4677-b43b-69b0c07d5c28 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1647 microversion: 2.1 time: 0.459786 Oct 19 00:52:59.953799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b9d5cb8-c2fa-4000-9993-1934d67e231c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:52:59.953799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b9d5cb8-c2fa-4000-9993-1934d67e231c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:52:59.957074 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1029/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:59 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1647 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:00.040535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b9d5cb8-c2fa-4000-9993-1934d67e231c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:00.052360 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b9d5cb8-c2fa-4000-9993-1934d67e231c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1216 microversion: 2.1 time: 0.119872 Oct 19 00:53:00.053163 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 960/1989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:52:59 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:00.276415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e18f2408-690f-4f0b-ade7-bc679134c110 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Calling method '.version_select at 0x7f2af4f6fdc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.302050 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e18f2408-690f-4f0b-ade7-bc679134c110 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e18f2408-690f-4f0b-ade7-bc679134c110 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/ff48364a-9656-4cda-8c3b-dba423b16556/metadata/os_distro HTTP/1.1 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: action_args: {'image_id': 'ff48364a-9656-4cda-8c3b-dba423b16556', 'id': 'os_distro'} Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ff48364a-9656-4cda-8c3b-dba423b16556 Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.311733 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ff48364a-9656-4cda-8c3b-dba423b16556 could not be found. Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e18f2408-690f-4f0b-ade7-bc679134c110 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e18f2408-690f-4f0b-ade7-bc679134c110 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "DELETE /compute/v2.1/images/ff48364a-9656-4cda-8c3b-dba423b16556/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.346977 Oct 19 00:53:00.316689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1030/1990] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 00:52:59 2022] DELETE /compute/v2.1/images/ff48364a-9656-4cda-8c3b-dba423b16556/metadata/os_distro => generated 62 bytes in 349 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:00.325034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-474de780-2ad8-4b4e-ba73-7d4fbcffe535 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Calling method '.version_select at 0x7f2af49dbdc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.350316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-474de780-2ad8-4b4e-ba73-7d4fbcffe535 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-474de780-2ad8-4b4e-ba73-7d4fbcffe535 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/images/0b402e12-70ab-477e-95e8-d43edf5b3792/metadata/os_version HTTP/1.1 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: action_args: {'image_id': '0b402e12-70ab-477e-95e8-d43edf5b3792', 'id': 'os_version'} Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0b402e12-70ab-477e-95e8-d43edf5b3792 Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.353172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0b402e12-70ab-477e-95e8-d43edf5b3792 could not be found. Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.359036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-474de780-2ad8-4b4e-ba73-7d4fbcffe535 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.365358 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-474de780-2ad8-4b4e-ba73-7d4fbcffe535 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "GET /compute/v2.1/images/0b402e12-70ab-477e-95e8-d43edf5b3792/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.039863 Oct 19 00:53:00.366184 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 961/1991] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/images/0b402e12-70ab-477e-95e8-d43edf5b3792/metadata/os_version => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:00.371769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69194bcf-e8bf-4353-b060-c2a3dc9bdedc tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Calling method '.version_select at 0x7f2af4e58e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.394725 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-69194bcf-e8bf-4353-b060-c2a3dc9bdedc tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69194bcf-e8bf-4353-b060-c2a3dc9bdedc tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/images/e235f2ac-a30e-4a9f-a7f8-4190a3212597/metadata HTTP/1.1 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: action_args: {'image_id': 'e235f2ac-a30e-4a9f-a7f8-4190a3212597'} Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e235f2ac-a30e-4a9f-a7f8-4190a3212597 Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.396383 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e235f2ac-a30e-4a9f-a7f8-4190a3212597 could not be found. Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69194bcf-e8bf-4353-b060-c2a3dc9bdedc tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69194bcf-e8bf-4353-b060-c2a3dc9bdedc tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "GET /compute/v2.1/images/e235f2ac-a30e-4a9f-a7f8-4190a3212597/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031007 Oct 19 00:53:00.402196 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1031/1992] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/images/e235f2ac-a30e-4a9f-a7f8-4190a3212597/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:00.412348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af6ff9cb-e19a-447b-9789-2ed6fbd6ded9 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Action: 'update_all', calling method: .version_select at 0x7f2af4a27430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:00.426590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.429721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:00.436273 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-af6ff9cb-e19a-447b-9789-2ed6fbd6ded9 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.436820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.437315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.437755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:00.438691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af6ff9cb-e19a-447b-9789-2ed6fbd6ded9 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/images/835b2254-df54-4365-803f-3a9ab63d815c/metadata HTTP/1.1 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 57 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: action_args: {'image_id': '835b2254-df54-4365-803f-3a9ab63d815c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 835b2254-df54-4365-803f-3a9ab63d815c Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.438821 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 835b2254-df54-4365-803f-3a9ab63d815c could not be found. Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.445525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.449547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.449661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af6ff9cb-e19a-447b-9789-2ed6fbd6ded9 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.449774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:00.449880 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af6ff9cb-e19a-447b-9789-2ed6fbd6ded9 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "PUT /compute/v2.1/images/835b2254-df54-4365-803f-3a9ab63d815c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032260 Oct 19 00:53:00.449880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 962/1993] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:53:00 2022] PUT /compute/v2.1/images/835b2254-df54-4365-803f-3a9ab63d815c/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:53:00.451395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0aac0188-4da0-4e5a-bf8f-089daed7f759 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Action: 'update', calling method: .version_select at 0x7f2af4b0da60>, body: {"meta": {"os_distro": "alt"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:00.475460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0aac0188-4da0-4e5a-bf8f-089daed7f759 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.477818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e92a00cd-12fc-4886-969c-346ae0d1b43d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.058119 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0aac0188-4da0-4e5a-bf8f-089daed7f759 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/images/008e173a-f250-40e7-8445-dad7a51007c0/metadata/os_distro HTTP/1.1 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 30 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: {"meta": {"os_distro": "alt"}} Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: action_args: {'image_id': '008e173a-f250-40e7-8445-dad7a51007c0', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 008e173a-f250-40e7-8445-dad7a51007c0 Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.478575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 008e173a-f250-40e7-8445-dad7a51007c0 could not be found. Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0aac0188-4da0-4e5a-bf8f-089daed7f759 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0aac0188-4da0-4e5a-bf8f-089daed7f759 tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "PUT /compute/v2.1/images/008e173a-f250-40e7-8445-dad7a51007c0/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.033622 Oct 19 00:53:00.484471 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 963/1994] 10.222.0.27 () {60 vars in 1310 bytes} [Wed Oct 19 00:53:00 2022] PUT /compute/v2.1/images/008e173a-f250-40e7-8445-dad7a51007c0/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:53:00.492226 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1032/1995] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:00.493024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49e134ae-f15b-459e-9b15-36ada0920ace tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Action: 'create', calling method: .version_select at 0x7f2af4b0d1f0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:00.519706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-49e134ae-f15b-459e-9b15-36ada0920ace tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] HTTP exception thrown: Image not found. Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49e134ae-f15b-459e-9b15-36ada0920ace tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Request method failure captured: Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/images/d4d59fc2-a5ae-42ed-af08-7b8b0c1521bc/metadata HTTP/1.1 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 57 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0przfNolmMbtNP91K2yP89d748xhsuuEd8BOt0LPLHWCPDUnhMxe8S6EtqBLbwLzqC0wc3U1itfKIV7s4gHkKd26p6V2KAeF9go665z87rvX4Nhq0bpQuyeq2KhaxWbFAaxlZC4ae_BHSCkHSpF_xwKGvUr2WlfjjyzOYbPpdx1CpQ Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a7bc6ded408446ea09e56df3117e8ed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a7bc6ded408446ea09e56df3117e8ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a7bc6ded408446ea09e56df3117e8ed"}]}] Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5a7bc6ded408446ea09e56df3117e8ed Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 89ad3153612d421f8e8f28705e44f334 Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1330165560-project Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: action_args: {'image_id': 'd4d59fc2-a5ae-42ed-af08-7b8b0c1521bc', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d4d59fc2-a5ae-42ed-af08-7b8b0c1521bc Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 00:53:00.522658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4d59fc2-a5ae-42ed-af08-7b8b0c1521bc could not be found. Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49e134ae-f15b-459e-9b15-36ada0920ace tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49e134ae-f15b-459e-9b15-36ada0920ace tempest-ImagesMetadataNegativeTestJSON-1330165560 tempest-ImagesMetadataNegativeTestJSON-1330165560-project] 10.222.0.27 "POST /compute/v2.1/images/d4d59fc2-a5ae-42ed-af08-7b8b0c1521bc/metadata" status: 404 len: 62 microversion: 2.1 time: 0.037581 Oct 19 00:53:00.529098 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 964/1996] 10.222.0.27 () {60 vars in 1281 bytes} [Wed Oct 19 00:53:00 2022] POST /compute/v2.1/images/d4d59fc2-a5ae-42ed-af08-7b8b0c1521bc/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:00.586870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.587804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:00.594559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.595039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.595477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:00.596188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.597376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.597850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:00.748348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:00.762943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:00.766629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:00.767836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc6fc928-b053-4a76-8a80-8273fd69456e tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1330 microversion: 2.57 time: 0.184921 Oct 19 00:53:00.780784 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1033/1997] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1330 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:00.972536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.973218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:00.976610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:00.977486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:00.988179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.988709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.989244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:00.989878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:00.990396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:00.990871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.012659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.013184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.013640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.020300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.020823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.021369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.482111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:01.491994 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2d88b35-b560-47ec-96f1-ed9d22b45ef5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1513 microversion: 2.1 time: 0.542193 Oct 19 00:53:01.496027 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 965/1998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1513 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:01.518055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:01.520061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:01.541918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.542600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.543063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.543794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.544258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.544718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.643693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:01.654050 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bac591d-66a7-48ed-8828-a0b4584e7106 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1647 microversion: 2.1 time: 0.686512 Oct 19 00:53:01.656701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1034/1999] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:00 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1647 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:01.736724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:01.748321 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c3c4a18-413f-4174-ade4-4742428f1709 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1212 microversion: 2.1 time: 0.241297 Oct 19 00:53:01.753192 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 966/2000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:01 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1212 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:01.801712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:01.802499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:01.815101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.817217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.818472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.820909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:01.823082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:01.823806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:01.991805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:02.001956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:02.003913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:02.007405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b29e99f-968a-4077-8d61-9bf601e57759 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1336 microversion: 2.57 time: 0.209429 Oct 19 00:53:02.017433 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1035/2001] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:01 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1336 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:02.527704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:02.528452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:02.544521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:02.545998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:02.547338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:02.549031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:02.551125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:02.551822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:02.680533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:02.681189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:02.700174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:02.700719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:02.707265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:02.708666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:02.712766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:02.713646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.062922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.084055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-756589e8-9af0-4675-addb-b6a253a88e24 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.560179 Oct 19 00:53:03.085758 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 967/2002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:02 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:03.094628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:03.097361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:03.115752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.119835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.122646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.123932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.124813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.125822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.308375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.335120 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c19f22a6-82b2-4650-ba7b-0d0de0764beb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1268 microversion: 2.1 time: 0.247617 Oct 19 00:53:03.354456 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 968/2003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:03 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1268 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:03.373161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:03.382094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:03.388321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.398218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.399340 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e38431ce-b393-492b-a973-c5fc4c805918 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1647 microversion: 2.1 time: 0.722732 Oct 19 00:53:03.401384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.402567 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1036/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:02 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1647 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:03.402727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.403494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.403971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.406975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.446555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19788717-483a-45ae-9bb8-28331035b6cf", "name": "network-vif-deleted", "tag": "e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:03.461777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.462562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.463479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.477929 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] Creating event network-vif-deleted:e9c912a7-7e8f-4dd9-9aa3-06e42dadf3f0 for instance 19788717-483a-45ae-9bb8-28331035b6cf on n-h2-master-1 Oct 19 00:53:03.485099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8dd288d4-91b1-437a-975a-8f30b8b7a6d2 req-7fb627f1-a8c6-4ed0-bae2-682d3d9ae0f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044584 Oct 19 00:53:03.490435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1037/2005] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:53:03.498494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5511555-cae6-428e-b1ec-7c90f3b098c4"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:03.501031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:03.516847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.517358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.517802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.518584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:03.520691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:03.521424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:03.525377 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:03.755242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.782804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.786524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:03.788431 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0bac411-bc19-4a2d-86db-3d1d8b0f87fc tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1336 microversion: 2.57 time: 0.432619 Oct 19 00:53:03.801273 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 969/2006] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:03 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1336 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:04.230076 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd5aee53-6944-4ae8-ade1-fbcec452b33d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "POST /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736581 Oct 19 00:53:04.244571 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1038/2007] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 00:53:03 2022] POST /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:04.255035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.263587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:04.280088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.283268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.284920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.287108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.289476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.291237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.427036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38e61c2d-4a66-43ef-8cd5-e680e77d11db tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.319471 Oct 19 00:53:04.432531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 970/2008] 10.222.0.27 () {58 vars in 1128 bytes} [Wed Oct 19 00:53:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 19 00:53:04.439650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.445437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:04.459387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.461871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.462826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.467088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.468077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.468779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.674335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:04.684993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbadaf5e-f34b-4ccf-b4fd-a0c610beaded tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1274 microversion: 2.1 time: 0.251022 Oct 19 00:53:04.688159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 971/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:04 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:04.718885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.721822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:04.729283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:04.737995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-793c73ee-54d4-41fe-98ee-39869a5d8c4e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.488699 Oct 19 00:53:04.740022 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1039/2010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:04 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:04.744042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.745806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9648b16-e456-4309-86d3-33b70254b83a tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Calling method '.version_select at 0x7f2af4e58e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.746413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.747388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.753397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.761122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.773663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.786113 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b9648b16-e456-4309-86d3-33b70254b83a tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] HTTP exception thrown: Image not found. Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9648b16-e456-4309-86d3-33b70254b83a tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Request method failure captured: Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0pvLfakirHndcnbTwNVPYtwmzZxTQqYWlrO1VXR-gm4Ud6UvmsH43s9pW5Idp2lLOIAg-4-NVynoB6JmIbo_ekO_BA89H2Pt7sxWJ8_G-xnZJvvSw4uNz6n96s_czyb2BoZ15zjR8lUix1rXajuVXVO6FASJMCqcId1tJtIWb3ChMY Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc404ab2e6a942a982cde4b6783df1aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}] Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d8cb12f6f274e71bfb97b73afe2ee89 Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '-1'} Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.788233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:04.796806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.800313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9648b16-e456-4309-86d3-33b70254b83a tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:04.800843 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9648b16-e456-4309-86d3-33b70254b83a tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.059260 Oct 19 00:53:04.802230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1040/2011] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 00:53:04 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:04.809835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3236026c-f0e1-43f4-a2d6-063ce663801d", "name": "network-vif-unplugged", "status": "completed", "tag": "19b61baf-1329-4bdd-a3e8-84eb43ba7c9d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:04.840604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.842023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.842955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.858325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:04.860900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:04.861467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:04.862834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lazy-loading 'fault' on Instance uuid 19788717-483a-45ae-9bb8-28331035b6cf {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:53:04.873048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] Creating event network-vif-unplugged:19b61baf-1329-4bdd-a3e8-84eb43ba7c9d for instance 3236026c-f0e1-43f4-a2d6-063ce663801d on n-h2-master-1 Oct 19 00:53:04.886049 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-219a9af5-b14a-4145-877e-861058cff720 req-11bdae6f-0543-428b-80fd-506f82a9e81e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081012 Oct 19 00:53:04.889113 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1041/2012] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:04.921873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07621125-31cd-4cf8-b0ea-86b11f64c3eb tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Calling method '.version_select at 0x7f2af546e940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.975872 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-07621125-31cd-4cf8-b0ea-86b11f64c3eb tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] HTTP exception thrown: Image not found. Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07621125-31cd-4cf8-b0ea-86b11f64c3eb tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Request method failure captured: Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/698bf328-c803-47ac-b2d0-74697b8b720j HTTP/1.1 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0pvLfakirHndcnbTwNVPYtwmzZxTQqYWlrO1VXR-gm4Ud6UvmsH43s9pW5Idp2lLOIAg-4-NVynoB6JmIbo_ekO_BA89H2Pt7sxWJ8_G-xnZJvvSw4uNz6n96s_czyb2BoZ15zjR8lUix1rXajuVXVO6FASJMCqcId1tJtIWb3ChMY Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc404ab2e6a942a982cde4b6783df1aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}] Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d8cb12f6f274e71bfb97b73afe2ee89 Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '698bf328-c803-47ac-b2d0-74697b8b720j'} Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 698bf328-c803-47ac-b2d0-74697b8b720j to delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 698bf328-c803-47ac-b2d0-74697b8b720j could not be found. Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.977963 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07621125-31cd-4cf8-b0ea-86b11f64c3eb tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:04.983650 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07621125-31cd-4cf8-b0ea-86b11f64c3eb tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/698bf328-c803-47ac-b2d0-74697b8b720j" status: 404 len: 62 microversion: 2.1 time: 0.090440 Oct 19 00:53:04.988125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1042/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:04 2022] DELETE /compute/v2.1/images/698bf328-c803-47ac-b2d0-74697b8b720j => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:04.998481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:04.999303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:05.029492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.029988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.031325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.035148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.038473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.040523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.110386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:05.121645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85feb798-4206-4365-a117-e3361f50c9f6 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 200 len: 1306 microversion: 2.1 time: 0.432202 Oct 19 00:53:05.124002 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 972/2014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:04 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 1306 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:05.133644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf6e1d13-9efc-48b7-9660-10eae54b988b tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Calling method '.version_select at 0x7f2af4b52550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:05.159538 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-bf6e1d13-9efc-48b7-9660-10eae54b988b tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] HTTP exception thrown: Image not found. Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf6e1d13-9efc-48b7-9660-10eae54b988b tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Request method failure captured: Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/a7e722dd-b121-45a8-bde8-40a4fa82d6b61 HTTP/1.1 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0pvLfakirHndcnbTwNVPYtwmzZxTQqYWlrO1VXR-gm4Ud6UvmsH43s9pW5Idp2lLOIAg-4-NVynoB6JmIbo_ekO_BA89H2Pt7sxWJ8_G-xnZJvvSw4uNz6n96s_czyb2BoZ15zjR8lUix1rXajuVXVO6FASJMCqcId1tJtIWb3ChMY Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc404ab2e6a942a982cde4b6783df1aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}] Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2d8cb12f6f274e71bfb97b73afe2ee89 Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'a7e722dd-b121-45a8-bde8-40a4fa82d6b61'} Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a7e722dd-b121-45a8-bde8-40a4fa82d6b61 to delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a7e722dd-b121-45a8-bde8-40a4fa82d6b61 could not be found. Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.161705 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:05.167505 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.171409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf6e1d13-9efc-48b7-9660-10eae54b988b tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:05.173229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf6e1d13-9efc-48b7-9660-10eae54b988b tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/a7e722dd-b121-45a8-bde8-40a4fa82d6b61" status: 404 len: 62 microversion: 2.1 time: 0.047358 Oct 19 00:53:05.175619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 973/2015] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:53:05 2022] DELETE /compute/v2.1/images/a7e722dd-b121-45a8-bde8-40a4fa82d6b61 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:05.186387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08113023-d298-4342-8532-dfa771c9d143 tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Calling method '.version_select at 0x7f2af4a278b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:05.196399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:05.213216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:05.219506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:05.221104 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b398c5b-6eaf-4122-ae96-3753f9866303 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1357 microversion: 2.57 time: 0.235594 Oct 19 00:53:05.234844 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1043/2016] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:04 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:05.247260 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-08113023-d298-4342-8532-dfa771c9d143 tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] HTTP exception thrown: Image not found. Oct 19 00:53:05.253413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08113023-d298-4342-8532-dfa771c9d143 tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Request method failure captured: Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/tempest-invalid-844828292 HTTP/1.1 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0pvLfakirHndcnbTwNVPYtwmzZxTQqYWlrO1VXR-gm4Ud6UvmsH43s9pW5Idp2lLOIAg-4-NVynoB6JmIbo_ekO_BA89H2Pt7sxWJ8_G-xnZJvvSw4uNz6n96s_czyb2BoZ15zjR8lUix1rXajuVXVO6FASJMCqcId1tJtIWb3ChMY Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc404ab2e6a942a982cde4b6783df1aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}] Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2d8cb12f6f274e71bfb97b73afe2ee89 Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'tempest-invalid-844828292'} Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-844828292 to delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-844828292 could not be found. Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.254492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:05.259895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.262919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:05.266047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08113023-d298-4342-8532-dfa771c9d143 tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:05.266047 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08113023-d298-4342-8532-dfa771c9d143 tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-844828292" status: 404 len: 62 microversion: 2.1 time: 0.084677 Oct 19 00:53:05.266617 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 974/2017] 10.222.0.27 () {58 vars in 1203 bytes} [Wed Oct 19 00:53:05 2022] DELETE /compute/v2.1/images/tempest-invalid-844828292 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:53:05.271722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.272220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.272678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.273403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.273859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.274285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.278135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85421810-d30b-47ca-b1d8-fc921402a2ff tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Calling method '.version_select at 0x7f2af93839d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:05.326388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-85421810-d30b-47ca-b1d8-fc921402a2ff tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] HTTP exception thrown: Image not found. Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85421810-d30b-47ca-b1d8-fc921402a2ff tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Request method failure captured: Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48 HTTP/1.1 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0pvLfakirHndcnbTwNVPYtwmzZxTQqYWlrO1VXR-gm4Ud6UvmsH43s9pW5Idp2lLOIAg-4-NVynoB6JmIbo_ekO_BA89H2Pt7sxWJ8_G-xnZJvvSw4uNz6n96s_czyb2BoZ15zjR8lUix1rXajuVXVO6FASJMCqcId1tJtIWb3ChMY Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fc404ab2e6a942a982cde4b6783df1aa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fc404ab2e6a942a982cde4b6783df1aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fc404ab2e6a942a982cde4b6783df1aa"}]}] Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: fc404ab2e6a942a982cde4b6783df1aa Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2d8cb12f6f274e71bfb97b73afe2ee89 Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1463084379-project Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48'} Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48 to delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48 could not be found. Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.328899 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 00:53:05.334119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:05.337954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85421810-d30b-47ca-b1d8-fc921402a2ff tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:05.339255 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85421810-d30b-47ca-b1d8-fc921402a2ff tempest-ImagesDeleteNegativeTestJSON-1463084379 tempest-ImagesDeleteNegativeTestJSON-1463084379-project] 10.222.0.27 "DELETE /compute/v2.1/images/3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48" status: 404 len: 62 microversion: 2.1 time: 0.067373 Oct 19 00:53:05.342460 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 975/2018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:05 2022] DELETE /compute/v2.1/images/3cb8c0b7-87b9-4278-a4c8-f9a920e1ba48 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:05.453939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:05.454802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:05.456972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:05.457715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:05.458629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:05.657835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:05.671537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.672430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.675126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.678051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.680181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.682901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.716752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:05.717905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:05.741625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.742486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.743206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.745843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.746655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.748676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.784808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bea81577-62b5-49ae-9786-e228be389a3a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "POST /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a/action" status: 202 len: 1138 microversion: 2.57 time: 0.536421 Oct 19 00:53:05.792412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1044/2019] 10.222.0.27 () {62 vars in 1320 bytes} [Wed Oct 19 00:53:05 2022] POST /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a/action => generated 1138 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 00:53:05.802218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:05.806763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:05.819774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.822445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.828104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:05.829193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:05.830083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:05.831283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:06.544375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:06.554448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c395c71a-5529-4fc9-938c-45f6773bdf7c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.760654 Oct 19 00:53:06.560415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1045/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:05 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:06.576565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:06.585975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:06.605844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:06.609030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:06.610277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:06.614582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:06.618236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:06.619420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:06.673468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:06.700498 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa0f6a34-daec-46a3-a8ec-4c84206fcdcf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.986240 Oct 19 00:53:06.703698 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 976/2021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:05 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:06.747172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:06.751984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:06.771700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:06.774135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:06.774792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:06.776425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:06.778052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:06.779312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:06.849312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf HTTP/1.1 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '19788717-483a-45ae-9bb8-28331035b6cf'} Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:06.857690 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39441c21-06a9-4247-9dd5-7bf7d4875137 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 404 len: 111 microversion: 2.1 time: 0.136514 Oct 19 00:53:06.862462 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 977/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:06 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:06.876330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07b34310-bb17-4be6-9e70-1f2740e38174 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b9f430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:07.060191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:07.073705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:07.079768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:07.083043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddf51cd5-55cd-491c-8b74-098e2dc68ac1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.519872 Oct 19 00:53:07.102155 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1046/2023] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:06 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:07.579840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:07.583721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:07.599897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:07.600870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:07.601579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:07.602575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:07.603291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:07.604931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:08.261056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:08.269476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c4cdff67-d780-414b-8a34-6a0eab60c8da tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.694585 Oct 19 00:53:08.270086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1047/2024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:07 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:08.294559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:08.305842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:08.341182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:08.341711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:08.346703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:08.347555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:08.348040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:08.348484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:08.606275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07b34310-bb17-4be6-9e70-1f2740e38174 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d" status: 202 len: 0 microversion: 2.1 time: 1.739625 Oct 19 00:53:08.610295 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 978/2025] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:06 2022] DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d => generated 0 bytes in 1744 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:53:08.619461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:08.620467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:08.650007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:08.652438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:08.652918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:08.660013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:08.660992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:08.663654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:08.803265 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:09.007058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:09.022545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:09.025171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:09.026667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a744b9b3-4a15-437c-97ab-ee704459b4f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.415149 Oct 19 00:53:09.044161 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 979/2026] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:08 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:09.053199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d89c4f3f-787a-4064-ba60-85e450493b56 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af497f3a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:09.112041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:09.128819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65fff0ea-bc58-4aee-9d0a-087220691a41 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.838307 Oct 19 00:53:09.129567 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1048/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:08 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:09.296419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:09.297225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:09.306042 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=18 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:09.308519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:09.310199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:09.310760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:09.311583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:09.315672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:09.318626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:09.388997 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:09.808952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:09.818528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4850e3b2-78dc-451a-a8cf-fdb4c97cec75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.525926 Oct 19 00:53:09.824083 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1049/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:09 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:09.829247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5dd89cf-86bb-4858-a716-8f137d496f48", "tag": "3d9b7c1f-825f-4f42-8c6a-7f1218888a18"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:09.855644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:09.856145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:09.856595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:09.884961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] Creating event network-changed:3d9b7c1f-825f-4f42-8c6a-7f1218888a18 for instance c5dd89cf-86bb-4858-a716-8f137d496f48 on n-h2-master-1 Oct 19 00:53:09.898355 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ef85a9f1-1e95-4ae4-9aeb-dd457934fc4b req-a56e6597-c6bb-41c9-8c9b-1d09aabaebcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072505 Oct 19 00:53:09.900880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1050/2029] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:10.045725 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:10.067771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:10.070829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:10.107335 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d89c4f3f-787a-4064-ba60-85e450493b56 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0" status: 202 len: 0 microversion: 2.1 time: 1.061529 Oct 19 00:53:10.109199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 980/2030] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:09 2022] DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0 => generated 0 bytes in 1064 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:53:10.117043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:10.117043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:10.117043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:10.117784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:10.117784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:10.118029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:10.126345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9326b6c-fe76-4495-b444-d04969d6f288 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'create', calling method: .version_select at 0x7f2af4986ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1939061689", "description": "tempest-description-1143212149"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:10.385698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:10.401062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:10.405146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:10.411014 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1eba4db6-73e6-495f-bf8f-1db9c1066559 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.356319 Oct 19 00:53:10.436917 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1051/2031] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:10 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:10.445084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:10.446718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:10.468951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:10.470532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:10.472590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:10.473646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:10.474383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:10.475059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.040130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:11.060812 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3033b150-8afc-4e35-bc78-144850e65156 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.614852 Oct 19 00:53:11.062016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1052/2032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:10 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:11.067550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3236026c-f0e1-43f4-a2d6-063ce663801d", "name": "network-vif-plugged", "status": "completed", "tag": "19b61baf-1329-4bdd-a3e8-84eb43ba7c9d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:11.117623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:11.125045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:11.126075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.155361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] Creating event network-vif-plugged:19b61baf-1329-4bdd-a3e8-84eb43ba7c9d for instance 3236026c-f0e1-43f4-a2d6-063ce663801d on n-h2-master-1 Oct 19 00:53:11.170221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d0b4ca01-3243-4804-b823-09132578dd62 req-fb3b1e11-3d16-4ad3-aaa9-91c966750b17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106294 Oct 19 00:53:11.171241 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1053/2033] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:11.178293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:11.187132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:11.202885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:11.204041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:11.205094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.209686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:11.210772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:11.211452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.464980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9326b6c-fe76-4495-b444-d04969d6f288 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.343851 Oct 19 00:53:11.465632 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 981/2034] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:53:10 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:11.470655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:11.472014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:11.508772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:11.509726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:11.510426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.511427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:11.512136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:11.512852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:11.697897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:11.717780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:11.725429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:11.727813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17c73a28-471d-4b9a-80a1-6e44e2f305be tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.260951 Oct 19 00:53:11.730578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 982/2035] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:11 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:11.741497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-042a4393-9579-496e-964a-4441be152808 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Action: 'update', calling method: .version_select at 0x7f2af49b0310>, body: {"security_group": {"name": "tempest-sg-hth-1347550243", "description": "tempest-description-hth-735368572"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:11.794894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:11.804398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b43731e3-d93e-4f88-9d54-536f74beb4bb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.631687 Oct 19 00:53:11.813923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1054/2036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:11 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:12.103464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-042a4393-9579-496e-964a-4441be152808 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f" status: 200 len: 217 microversion: 2.1 time: 0.369197 Oct 19 00:53:12.104358 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 983/2037] 10.222.0.27 () {60 vars in 1290 bytes} [Wed Oct 19 00:53:11 2022] PUT /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f => generated 217 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:12.115429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:12.116432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:12.117087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d2de0c0-8f6e-42ef-b1d3-4bae13471e3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af497f790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:12.127323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:12.128888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:12.131561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:12.136901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:12.137945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:12.138656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:12.200025 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:12.386112 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d2de0c0-8f6e-42ef-b1d3-4bae13471e3d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f" status: 200 len: 217 microversion: 2.1 time: 0.272679 Oct 19 00:53:12.386697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 984/2038] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:53:12 2022] GET /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f => generated 217 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:53:12.401632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce8a33ec-a4c9-4f71-bfda-4ea3ff4f5cb9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4b52550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:12.470060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:12.480114 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69247070-37f8-4690-a249-742bacd0b363 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.377006 Oct 19 00:53:12.489323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1055/2039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:12 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:12.921584 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce8a33ec-a4c9-4f71-bfda-4ea3ff4f5cb9 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f" status: 202 len: 0 microversion: 2.1 time: 0.524631 Oct 19 00:53:12.925665 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 985/2040] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:12 2022] DELETE /compute/v2.1/os-security-groups/0187b547-11d7-4052-b9d4-dd66aa59711f => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:53:12.932537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:12.934403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:12.969504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:12.970258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:12.971066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:12.972557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:12.973300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:12.973962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:12.994508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-178904379", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "66372eed-46b0-4054-b481-c7e7c627982e"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:13.092340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:13.098653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] validate_networks() for [('66372eed-46b0-4054-b481-c7e7c627982e', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:13.106378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:13.108546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:13.110519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9bece560-26b5-4f07-996f-4edf51798a71 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.182936 Oct 19 00:53:13.111609 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 986/2041] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:12 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:13.119325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:13.120293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:13.129188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.130040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.130995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:13.132192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.133133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.134129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:13.166984 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:13.523544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:13.538789 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2eb14b2-1ac6-4024-b8fc-a6bd51c4a5d8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1519 microversion: 2.1 time: 0.421142 Oct 19 00:53:13.540796 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 987/2042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:13 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1519 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:13.552207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:13.552741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:13.575450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.575996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.576456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:13.583456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.584105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.587635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:13.621327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf HTTP/1.1 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '19788717-483a-45ae-9bb8-28331035b6cf'} Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:13.623031 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4458e9b2-0d02-4578-9d4e-b810d7548816 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 404 len: 111 microversion: 2.1 time: 0.082210 Oct 19 00:53:13.629523 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 988/2043] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:53:13 2022] DELETE /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:13.630859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:13.630859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:13.651794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.652375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.653113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:13.655961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:13.656477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:13.656976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.117657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:14.118787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:14.120079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:14.120798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:14.121461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:14.134456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.136913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.137640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.138751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.139445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.140113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.172429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:14.182771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a321a409-af13-44d2-9de7-349610dbd1bc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.556623 Oct 19 00:53:14.183680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 989/2044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:13 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:14.188903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.189920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: 19788717-483a-45ae-9bb8-28331035b6cf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:14.197373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.199215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.199976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.200966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Getting quotas for project 39e5e345d67e457b9f51a84aa0914ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:14.201292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.201973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.202627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.228719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf HTTP/1.1 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '19788717-483a-45ae-9bb8-28331035b6cf'} Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.230897 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. Oct 19 00:53:14.235679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.236188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Getting quotas for user b85df86a633d469489cf2fdc7eaec5cf and project 39e5e345d67e457b9f51a84aa0914ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:14.239022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Instance 19788717-483a-45ae-9bb8-28331035b6cf could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.240305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5dcb5478-958e-4f12-ad89-91f2f87b85b7 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf" status: 404 len: 111 microversion: 2.1 time: 0.055228 Oct 19 00:53:14.244652 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 990/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:14 2022] GET /compute/v2.1/servers/19788717-483a-45ae-9bb8-28331035b6cf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:14.250612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.251607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:14.260286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.261382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.262054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.263072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.263757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.264450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.278282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:14.289703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:14.357090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:14.369352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:14.371166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:14.373399 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba196401-e75c-496c-897b-0ba0462a6f07 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.127282 Oct 19 00:53:14.390348 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 991/2046] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:14 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:14.396494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af49b0550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.421394 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:14.422273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group 1a33bf01-db59-4461-87f2-e2b00270fed0 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:14.422974 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.422974 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0 HTTP/1.1 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: exception: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1a33bf01-db59-4461-87f2-e2b00270fed0'} Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:14.425277 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] Oct 19 00:53:14.430482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.437541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group 1a33bf01-db59-4461-87f2-e2b00270fed0 does not exist Oct 19 00:53:14.437541 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-d5ec40b2-a79d-4de4-982b-a783cd524111'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.437541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1533f6d7-f82c-4ad6-954e-e08fcd086f0a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0" status: 404 len: 194 microversion: 2.1 time: 0.045248 Oct 19 00:53:14.437541 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 992/2047] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/1a33bf01-db59-4461-87f2-e2b00270fed0 => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:14.446144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af497f790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.472132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-571fa8a8-dfba-48f2-a370-aa94eff26a3f tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.718109 Oct 19 00:53:14.474682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1056/2048] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:53:14.475010 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:14.475727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group 30559406-1109-49d6-a5b7-a0bcc51d902d not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:14.476252 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.476252 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d HTTP/1.1 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: exception: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '30559406-1109-49d6-a5b7-a0bcc51d902d'} Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:14.479060 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group 30559406-1109-49d6-a5b7-a0bcc51d902d does not exist Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-b53c8356-dffc-4771-b920-22a2f1badd4c'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.484792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-599b27b3-ab4f-42aa-97de-09c63364848c tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d" status: 404 len: 194 microversion: 2.1 time: 0.038433 Oct 19 00:53:14.502188 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 993/2049] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/30559406-1109-49d6-a5b7-a0bcc51d902d => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:53:14.514616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4940940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.524673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-449930a4-a79f-42ea-b728-72a1cf2dac70 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.525883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-449930a4-a79f-42ea-b728-72a1cf2dac70 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:14.566231 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:14.566934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:14.567515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.567515 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564 HTTP/1.1 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: exception: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ad5a3ff3-4817-44a2-9a25-baaa772d9564'} Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:14.570905 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group ad5a3ff3-4817-44a2-9a25-baaa772d9564 does not exist Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-f8a8422a-4229-47ca-8bcd-fc6779a77be9'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-024b3f98-e9f9-475e-85f4-91b63e227150 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564" status: 404 len: 194 microversion: 2.1 time: 0.063298 Oct 19 00:53:14.578704 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 994/2050] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/ad5a3ff3-4817-44a2-9a25-baaa772d9564 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:14.587245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.590199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:14.616646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.616984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.620890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.621941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:14.622435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:14.622875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:14.684606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-449930a4-a79f-42ea-b728-72a1cf2dac70 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:14.701754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-449930a4-a79f-42ea-b728-72a1cf2dac70 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1224 microversion: 2.1 time: 0.197904 Oct 19 00:53:14.703072 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1057/2051] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:14 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:14.709058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4fcd790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.842128 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:14.842727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group 72aed06c-0748-4f7f-9860-54c8b770f729 not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:14.843271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.843271 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729 HTTP/1.1 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: exception: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '72aed06c-0748-4f7f-9860-54c8b770f729'} Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:14.847151 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group 72aed06c-0748-4f7f-9860-54c8b770f729 does not exist Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-fd877149-4aaa-484c-9fff-c29856c9253f'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64dda461-4f29-4b87-937c-9b375ad7005a tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729" status: 404 len: 194 microversion: 2.1 time: 0.144340 Oct 19 00:53:14.854375 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1058/2052] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/72aed06c-0748-4f7f-9860-54c8b770f729 => generated 194 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:14.875335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af9364ee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:14.958285 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:14.959193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:14.960218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.960218 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781 HTTP/1.1 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: exception: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f26f568b-334f-4ede-a1e4-d2e4b1a9e781'} Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:14.963725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group f26f568b-334f-4ede-a1e4-d2e4b1a9e781 does not exist Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-dd59dda3-c1fd-4165-b000-9b40419387ab'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d44b075f-bceb-4193-8c33-4aac862e7104 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781" status: 404 len: 194 microversion: 2.1 time: 0.112106 Oct 19 00:53:14.972610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1059/2053] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/f26f568b-334f-4ede-a1e4-d2e4b1a9e781 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:53:14.982068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4da6ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.030087 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:53:15.030736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Neutron security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 00:53:15.031745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.031745 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d HTTP/1.1 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: exception: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d'} Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:53:15.034623 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Security group b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d does not exist Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-6dcc977b-f9b3-42f1-8332-20d751cae100'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:15.041351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a6fb529-b7c9-4b72-8e67-42228b407be2 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d" status: 404 len: 194 microversion: 2.1 time: 0.064597 Oct 19 00:53:15.048742 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1060/2054] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:14 2022] DELETE /compute/v2.1/os-security-groups/b36ae8de-2d8b-4e8a-ab65-87b8b5bde49d => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:15.059788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.060166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.060709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.077058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.077958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.078697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.079746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.080422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.082274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.109822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-baa7b15a-ed71-46c1-b899-428d952180e5 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1504 microversion: 2.1 time: 0.529763 Oct 19 00:53:15.112104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 995/2055] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:14 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1504 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:15.152533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:53:15.156635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.158811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.177940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.180215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.180933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.182083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.182773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.183416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.411161 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c005a377-0876-4ca6-a38f-a12acc8f0293 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 204 len: 0 microversion: 2.1 time: 0.365333 Oct 19 00:53:15.413976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1061/2056] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:53:15 2022] DELETE /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:53:15.425301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.426028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.449976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.451252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.452511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.457876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.459359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.464519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.549837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.566229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-796253d2-6479-4541-8c93-02837e3040a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 200 len: 1504 microversion: 2.1 time: 0.434291 Oct 19 00:53:15.575252 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 996/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:15 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 1504 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:15.580246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.580928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.598713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.599496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.602933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.603875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.604504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.605113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.747491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.767290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.771674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.776560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd79fd75-a220-4a3b-a72a-ae7e31e931d6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.198539 Oct 19 00:53:15.777502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 997/2058] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:15 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:15.788995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.790862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.814627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.816043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.816671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.818918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.819588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.820842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.842840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:15.854296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16a8008c-ab65-457d-9067-4e1bb5227b81 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.438882 Oct 19 00:53:15.866145 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1062/2059] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:15 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:15.884090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:15.884859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:15.902253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.903010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.906850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.907980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:15.911439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:15.912110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:15.964550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:53:16.072545 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:16.104329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7af39738-94fb-4a98-bfca-05ad9f1b8b68 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 204 len: 0 microversion: 2.1 time: 0.234708 Oct 19 00:53:16.110503 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1063/2060] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:53:15 2022] DELETE /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:53:16.119358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:16.125826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:16.142872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:16.147355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:16.147998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:16.151673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:16.153267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:16.154654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:16.155363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:16.157037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f80d6f7-7c2f-4859-9df4-374b64b87e4f tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1646 microversion: 2.1 time: 0.377775 Oct 19 00:53:16.158252 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 998/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:15 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1646 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:16.305947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:16.316363 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c593129a-8646-4f97-9593-9bdf3c0e7daa tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1228 microversion: 2.1 time: 0.200121 Oct 19 00:53:16.317173 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1064/2062] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:16 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1228 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:16.328769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-325500520", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ee5219f5-db7a-44ce-ab2c-d09ce7de3cef"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:16.413758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] validate_networks() for [('ee5219f5-db7a-44ce-ab2c-d09ce7de3cef', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:16.697296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5dd89cf-86bb-4858-a716-8f137d496f48", "name": "network-vif-plugged", "status": "completed", "tag": "3d9b7c1f-825f-4f42-8c6a-7f1218888a18"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:16.735599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:16.736158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:16.742833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:16.791727 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] Creating event network-vif-plugged:3d9b7c1f-825f-4f42-8c6a-7f1218888a18 for instance c5dd89cf-86bb-4858-a716-8f137d496f48 on n-h2-master-1 Oct 19 00:53:16.797310 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-48a0e8b5-c199-4aa1-8da2-bd7bfa3ca1a7 req-cd030bac-9419-49b2-be58-ed33bfef2053 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104599 Oct 19 00:53:16.798760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1065/2063] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:16.811156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:16.812217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:16.825930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:16.826425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:16.826860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:16.833900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:16.834713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:16.835172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.068355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:17.096245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:17.102027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:17.103497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d98fdb2-2b04-4687-86da-3e541978ff5c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.302384 Oct 19 00:53:17.108243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1066/2064] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:16 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:17.118169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:17.119011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:17.132011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.133010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.133652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.135272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.136282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.137604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.194441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:17.195301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:17.196161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:17.197614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:17.198830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:17.222014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.222724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.224065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.226583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.227279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.228049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.278773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:17.293764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for user 2542aef0e4464018bf9d4563ffe9030d and project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:17.340080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:17.347013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:17.488004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82195a5a-389f-4e16-8d0b-797b156aca76 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164940 Oct 19 00:53:17.489074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 999/2065] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:53:17.493862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:17.497717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:17.546952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.547465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.551767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.552556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.553072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.553524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.852939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:17.890550 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3403203-54b4-46b2-8a06-0077ec8946a2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 0.780959 Oct 19 00:53:17.891318 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1067/2066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:17 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:17.904874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:17.914045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:17.930463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.943796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.944534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:17.945581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:17.946522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:17.949415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:18.303088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.320415 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7684f09-292f-4be6-a4b3-e50e3da7e294 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1646 microversion: 2.1 time: 0.830065 Oct 19 00:53:18.326790 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1000/2067] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:17 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1646 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:18.342141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8542fad7-f5fb-409f-a038-10eaa2e448c1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:18.345687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8542fad7-f5fb-409f-a038-10eaa2e448c1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:18.468047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.501061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-016ffc85-0aac-42d9-99bc-5aacf6290334 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1276 microversion: 2.1 time: 0.607304 Oct 19 00:53:18.502831 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1068/2068] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:17 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1276 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:18.508554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:18.509663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:18.518879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:18.519852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:18.520660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:18.521651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:18.522480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:18.523134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:18.778634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.795189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.802760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.808592 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-167cf98c-a32a-4b2d-99a3-e90ad28eb79f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.304301 Oct 19 00:53:18.811340 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1069/2069] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:18 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:18.838031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8542fad7-f5fb-409f-a038-10eaa2e448c1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:18.853912 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8542fad7-f5fb-409f-a038-10eaa2e448c1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1217 microversion: 2.1 time: 0.524548 Oct 19 00:53:18.859292 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1001/2070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:18 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1217 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:18.917791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:18.918956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:18.948786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:18.949411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:18.950292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:18.954659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:18.957097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:18.959585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:19.353195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:19.353941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:19.365782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:19.368990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:19.369563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:19.370431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:19.371126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:19.372938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.172968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.185308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbb3efbc-9b3d-4e08-bbdc-5cfbbe471d9a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1316 microversion: 2.1 time: 1.271404 Oct 19 00:53:20.186126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1070/2071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:18 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1316 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:20.192645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:20.193598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:20.201981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.202878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.203540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.204502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.206531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.350469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.365669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a93d4e8f-d9d5-4399-8bfd-1a1308bcb0c7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1282 microversion: 2.1 time: 0.175876 Oct 19 00:53:20.366254 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1071/2072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:20 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:20.375567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:20.376754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:20.407803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.410894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.413647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.415739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.418725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.421005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.710569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.727181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.729018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.735720 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-944713d8-94e0-421e-9bd6-b55ca85a651c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.363053 Oct 19 00:53:20.736394 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1072/2073] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:20 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:20.751399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:20.751399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:20.767711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.768288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.772759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.773712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:20.775878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:20.776985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:20.958617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f386bc9a48641a4bcd3b09ae45bea70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f69ef772c8bb45358f98bf5b8ff2e670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:20.986142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c597cf7-307d-4020-9a9e-1ad70e3a9023 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 200 len: 1646 microversion: 2.1 time: 1.637654 Oct 19 00:53:20.992735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1002/2074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:19 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 1646 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:21.019949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f670e59e-a8b4-4fed-9444-49c112a0b0b9", "name": "network-vif-deleted", "tag": "969015d5-8bf4-4c33-930e-1792c7eb204a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:21.086516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:21.090950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.094347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.095150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.122517 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e59413a2-94f0-48a7-b7c5-ba8b4047e64f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1275 microversion: 2.1 time: 0.380027 Oct 19 00:53:21.124307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1073/2075] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:20 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1275 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:21.180110 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] Creating event network-vif-deleted:969015d5-8bf4-4c33-930e-1792c7eb204a for instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 on n-h1-master-1 Oct 19 00:53:21.203197 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-53f0b27c-594f-4595-bb21-43d4794314d1 req-df1e9deb-7caa-498e-baa4-004a6edf0fb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206978 Oct 19 00:53:21.207798 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1003/2076] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:21.213226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:21.213870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:21.234813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.236281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.239423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.240553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.242364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.242994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.345416 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:21.397741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:21.398875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:21.421375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.423471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.433504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.434336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.434832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.435287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.720584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:21.737319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4d64da2-f525-4091-9399-6349808467bf tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1282 microversion: 2.1 time: 0.345810 Oct 19 00:53:21.748646 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1004/2077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:21 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1282 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:21.802214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:21.836214 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d88d6e7a-cc80-40ae-892e-5ecd6c015622 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1466 microversion: 2.1 time: 0.609048 Oct 19 00:53:21.836965 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1074/2078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:21 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1466 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:21.866052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:21.873001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:21.880193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.883469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.883870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:21.886325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:21.888145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:21.891925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.154187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b9367336-a330-4a2d-88af-c7eb4af13eb9"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:22.156722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:22.164379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:22.183487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:22.185183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:22.186420 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1c416372-a3e5-4f20-b612-18b4298d7e81 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.345279 Oct 19 00:53:22.186976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1075/2079] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:21 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:22.191500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.194100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.199596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.208560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.209091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.213175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:22.213802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:22.216159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.254597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.255198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.261320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.262207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.262697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.263137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.537685 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] HTTP exception thrown: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Request method failure captured: Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments/b5511555-cae6-428e-b1ec-7c90f3b098c4 HTTP/1.1 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 74 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oZ8XO7upnGAPk26iR0Mdnahyn6AeYrYDgheyAkU2XCXDKTpBDLYxnzl5d8SU9sws2LysCaPz7DwsbrfuEaQCqWmyL3FtYHWXImTFkDuQxa6HHEOhYtLQ_qwBEbfGNemP7OIGChodFMz-4aN2dHE-CBgBwDWqOX6ZUCyM9f108AD_U Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9fd8811380834e25984c59a5db32dafe Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9fd8811380834e25984c59a5db32dafe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9fd8811380834e25984c59a5db32dafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9fd8811380834e25984c59a5db32dafe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9fd8811380834e25984c59a5db32dafe"}]}] Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9fd8811380834e25984c59a5db32dafe Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesAdminNegativeTest-117981137-project-admin Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0b496adf117b428690bf79ce25400371 Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesAdminNegativeTest-117981137-project-admin Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: {"volumeAttachment": {"volumeId": "b9367336-a330-4a2d-88af-c7eb4af13eb9"}} Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: exception: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '799bdcc4-8682-46f3-ada7-eadb0baa311d', 'id': 'b5511555-cae6-428e-b1ec-7c90f3b098c4', 'body': {'volumeAttachment': {'volumeId': 'b9367336-a330-4a2d-88af-c7eb4af13eb9'}}} Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. (HTTP 404) (Request-ID: req-ce908919-ffc1-41e1-beaa-863eb5a28466) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:53:22.575836 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Returning 400 to user: Volume b9367336-a330-4a2d-88af-c7eb4af13eb9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:22.579474 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e571029-e601-44fa-b71b-a86fc40b14ad tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments/b5511555-cae6-428e-b1ec-7c90f3b098c4" status: 400 len: 107 microversion: 2.1 time: 0.838839 Oct 19 00:53:22.582211 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1005/2080] 10.222.0.27 () {60 vars in 1433 bytes} [Wed Oct 19 00:53:21 2022] PUT /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments/b5511555-cae6-428e-b1ec-7c90f3b098c4 => generated 107 bytes in 840 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:53:22.781586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-724427906", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:22.880726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e51d335a-eb6c-4a47-bf0e-946db1165e3f tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1617 microversion: 2.1 time: 0.673572 Oct 19 00:53:22.882844 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1076/2081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:22 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1617 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:22.904062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:22.904768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] [instance: f670e59e-a8b4-4fed-9444-49c112a0b0b9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:22.924864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.925478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.925966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.926939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:22.927424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:22.933410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:22.954063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] validate_networks() for [('7caf4a4c-b471-4e13-93bb-24ca2036a7b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:22.982774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] HTTP exception thrown: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Request method failure captured: Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 HTTP/1.1 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oWbdSv5qQS3ipA2DklaxTz1cJ-zUgDswgSq1J4s7nFNBV5NnrnZg2W3NjKqaNlDe4Y7VxzO2fXrX08nE0KrAWxSosUexX5fjfgUgU4LH4Q3Z3ovduZbXeCcH1KknJH3EAjd4QtA297DjSNFqgFiH5O8sabAoWwf_LzK97y2oLllf0 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f69ef772c8bb45358f98bf5b8ff2e670", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f69ef772c8bb45358f98bf5b8ff2e670"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f69ef772c8bb45358f98bf5b8ff2e670"}]}] Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f69ef772c8bb45358f98bf5b8ff2e670 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1647150122 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2f386bc9a48641a4bcd3b09ae45bea70 Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsTestJSON-1647150122-project Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f670e59e-a8b4-4fed-9444-49c112a0b0b9'} Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:22.985636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. Oct 19 00:53:22.989473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:22.995393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Returning 404 to user: Instance f670e59e-a8b4-4fed-9444-49c112a0b0b9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:22.996406 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce4627db-a07d-486d-a75a-25e798b347ce tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9" status: 404 len: 111 microversion: 2.1 time: 0.112315 Oct 19 00:53:23.004781 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1077/2082] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:22 2022] GET /compute/v2.1/servers/f670e59e-a8b4-4fed-9444-49c112a0b0b9 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:23.034814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:23.035454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:23.062931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:23.063643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:23.065893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:23.067974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:23.069484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:23.069924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:23.709786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:23.724275 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55b8134b-e242-4fde-81fc-1e8339b997cb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 0.718122 Oct 19 00:53:23.724897 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1078/2083] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:23 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:23.748229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:23.749033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:23.755895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:23.756582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:23.757202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:23.758138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:23.758831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:23.759402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:23.881454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lazy-loading 'services' on Instance uuid 799bdcc4-8682-46f3-ada7-eadb0baa311d {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:53:24.015765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79415909-3d28-45a3-bb2f-89e9915acec5 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "DELETE /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments/b5511555-cae6-428e-b1ec-7c90f3b098c4" status: 202 len: 0 microversion: 2.1 time: 0.273311 Oct 19 00:53:24.016592 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1079/2084] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 00:53:23 2022] DELETE /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments/b5511555-cae6-428e-b1ec-7c90f3b098c4 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:53:24.031914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:24.035611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:24.053077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.056073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.056819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:24.057800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.059875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.061834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:24.161414 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:24.563956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:24.564449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:24.565052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:24.566020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:24.566841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:24.569679 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:24.595114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.595699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.596219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:24.597051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.597516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.597951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:24.657679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Getting quotas for project 9868d1ede07c453e9a0cb24d0fcdd4df. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:24.673795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Getting quotas for user 4eaebe4f02ee4634b92407e4e066beab and project 9868d1ede07c453e9a0cb24d0fcdd4df. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:24.693439 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:24.705442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:24.715611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:24.718453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:24.745072 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6486cb4-1e44-44cc-a519-fb25de7a2847 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.711738 Oct 19 00:53:24.745072 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1080/2085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:24 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:24.768981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5bd38ba-2ed5-4cc2-b573-cc04536d26b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af5544b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:24.869632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9ef3a79-535a-44c3-a936-e476d7e7c0bb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.287678 Oct 19 00:53:24.871572 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1006/2086] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 2291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:53:24.895006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:24.895675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:24.930436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.931212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.931834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:24.935056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:24.935692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:24.936295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:25.113115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:25.130394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:25.132280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:25.133756 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f51f18ae-7809-4ad7-bdeb-9be3e7bed499 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.251945 Oct 19 00:53:25.150137 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1007/2087] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:24 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:25.160454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-591968186", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["60adecb6-1821-4de4-b712-ac428eda4096"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:25.234340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:25.593748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5bd38ba-2ed5-4cc2-b573-cc04536d26b0 tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/92f8792a-925f-46a9-ac7e-50b07dd6236e" status: 202 len: 0 microversion: 2.1 time: 0.850990 Oct 19 00:53:25.598871 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1081/2088] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:24 2022] DELETE /compute/v2.1/os-security-groups/92f8792a-925f-46a9-ac7e-50b07dd6236e => generated 0 bytes in 858 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:53:25.603919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3236026c-f0e1-43f4-a2d6-063ce663801d", "name": "network-vif-deleted", "tag": "19b61baf-1329-4bdd-a3e8-84eb43ba7c9d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:25.626775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:25.627911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:25.635455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:25.662892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] Creating event network-vif-deleted:19b61baf-1329-4bdd-a3e8-84eb43ba7c9d for instance 3236026c-f0e1-43f4-a2d6-063ce663801d on n-h2-master-1 Oct 19 00:53:25.678603 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b1a1de2d-69a3-4aa6-8f73-610dcc9ec86a req-6c51e0f5-cc60-4f20-8134-0c740abd3b44 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078184 Oct 19 00:53:25.683300 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1082/2089] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:25.694927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:25.702910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:25.715433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:25.716036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:25.716562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:25.724251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:25.725264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:25.725912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:25.810480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-967c43ef-ea15-4507-85a6-d4b185c6ebb9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124866 Oct 19 00:53:25.818169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1083/2090] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:53:25 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:25.827512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:25.832808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:25.845620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:25.848723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:25.849342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:25.850263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:25.852898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:25.853569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.057714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:26.060599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:26.061689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:26.062366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:26.063061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:26.108496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.109406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.110067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.111139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.112599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.115480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.164210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:26.171251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:26.176310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:26.186296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-88cfaf4d-11a9-4b65-94eb-9119f9f42880 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 0.365315 Oct 19 00:53:26.187164 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1084/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:25 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:26.193211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62", "tag": "8548892a-985b-41ba-a94e-cdf0a07721da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:26.206775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.207964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.212279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.224947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:26.227623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:26.229310 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] Creating event network-changed:8548892a-985b-41ba-a94e-cdf0a07721da for instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 on n-h1-master-1 Oct 19 00:53:26.235193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a2458540-41f9-44ca-9c0c-af7b8af5423b req-ea9bc557-8bb7-4732-88d2-f8395fdbf487 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046500 Oct 19 00:53:26.248466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1085/2092] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:26.256366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:26.257614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:26.269868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.270771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.271439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.272424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.273431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.274414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.301193 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e37e18b5-0f4f-47bd-8b94-4f8952722591 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.149587 Oct 19 00:53:26.308820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1008/2093] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:53:26.314224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c2646a2-b58d-4f5b-a21d-289da8878d7d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] Calling method '.version_select at 0x7f2af4ad1040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:26.409151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:26.417860 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1d6593a3-2e24-4b9c-b366-b21acac8826b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1274 microversion: 2.1 time: 0.166977 Oct 19 00:53:26.437053 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1086/2094] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:26 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1274 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:26.445021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:26.452390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:26.470238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.470743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.471930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.472746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.473211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.473644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.834317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:26.843112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a4bc106-21c9-4373-983b-476339347800 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.401881 Oct 19 00:53:26.848371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1087/2095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:26 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:26.853996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:26.855591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:26.864926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.865782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.866662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.867645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:26.868585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:26.869908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:26.878522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c2646a2-b58d-4f5b-a21d-289da8878d7d tempest-SecurityGroupsTestJSON-1647150122 tempest-SecurityGroupsTestJSON-1647150122-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/48d66a47-285f-434f-9e46-aed09ab898a5" status: 202 len: 0 microversion: 2.1 time: 0.568239 Oct 19 00:53:26.879206 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1009/2096] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:53:26 2022] DELETE /compute/v2.1/os-security-groups/48d66a47-285f-434f-9e46-aed09ab898a5 => generated 0 bytes in 570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:53:26.884241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-653b65c5-98b2-43a4-80d3-6bf0526241aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:26.885173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-653b65c5-98b2-43a4-80d3-6bf0526241aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:27.302974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:27.319599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:27.323269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:27.327391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c11722e2-a716-413b-bf43-53e4404188f6 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.474862 Oct 19 00:53:27.332694 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1088/2097] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:26 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:27.343062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:27.348289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:27.373231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.376197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.379151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.382876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.383912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.386251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.421226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-653b65c5-98b2-43a4-80d3-6bf0526241aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:27.434017 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-653b65c5-98b2-43a4-80d3-6bf0526241aa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1216 microversion: 2.1 time: 0.553396 Oct 19 00:53:27.450493 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1010/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:26 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1216 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:27.473783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:27.474416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:27.512277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.514978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.521541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.529668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.530527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.531210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.532242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-289e2134-427d-4491-8dff-24254cd83bad tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.198128 Oct 19 00:53:27.537224 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1089/2099] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:53:27 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:27.538697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:27.539324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:27.546913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.547513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.547971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.548835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:27.550692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:27.551149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:27.972487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:27.983674 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb944476-51ae-4c17-8585-db6649f3244e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1280 microversion: 2.1 time: 0.449002 Oct 19 00:53:27.985729 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1090/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:27 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1280 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:27.998235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:28.005795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:28.040658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.040658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.040658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.040658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.041924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.042417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.720031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:28.734432 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6491b8ad-8799-4251-ae63-a1e058ecdf58 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 1.280277 Oct 19 00:53:28.759843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1011/2101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:27 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:28.765903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc", "tag": "3f6ff0ec-ca51-4422-8183-d27e465d66ed"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:28.779105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.786221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.786928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.821208 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] Creating event network-changed:3f6ff0ec-ca51-4422-8183-d27e465d66ed for instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc on n-h1-master-1 Oct 19 00:53:28.831648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:28.833823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b1007965-d5b3-445c-915b-fe9a5a27f168 req-9b4127ff-5034-4f2a-8006-d7813a85c3f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069407 Oct 19 00:53:28.836207 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1012/2102] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:28.842623 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fda5e787-8315-40f3-9636-837ece3613f7 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.851308 Oct 19 00:53:28.845565 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1091/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:27 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:28.852130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:28.853052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:28.853980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:28.854615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:28.866576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.867251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.869746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.871992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.872335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.873638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.875665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.881938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.882498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:28.885590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:28.886487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:28.886969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.063050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:29.069200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:29.081925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:29.082201 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bb4ea61-6f1e-4692-8454-4d0f9b25286e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1274 microversion: 2.1 time: 0.231827 Oct 19 00:53:29.083008 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1092/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:28 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:29.095744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:29.106135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:29.107339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91cffbed-d825-4019-ba64-a29616d6f2c3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.269752 Oct 19 00:53:29.108174 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1013/2105] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:28 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:29.112084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:29.118726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.119229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.119675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.120394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.120960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.121404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.128535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:29.129391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:29.141866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.149146 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:29.150965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.152044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.153945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.160687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.161294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.220780 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-504aedbd-1343-4e27-bedc-7bbec095065f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122659 Oct 19 00:53:29.226427 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1093/2106] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:53:29 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:29.288441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:29.295981 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:29.305145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9adaceb-a5b4-49d2-8d6e-f519aa1f2ac1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1280 microversion: 2.1 time: 0.195402 Oct 19 00:53:29.306314 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1014/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:29 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1280 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:29.762251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:29.763206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:29.780302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.782193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.785572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.787796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.792426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.793115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.868479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:29.873195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:29.902978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.903660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.904209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:29.906229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:29.910482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:29.911267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:30.979163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:30.993345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7daf91d6-a5d6-4033-afbe-24123a781050 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 1.235233 Oct 19 00:53:30.994287 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1094/2108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:29 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:30.999737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:31.007965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:31.022619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.027208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:31.036822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.037779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.038707 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-89ef5d63-9b27-416c-a7d6-05a40632abe3 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 1.174550 Oct 19 00:53:31.039835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.056475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.056924 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1015/2109] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:29 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:31.065328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.077584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:31.078577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:31.099714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.105423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.106171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.107164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.117483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.118107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.290676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:31.306884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:31.308490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:31.310615 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bcfa7bde-831c-474e-8d32-5805387620f7 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.252310 Oct 19 00:53:31.311220 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1016/2110] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:31 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:31.324370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:31.328073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:31.344230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.348083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.352253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.353437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.358436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.360384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.459388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-802c211a-a29b-400d-84ea-9c1a176373a7 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146981 Oct 19 00:53:31.472600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1017/2111] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:53:31 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:31.486879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:31.497214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:31.520559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.521450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.522125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.523079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:31.523705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:31.524385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:31.609545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:31.625499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ecdbe6eb-20a0-460c-9619-2860ccbac966 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.629378 Oct 19 00:53:31.626858 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1095/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:30 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:32.019662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:32.020309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:32.048793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.049834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.050310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.051101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.051579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.052019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.090485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.100881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b56dfcd5-d0b7-4c92-b180-a108b1a061ff tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.626795 Oct 19 00:53:32.109862 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1018/2113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:31 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:32.124609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:32.129590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:32.155577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.156246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.156858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.157737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.158402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.159554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.690998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.706184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af0dbf03-596c-4a7f-ab28-595387998282 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 0.684824 Oct 19 00:53:32.707581 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1096/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:32 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:32.715012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:32.718462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:32.731649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.732505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.733188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.738750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.739639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.740447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.806488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.815549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31372c44-53a1-453b-9e6d-462a50a2504c tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.704141 Oct 19 00:53:32.833712 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1019/2115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:32 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:32.839000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:32.855214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:32.864193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.865644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.870888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.872058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.872806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.873490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.922953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.938519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.944600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:32.947462 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6d74f24-4d23-4f79-9dae-0683c99dc08c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112430 Oct 19 00:53:32.950549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9a869f2-3f11-4e1f-a233-eb3566ea7eb1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.237727 Oct 19 00:53:32.950763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1020/2116] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:53:32 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:53:32.956336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:32.958878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:32.963176 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1097/2117] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:32 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:32.980109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.980806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.981372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:32.982219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:32.982822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:32.983362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.123512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62", "name": "network-vif-plugged", "status": "completed", "tag": "8548892a-985b-41ba-a94e-cdf0a07721da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:33.165238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.166018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.166636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.214480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] Creating event network-vif-plugged:8548892a-985b-41ba-a94e-cdf0a07721da for instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 on n-h1-master-1 Oct 19 00:53:33.229954 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cf3fa032-230a-4e98-a29b-cf6f254133bf req-f4f972bf-8615-4604-9188-ba9bcfb055c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131443 Oct 19 00:53:33.233695 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1098/2118] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:33.251647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:33.252957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:33.272944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.277899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.278091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.278840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.281947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.282471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.531294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:33.550314 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-34d008e2-2047-4820-95ff-3fcda90281c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.598018 Oct 19 00:53:33.551441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1021/2119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:32 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:33.556358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:33.575099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.576093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.576820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.592085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] Creating event network-changed:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:53:33.598327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-db25befa-4151-4c09-940c-5f09a90cb732 req-63e5b110-10a2-4e7e-aa9f-14343096b969 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045413 Oct 19 00:53:33.600961 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1022/2120] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:33.612147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1299653419", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ad970e27-e1ef-4751-80c2-1d5de6005294"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:33.706042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] validate_networks() for [('ad970e27-e1ef-4751-80c2-1d5de6005294', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:33.906396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:33.920663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a637ce48-d645-45e8-84df-3315fa74f80b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.683743 Oct 19 00:53:33.922324 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1099/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:33 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:33.931105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:33.932604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:33.948240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.949157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.949762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:33.950905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:33.951840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:33.952549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:34.357084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:34.379344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bfb00506-7975-420d-906d-33bcac6f494f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1317 microversion: 2.1 time: 0.453136 Oct 19 00:53:34.380100 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1100/2122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:33 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:34.385476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-334010493", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "82c7aa9d-4226-40d4-9740-5580292913bc"}], "block_device_mapping_v2": [{"uuid": "878b3795-4294-45ce-9491-abf26c8e6626", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:34.477054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] validate_networks() for [('82c7aa9d-4226-40d4-9740-5580292913bc', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:34.670638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:34.671688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:34.672165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:34.672578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:34.673041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:34.683726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:34.684214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:34.684679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:34.685413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:34.685862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:34.686286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:34.710397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:34.716349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Getting quotas for user 7323365b46824abfacf50c9435816bbf and project 8afb1bcb4dfd4a6c89c54312cb2e6377. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:34.735942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:34.738961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:34.795101 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1bff82b-fc01-4bb7-bc25-add44f385227 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.191377 Oct 19 00:53:34.796420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1023/2123] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:53:34.801746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:34.802644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:34.810972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:34.811927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:34.812557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:34.813967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:34.815543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:34.817162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.130585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.135424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:35.136272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:35.136837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:35.138762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:35.139382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:35.147095 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a87aa61c-604e-4887-aebf-d1104603a60b tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.348631 Oct 19 00:53:35.149141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1024/2124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:34 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:35.151558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.152332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.152972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.154116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.154745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.155345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.159820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:35.160888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:35.168387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.168961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.169857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.171668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.172141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.172580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.190633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:35.198646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Getting quotas for user 5d0158da7efc485ebd6a1e1db617b5e7 and project 4c9189bd828c41a88fe9333fb5ec9351. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:35.255038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.264059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.266004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.267429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-05c99aac-e5b2-41cf-a073-175f5f48c8d1 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.117187 Oct 19 00:53:35.281460 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1025/2125] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:35 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:35.291696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8654a2-8b7b-4e67-9a73-bd00ba7ed970", "tag": "3571f0da-08de-4df1-b670-eab6a1f994f7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:35.320470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.320988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.322789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.347859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] Creating event network-changed:3571f0da-08de-4df1-b670-eab6a1f994f7 for instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 on n-h2-master-1 Oct 19 00:53:35.365137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:35.367326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='878b3795-4294-45ce-9491-abf26c8e6626',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:35.394273 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3308e1a7-49b2-4dc3-8f5e-28afdc78454f req-74e44eab-09cd-4deb-8b94-af9dee60427a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108257 Oct 19 00:53:35.395051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1026/2126] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:35.419251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:35.420183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:35.434060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.434559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.434998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.435717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.436172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.436613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.579865 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-784059cb-46f1-48ee-b7e2-aafd54aa3d24 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.198369 Oct 19 00:53:35.582162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1101/2127] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:53:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:53:35.587725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:35.589311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:35.597714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.598589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.599206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.600364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.602177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.602817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.751295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.762346 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9c1df2d-0d90-4bc9-8b22-1b214617357e tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1222 microversion: 2.1 time: 0.178943 Oct 19 00:53:35.788308 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1102/2128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:35 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:35.797318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:35.798609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:35.805682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.806397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.807014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.807876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.808904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.809486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.840143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:35.849448 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b4d0d7f-ccc3-4fd4-93b0-01e071809cdf tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.447876 Oct 19 00:53:35.853552 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1027/2129] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:35 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:35.860083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:35.860729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:35.883060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.883565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.884102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:35.884747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:35.885211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:35.885646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.135776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.149968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd0be193-ebd0-4578-b56e-71e7da9d9bca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.360145 Oct 19 00:53:36.150593 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1103/2130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:35 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:36.161374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.162013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.209880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.219205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b0801482-eef0-4281-aa11-70f9341ca8c8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1507 microversion: 2.1 time: 0.364469 Oct 19 00:53:36.241336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1028/2131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:35 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1507 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:36.259444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.260081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.273714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.276641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.281067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.281777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.282731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.283932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.315149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.324940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.332281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.333550 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16c33777-d90c-48f6-bceb-54b686a6e2f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1103 microversion: 2.25 time: 0.181997 Oct 19 00:53:36.338410 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1104/2132] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1103 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:36.346349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.352245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.355507 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:36.366481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.367026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.367411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.383236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.383993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.384600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.558479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.570940 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e7949d3-f498-4d69-9e58-ee3684f051e6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.328363 Oct 19 00:53:36.574040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1029/2133] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:36.583347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.583966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.592096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.592605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.593081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.593801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.594264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.597297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.663300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.672306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b335ca06-4890-4f7f-8fc2-9be9417005a4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1507 microversion: 2.1 time: 0.332808 Oct 19 00:53:36.672940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1105/2134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:36.699348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:36.703587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.711248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.715868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.716580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.717878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.718561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.719383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.731910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.743688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.745538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.747027 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44368ed6-c77f-4065-9d97-14fa2a9ef2fa tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.171596 Oct 19 00:53:36.748198 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1030/2135] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:36.792888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.793426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.803041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.803746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.804313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.808302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.809361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.809952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.871477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ef4b82b-6b01-4d11-8af7-ef613e91776e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "PUT /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1079 microversion: 2.1 time: 0.177904 Oct 19 00:53:36.872982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1106/2136] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:53:36 2022] PUT /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1079 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:36.879344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc", "name": "network-vif-plugged", "status": "completed", "tag": "3f6ff0ec-ca51-4422-8183-d27e465d66ed"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:36.895519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.896659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.897481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.901645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:36.912354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] Creating event network-vif-plugged:3f6ff0ec-ca51-4422-8183-d27e465d66ed for instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc on n-h1-master-1 Oct 19 00:53:36.915587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cca9f90a-5a72-4f49-8f69-258a72965d20 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1270 microversion: 2.1 time: 0.127120 Oct 19 00:53:36.916220 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1031/2137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:36.920593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-47bc8d3c-5c70-4281-92b0-e939afcf7f09 req-dab4c65c-b126-4417-957a-704f59ada62f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045799 Oct 19 00:53:36.922127 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1107/2138] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:36.923616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.924297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.932278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:36.933633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:36.940811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.941368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.941869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.942552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.943017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.943457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.946145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.947668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.948523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:36.949415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:36.950118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:36.950925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.242435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.248584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.260107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7cdd5518-1726-4fb2-b9bb-073c2d15f118 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1505 microversion: 2.1 time: 0.336133 Oct 19 00:53:37.261540 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1108/2139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:37.276252 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cddd6560-dba0-4635-9750-f42b9b0ae61c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.358828 Oct 19 00:53:37.286650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1032/2140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:36 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:37.289115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:37.289755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.301818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:37.306571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.309197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.309687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.312796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.313673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.314558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.315336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.317268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.317967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.331897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.335511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.336102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.336563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.373554 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:37.663836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.670477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ef028dd-5383-452f-b1bb-5559ad25e1fc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.407482 Oct 19 00:53:37.671180 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1109/2141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:37 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:37.677886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.685341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:37.686269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.690464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cef79c7a-50fe-4b4f-88c1-9af8b1f1395f tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1505 microversion: 2.1 time: 0.398249 Oct 19 00:53:37.691066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1033/2142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:37 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.704768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.717795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:37.718821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.727879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.728678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.729717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.730942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.732014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.732894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.796002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.806086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.810421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.811877 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e16aff1d-cde9-4a14-aae3-2433be8df6c9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1176 microversion: 2.25 time: 0.137780 Oct 19 00:53:37.826225 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1110/2143] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:37 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1176 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:37.836471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:37.840025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.847868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.848454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.848989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.850805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.851520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.851972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.919841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:37.933189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe288413-dafc-40b3-ba64-8713de9e416d tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.225189 Oct 19 00:53:37.949732 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1034/2144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:37 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:37.957670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:37.957670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:37.957670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:37.957670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:37.957670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:37.962376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:37.963293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:37.967546 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:37.973081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.974363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.975408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:37.976271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:37.976652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:37.977091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.032034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:38.039859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.040356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.041000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.041725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.042186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.042779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.073504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-915826af-defb-4b23-a8b6-06a7a1dd11e8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "POST /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62/action" status: 202 len: 1111 microversion: 2.1 time: 0.245789 Oct 19 00:53:38.074271 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1111/2145] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:53:37 2022] POST /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62/action => generated 1111 bytes in 248 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 00:53:38.079653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:38.080944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:38.083200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:38.101205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:38.103081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:38.105690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-94d70969-0922-4832-8483-fc73ea0cb2a8 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1366 microversion: 2.57 time: 0.154411 Oct 19 00:53:38.119952 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1035/2146] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:37 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:38.120412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.135194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.136278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.136671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.137742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.137742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.147641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:38.148693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:38.156470 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:38.158350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.160122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.160680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.161512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.162062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.162572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.369036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:38.381895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13926ce3-518b-4e06-b70f-c44991c90344 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1278 microversion: 2.1 time: 0.305914 Oct 19 00:53:38.386214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1112/2147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:38 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:38.402421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:38.403138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:38.414127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.415313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.415833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.416655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.417296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.417740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.582242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:38.594390 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f7b3f1f-d1bf-4950-8841-7ab563660604 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.459414 Oct 19 00:53:38.620804 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1036/2148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:38 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:38.704921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:38.706637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:38.719525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.720534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.721520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:38.723181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:38.724335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:38.725464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.214695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.223218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad4a2ae6-d3ac-4af1-87ed-86a8caf6daa7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.835855 Oct 19 00:53:39.224029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1113/2149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:38 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:39.228520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:39.229160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:39.235169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.235655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.236086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.237432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.237882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.238301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.330844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.336259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.343774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.348761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.350485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c24d1ee-8b82-49d7-bc01-d3ff5f65d588 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1232 microversion: 2.25 time: 0.125484 Oct 19 00:53:39.351909 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd4b1c6e-bacb-44cc-9e80-a45f267bb7fb tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.651736 Oct 19 00:53:39.352190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1114/2150] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:39 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1232 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:39.353218 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1037/2151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:38 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:39.358264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:39.359013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:39.359394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:39.359926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:39.368084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.368451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.369237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.369957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.371422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.372104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.372980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.374735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.375455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.377124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.377734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.378609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.518287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.537945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.544160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.549827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9fd6518-1720-40e4-bf42-cd5473883fc3 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1372 microversion: 2.57 time: 0.194214 Oct 19 00:53:39.561898 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1038/2152] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:39 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:39.568639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:39.569506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:39.587163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.587717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.588164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.589120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.589646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.590186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.644253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.661787 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3161903a-21e0-4b0a-bdd9-078e90eafbe5 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1324 microversion: 2.1 time: 0.308197 Oct 19 00:53:39.663048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1115/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:39 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:39.679738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:39.680368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:39.690347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.691213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.691742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.692191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.692955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:39.693421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:39.693854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:39.702239 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a233b35d-dded-45cd-b52f-accec520f15a tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1276 microversion: 2.1 time: 0.138694 Oct 19 00:53:39.703539 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1039/2154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:39 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:39.944382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:39.953573 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6808450-4e1f-4e94-adda-1d7e9028ac48 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.289291 Oct 19 00:53:39.954169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1116/2155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:39 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:40.253386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.254781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.266996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.267785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.268467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.275702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.285493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.286725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.381771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.384159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.403379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.403938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.404980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.405817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.406479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.407336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.636166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.646490 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38539801-1fe8-4f0a-ae2a-76fcb41909f7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.403299 Oct 19 00:53:40.647970 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1040/2156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:40.657576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.659263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.669884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.670850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.672357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.673400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.674207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.675259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.703651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.714039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36fa1cab-cab0-4014-9e2b-6c5273eda93f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.341669 Oct 19 00:53:40.731289 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1117/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:40.742848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.747694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.766964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.767944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.769045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.769989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.770563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.771099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.820582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.834186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.836514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.838146 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-328cf937-b78e-40ed-a553-b6c84e16c378 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1232 microversion: 2.25 time: 0.188924 Oct 19 00:53:40.849705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1041/2158] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1232 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:40.859163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.859847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.866540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.867044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.867492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.868219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.868716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.869365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.895481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.909216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.910715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:40.912308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3fa1e03f-3e68-4f89-8a5c-43ecfdbe445c tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1372 microversion: 2.57 time: 0.178509 Oct 19 00:53:40.925522 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1118/2159] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:40.937774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:40.938406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:40.947012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.947439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.948302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:40.949583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:40.950306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:40.951000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.293271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:41.302568 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7ef16e8b-6907-47d8-a429-17cdb9df60f6 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1521 microversion: 2.1 time: 0.451633 Oct 19 00:53:41.314220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:41.322332 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1042/2160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1521 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:41.323245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e40b4aa-c511-4965-aa11-51378cc9852f tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 0.396251 Oct 19 00:53:41.333962 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1119/2161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:40 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:41.334153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.334153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.334336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.334336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.340739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.350572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.351084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.351529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.352266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.352782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.353221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.419130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] HTTP exception thrown: Action 999 not found Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Request method failure captured: Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc/os-instance-actions/999 HTTP/1.1 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0p4JnBP81GzurX8glnxngyQolsdRt5Gv2zFEXLPS2IXPztVO1s4aNu8wNL8JpSs7EfIk2AOVcZy-4X9DCavfLjlCxgk171qWJknn8ms5949kKgseWh_CSzT79t6ZMgUQ99IykdSzJdOTERnyoyYtvhnKgq6wH5HgTksQVxFCFZms9I Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39e5e345d67e457b9f51a84aa0914ca7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}] Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b85df86a633d469489cf2fdc7eaec5cf Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: exception: Action 999 not found Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': '3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc', 'id': '999'} Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 19 00:53:41.426057 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.429606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Returning 404 to user: Action 999 not found {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:41.429606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-46d3dd64-f3a9-4ce5-81d2-abd2e7cabd25 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.098559 Oct 19 00:53:41.430041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1120/2162] 10.222.0.27 () {58 vars in 1308 bytes} [Wed Oct 19 00:53:41 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc/os-instance-actions/999 => generated 66 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:53:41.438032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '.version_select at 0x7f2af5803670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.438606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 0aecc92d-a607-49aa-a239-c7d91f88b2cf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.446713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] HTTP exception thrown: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Request method failure captured: Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0aecc92d-a607-49aa-a239-c7d91f88b2cf/os-instance-actions HTTP/1.1 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0p4JnBP81GzurX8glnxngyQolsdRt5Gv2zFEXLPS2IXPztVO1s4aNu8wNL8JpSs7EfIk2AOVcZy-4X9DCavfLjlCxgk171qWJknn8ms5949kKgseWh_CSzT79t6ZMgUQ99IykdSzJdOTERnyoyYtvhnKgq6wH5HgTksQVxFCFZms9I Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39e5e345d67e457b9f51a84aa0914ca7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}] Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b85df86a633d469489cf2fdc7eaec5cf Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': '0aecc92d-a607-49aa-a239-c7d91f88b2cf'} Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:41.448576 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Returning 404 to user: Instance 0aecc92d-a607-49aa-a239-c7d91f88b2cf could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae2157fe-03ba-4825-8b05-be12705f01ef tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/0aecc92d-a607-49aa-a239-c7d91f88b2cf/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016052 Oct 19 00:53:41.452469 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1121/2163] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 00:53:41 2022] GET /compute/v2.1/servers/0aecc92d-a607-49aa-a239-c7d91f88b2cf/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:41.461086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.461805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.468479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.469246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.469846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.472035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.472688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.473131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.504073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:53:41.617304 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a9131ba7-e6ec-4f9c-b2a1-89bcfb74c903 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 204 len: 0 microversion: 2.1 time: 0.159406 Oct 19 00:53:41.618835 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1122/2164] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:53:41 2022] DELETE /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:53:41.629064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.635561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.643909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.645347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.646048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.646971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.647592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.648169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.701381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:41.715935 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac4ec649-9ed2-4cec-a956-a58927c97f49 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.390166 Oct 19 00:53:41.729507 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1043/2165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:41 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:41.749514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:41.751215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:41.766608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.767105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.767619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:41.771258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:41.771770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:41.772220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.306708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.320360 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c0e89b3-15a0-4494-97d8-5a6a9d40d1ad tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1527 microversion: 2.1 time: 0.696524 Oct 19 00:53:42.321260 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1123/2166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:41 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1527 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:42.331375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:42.336951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:42.351936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.357373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.358277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.359654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.360366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.361087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.402493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.420501 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc555cde-0ea2-4fe5-9226-7d2cac5ca404 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.688488 Oct 19 00:53:42.423794 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1044/2167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:41 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:42.432368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:42.439197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:42.467556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.468156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.476148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.477725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.478481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.479073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.670313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.689082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.691380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.692767 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ddbdfd19-b386-4de5-b93a-ed3e5142f1f2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1240 microversion: 2.25 time: 0.267079 Oct 19 00:53:42.694859 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1045/2168] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:42 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1240 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:42.709433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:42.719065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:42.732472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.732828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.733276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.734024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:42.734452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:42.734884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:42.945967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.979827 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-661ad40e-e1bf-4906-8694-c0e0128a1027 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.654506 Oct 19 00:53:42.981798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:42.982170 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1124/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:42 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:42.997967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8654a2-8b7b-4e67-9a73-bd00ba7ed970", "name": "network-vif-plugged", "status": "completed", "tag": "3571f0da-08de-4df1-b670-eab6a1f994f7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:43.023368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:43.023600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.024226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.024897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.025006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:43.027759 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-792d7f30-be6c-4b78-882a-eafbdf4e9fbd tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1372 microversion: 2.57 time: 0.331719 Oct 19 00:53:43.028360 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1046/2170] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:42 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:43.060614 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] Creating event network-vif-plugged:3571f0da-08de-4df1-b670-eab6a1f994f7 for instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 on n-h2-master-1 Oct 19 00:53:43.067551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:43.068300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:43.084887 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-df0f60dd-06cf-4ccd-8a1f-5edfbd50453d req-2a47f436-e14b-4d9f-93f4-a204e316114b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100316 Oct 19 00:53:43.087045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1125/2171] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:43.102086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:43.103157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:43.107054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.107596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.109432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.111877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.113498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.114708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.121809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.122829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.130845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.131913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.134288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.134913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.502666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:43.506217 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:43.520454 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e00ec368-e16a-40ae-acac-2262bb259e84 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.431666 Oct 19 00:53:43.538803 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1126/2172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:43 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:43.557100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a5aab4-9499-4472-8ca2-ba03acb3fbe4", "tag": "49f7ee2e-62aa-41f2-ba1e-2b36488365bb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:43.591291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.591823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.596087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.613664 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] Creating event network-changed:49f7ee2e-62aa-41f2-ba1e-2b36488365bb for instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 on n-h1-master-1 Oct 19 00:53:43.619818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bad5b778-89f8-432e-aab2-e42d69875e3b req-e3d73465-629e-48ad-bf53-432b6aeda47a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078805 Oct 19 00:53:43.621803 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1127/2173] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:43.644832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:43.646340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:43.658792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.659740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.660473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:43.661508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:43.662474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:43.663161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.181032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.194670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-623fa7a0-ad62-4f92-8656-c40e56678a08 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1527 microversion: 2.1 time: 0.571330 Oct 19 00:53:44.212718 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1128/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:43 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1527 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:44.217323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:44.219416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:44.246164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.248295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.251249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.253055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.256662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.257405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.473495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.499441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d39df397-376c-40ed-a6c8-dc65a5c76744 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 1.456153 Oct 19 00:53:44.520002 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1047/2175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:43 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:44.526682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:44.527572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:44.563535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.564382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.572299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.573669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.574320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.575107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.694037 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:44.728178 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=28 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:44.753136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.763522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.764803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.771999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:44.773845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-635d3e76-3332-44df-b228-3c8f5587c98f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1250 microversion: 2.25 time: 0.252109 Oct 19 00:53:44.774344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e81f999-59f8-451d-8bb9-7f562d1dc01a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1316 microversion: 2.1 time: 0.571218 Oct 19 00:53:44.779054 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1048/2176] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:44 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1250 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:44.779597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1129/2177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:44 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1316 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:44.785332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:44.789354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:44.795632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:44.800694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:44.803743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.804492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.805365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.812950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.813704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.814348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.817611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.818129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.818574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.819311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:44.819768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:44.831943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:44.991937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:45.001870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:45.004136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:45.005415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65238205-c6c3-4742-a50f-abe9ed0ac630 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1357 microversion: 2.57 time: 0.224570 Oct 19 00:53:45.013757 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1130/2178] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:44 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:45.028851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:45.028851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:45.041549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.042250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.051492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.053828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.055234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.056918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.168745 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:45.408584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:45.426179 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1cba4e91-2276-46c8-8e1f-73c30108b4e1 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.641416 Oct 19 00:53:45.427691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1049/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:44 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:45.437035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:45.441824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:45.463194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.463993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.464539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.465462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.466036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.466744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.476516 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:45.509951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:53:45.549916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:45.564070 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3dd015ba-00cd-48a2-8dce-e93a2959e2b9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.548756 Oct 19 00:53:45.564759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1131/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:45 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:45.598141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "name": "network-vif-plugged", "status": "completed", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:45.613126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.613611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.614117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.636322 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] Creating event network-vif-plugged:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:53:45.641699 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3eea3a7e-cea7-4f58-a1ad-889e3526eab3 req-3a846e48-db43-4e9d-b94e-3940bdd63ef7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072489 Oct 19 00:53:45.643645 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1132/2181] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:45.651606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:45.653299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:45.661841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.662586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.663359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.664221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.664909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.665482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.675593 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6771685a-e765-44ac-8659-d8bd4aaa864f tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "DELETE /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 204 len: 0 microversion: 2.57 time: 0.243172 Oct 19 00:53:45.678293 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1050/2182] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:53:45 2022] DELETE /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:53:45.694263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:45.697173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:45.709942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.710434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.710880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:45.711794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:45.712259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:45.712720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.321453 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:46.381327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:46.391581 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad80f871-a048-48ad-9a73-053d4d7e45ee tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1485 microversion: 2.1 time: 0.746458 Oct 19 00:53:46.392203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1133/2183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:45 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1485 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:46.541201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:46.554195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-871df974-de5a-4787-80d0-bc88d2a4486b tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 0.874571 Oct 19 00:53:46.556998 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1051/2184] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:45 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:46.566644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:46.567390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:46.591733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.592251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.592702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.593860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.594627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.595165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.723728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23707e2e-13eb-407e-924f-19e4c6ffb86e tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Action: 'create', calling method: .version_select at 0x7f2af508ac10>, body: {"keypair": {"name": "tempest-keypair-559977234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaKpv4xfVlAVfPM9TcvZ5bxqZnDZTshHwNv/AcPaSiv43eeJzLmmcctCZSj6PkfRANYgHsMcPb4d/LCH/pbqzkUyxfk8OTBnT/ef8bkcPSekfqlo73/uYC1lWjM/YL6EA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:46.766488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-23707e2e-13eb-407e-924f-19e4c6ffb86e tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:46.784697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-23707e2e-13eb-407e-924f-19e4c6ffb86e tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for user cdea18bdbdad41babeb869506d9e602f and project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:46.793762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:46.803928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:46.805793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:46.807074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb6d9c8e-37c4-4dc5-90e6-edf779dce076 tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1363 microversion: 2.57 time: 0.249079 Oct 19 00:53:46.822040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1052/2185] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:46 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:46.828415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:46.829072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:46.858683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.859182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.859842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.864256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.865190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.867661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.867806 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23707e2e-13eb-407e-924f-19e4c6ffb86e tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.463645 Oct 19 00:53:46.882878 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1134/2186] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:53:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:46.919204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:46.919837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:46.937974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.938495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.938948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:46.940249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:46.940722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:46.941154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.490849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.504808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.507060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.508959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-746e94a7-3a85-44d2-8e30-b04108b85c1a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1292 microversion: 2.25 time: 0.685778 Oct 19 00:53:47.517817 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1053/2187] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:46 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1292 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:47.523704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:47.526235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:47.541671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:47.543469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:47.543936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.544723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:47.545203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:47.547170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.552663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.566241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-479ee5d4-6752-44c3-abb4-0f55211cf870 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1466 microversion: 2.1 time: 0.681406 Oct 19 00:53:47.567501 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1135/2188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:46 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1466 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:47.577839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc", "name": "network-vif-deleted", "tag": "3f6ff0ec-ca51-4422-8183-d27e465d66ed"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:47.612818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:47.613835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:47.614476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.630589 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] Creating event network-vif-deleted:3f6ff0ec-ca51-4422-8183-d27e465d66ed for instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc on n-h1-master-1 Oct 19 00:53:47.639289 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5f1ab0e5-485a-49ea-bf3c-a38781bbb28d req-d0049465-99af-44e4-836a-46daefe965f1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070293 Oct 19 00:53:47.640539 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1136/2189] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:47.646703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:47.647814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:47.655495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:47.656322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:47.657976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.659279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:47.660413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:47.661303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:47.943828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.955790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:47.968093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc5f5c8b-f403-49d6-9846-b1cc5703cb4e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1322 microversion: 2.1 time: 0.448672 Oct 19 00:53:47.972299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d42fe6c2-c23d-4c5e-81b1-bb726418f8df tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.329682 Oct 19 00:53:47.985200 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1137/2190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:47 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:47.991141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1054/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:47 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:48.009070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:48.009967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:48.019546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.023849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.024704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.025956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.026647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.027915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.049127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:48.049127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:48.077210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.079700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.083063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.084251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.084965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.089058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.169092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.169850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.170501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.171173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lazy-loading 'fault' on Instance uuid 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:53:48.223056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b85df86a633d469489cf2fdc7eaec5cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e5e345d67e457b9f51a84aa0914ca7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:48.232203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c4cb2df7-c570-4de1-a2f0-70252c82f716 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 200 len: 1314 microversion: 2.1 time: 0.215672 Oct 19 00:53:48.233546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1138/2192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:48 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:48.241447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:48.242110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:48.250489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.251144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.251818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.252817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.253896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.254706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.484044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bea9b0d-c2fd-438e-a798-090ee486d495 tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1617 microversion: 2.1 time: 0.246444 Oct 19 00:53:48.487528 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1139/2193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:48 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1617 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:48.498335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:48.498972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:48.517559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:48.519727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.520566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.521234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.522473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.523180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.523929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.533719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54e6b16a-c5b2-49da-85a9-65620d35913c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 0.529238 Oct 19 00:53:48.541073 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1055/2194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:48 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:48.564208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:48.566031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:48.583697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.584605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.585307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.611765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:48.617999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:48.625595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:48.678621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:48.688031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:48.691469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:48.693196 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f117984-c99c-4753-9f03-e21267ba1dab tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1363 microversion: 2.57 time: 0.204403 Oct 19 00:53:48.694268 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1140/2195] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:48 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:48.797245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-928646341", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "60adecb6-1821-4de4-b712-ac428eda4096"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:48.931660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:53:49.216939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:49.229893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:49.234728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:49.236785 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d42367e-5d98-427f-9ace-8e36073e4dec tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1292 microversion: 2.25 time: 0.693953 Oct 19 00:53:49.237389 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1056/2196] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:48 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1292 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:49.254309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:49.257533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:49.272919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.273439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.273891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.274680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.282387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.283561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.714796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:53:49.715815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:53:49.716444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:53:49.718648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:53:49.719398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:53:49.740105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.740900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.741536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.746291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.747064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.747658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.796215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:53:49.810370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:49.820235 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0dc29e30-a462-44aa-9f18-f3f5525cecdd tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1517 microversion: 2.1 time: 0.581756 Oct 19 00:53:49.821670 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:49.827172 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1057/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:49 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1517 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:49.827634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Getting quotas for user 02e52a53aba2448096ac85fcfaa598a1 and project 5685c970486040e2bc073d3bc1a5e577. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:53:49.838753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:49.851201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:49.874198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.874700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.875145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.875859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:49.877408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:49.877408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:49.891293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:53:49.900894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:53:50.011011 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-792ef574-39f9-4d64-87dc-bb303af537a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219723 Oct 19 00:53:50.021891 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1141/2198] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:53:50.027335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:50.049154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] [instance: 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:50.060304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.061424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.061901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.070364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.070882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.071338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.107554 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] HTTP exception thrown: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Request method failure captured: Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc HTTP/1.1 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0p4JnBP81GzurX8glnxngyQolsdRt5Gv2zFEXLPS2IXPztVO1s4aNu8wNL8JpSs7EfIk2AOVcZy-4X9DCavfLjlCxgk171qWJknn8ms5949kKgseWh_CSzT79t6ZMgUQ99IykdSzJdOTERnyoyYtvhnKgq6wH5HgTksQVxFCFZms9I Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39e5e345d67e457b9f51a84aa0914ca7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39e5e345d67e457b9f51a84aa0914ca7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39e5e345d67e457b9f51a84aa0914ca7"}]}] Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 39e5e345d67e457b9f51a84aa0914ca7 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-934337681 Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b85df86a633d469489cf2fdc7eaec5cf Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-934337681-project Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc'} Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:50.112745 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. Oct 19 00:53:50.116093 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:50.119491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] Returning 404 to user: Instance 3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:50.121366 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c06b19f-1827-4b1e-8a67-21792f0af412 tempest-InstanceActionsNegativeTestJSON-934337681 tempest-InstanceActionsNegativeTestJSON-934337681-project] 10.222.0.27 "GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc" status: 404 len: 111 microversion: 2.1 time: 0.098077 Oct 19 00:53:50.128966 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1142/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:50 2022] GET /compute/v2.1/servers/3c0d4ea7-4eaa-497f-900f-7a0de6d77ccc => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:50.139119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:50.140098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:50.153574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.154368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.155000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.155943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.159203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.159654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.441019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:50.451303 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce9e6ff2-3432-4011-8440-b53ea18c26ec tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.620093 Oct 19 00:53:50.474440 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1058/2200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:49 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:50.492848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:50.494250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:50.521310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.522303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.523461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.524556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.525312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.525958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.706649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.707147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.707590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.708048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lazy-loading 'fault' on Instance uuid 80aad5b9-ca60-4a17-8815-d7cd622a630a {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:53:50.879410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:50.894843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:50.898207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60cdb88d047841efb92e55cd533edab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248e481eb8de408fbb0e819a5a1f136e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:50.903228 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8a8788b-138a-4640-9e70-05c4646d852b tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 200 len: 1368 microversion: 2.57 time: 0.426828 Oct 19 00:53:50.911225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:50.920659 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea77b993-10b2-4899-bb3a-605f63ebb1ec tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 0.790378 Oct 19 00:53:50.927143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1059/2201] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:50 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 1368 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:50.927409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1143/2202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:50 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:50.945717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:50.946296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:50.947022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:50.949292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:50.957294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.958038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.958635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.960273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.961161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.961846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.963294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.963890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.967651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:50.968825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:50.969509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:50.970153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.026963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lazy-loading 'flavor' on Instance uuid c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:53:51.103543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:51.137198 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ebc2c7ed-26de-4255-a628-67751060a569 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1220 microversion: 2.1 time: 0.192858 Oct 19 00:53:51.138499 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1144/2203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:50 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:51.154637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:51.159674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:51.177743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.178510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.181458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.182832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.183641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.184287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.239107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3f2dcc3-3364-4eca-9682-ffcd4eef5a7f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action" status: 200 len: 32 microversion: 2.1 time: 0.309256 Oct 19 00:53:51.244686 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1060/2204] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:53:50 2022] POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:53:51.257515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:51.261549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:51.285287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.289776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.291003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.291879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.293267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.296109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.755189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:51.766667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-674206e4-e9cc-4cdc-8901-694d5fb28a78 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.514627 Oct 19 00:53:51.769601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1061/2205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:51 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:51.789359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a5aab4-9499-4472-8ca2-ba03acb3fbe4", "name": "network-vif-plugged", "status": "completed", "tag": "49f7ee2e-62aa-41f2-ba1e-2b36488365bb"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:51.827025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.828331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.831173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.850261 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] Creating event network-vif-plugged:49f7ee2e-62aa-41f2-ba1e-2b36488365bb for instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 on n-h1-master-1 Oct 19 00:53:51.856423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-740df417-e7de-4471-a3c0-7a9fa5065b53 req-b4cb6f89-4f2f-4f9f-8b3d-673f9de45da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083591 Oct 19 00:53:51.859551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1062/2206] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:51.868928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:51.869837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:51.877339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.878046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.878661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.879533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:51.880594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:51.881224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:51.928283 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:52.375086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:52.405230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:52.406709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:52.416997 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-71793ea1-4ebb-40b9-9807-cbbbefd72427 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1292 microversion: 2.25 time: 1.277045 Oct 19 00:53:52.427044 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1145/2207] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:51 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1292 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:52.434442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:52.435074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] [instance: 80aad5b9-ca60-4a17-8815-d7cd622a630a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:52.452042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.452768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.453390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:52.455800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.459581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.460212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:52.495492 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] HTTP exception thrown: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Request method failure captured: Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a HTTP/1.1 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ppK1IhGLCaBQOV5vzcA0-k5bdrkCLWznAkGtLaLdNkKFJrwx4l8UyJydlVq88v-LxbkwK6Wrh8w9qR9qtq9FpA4nOyUI3RUQz8rqLoG7GXigfEUK9VJXfj8wAHvO6L97mkvMtImtd1W9AB1pITJ46M32j0mTkgPjD6LFRyylYMKUk Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.57 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 248e481eb8de408fbb0e819a5a1f136e Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerShowV257Test-973342949 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248e481eb8de408fbb0e819a5a1f136e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248e481eb8de408fbb0e819a5a1f136e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248e481eb8de408fbb0e819a5a1f136e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248e481eb8de408fbb0e819a5a1f136e"}]}] Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerShowV257Test-973342949 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 248e481eb8de408fbb0e819a5a1f136e Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerShowV257Test-973342949 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerShowV257Test-973342949-project Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 60cdb88d047841efb92e55cd533edab9 Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerShowV257Test-973342949-project Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '80aad5b9-ca60-4a17-8815-d7cd622a630a'} Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:52.497308 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. Oct 19 00:53:52.501198 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:53:52.511343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] Returning 404 to user: Instance 80aad5b9-ca60-4a17-8815-d7cd622a630a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:52.521521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-05454c71-4fc0-4fa5-98be-2068ddcc6b1a tempest-ServerShowV257Test-973342949 tempest-ServerShowV257Test-973342949-project] 10.222.0.27 "GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a" status: 404 len: 111 microversion: 2.57 time: 0.093208 Oct 19 00:53:52.522141 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1146/2208] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:52 2022] GET /compute/v2.1/servers/80aad5b9-ca60-4a17-8815-d7cd622a630a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:53:52.549389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:52.550074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:52.563092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.563599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.564045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:52.574445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.575017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.575591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:52.945875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:52.957400 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0033c4fe-3389-4c1b-8663-5c941387e339 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 1.096571 Oct 19 00:53:52.959257 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1063/2209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:51 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:52.964277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:52.965183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:52.971827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.972655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.973337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:52.974608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:52.975285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:52.976458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.498146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:53.508777 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6b22b1d-87f2-4fec-9ebe-3e4d369fb8fd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1268 microversion: 2.1 time: 0.548098 Oct 19 00:53:53.522104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1064/2210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:52 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1268 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:53.540998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35151adf-1d29-46da-94bd-6b763b85c911", "tag": "38fba665-c513-49b8-b120-100135193616"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:53.566838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:53.567257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:53.572240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.602829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] Creating event network-changed:38fba665-c513-49b8-b120-100135193616 for instance 35151adf-1d29-46da-94bd-6b763b85c911 on n-h1-master-1 Oct 19 00:53:53.612768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:53.616767 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3ad1e3c2-93b3-4dcb-b9b3-d41d47c7fd4a req-6e55d42c-5210-4c5c-8177-7a6764620450 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090725 Oct 19 00:53:53.617392 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1065/2211] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:53.622895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc5b348b-4555-4a39-b76a-d53ea36414a8 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1318 microversion: 2.1 time: 1.097702 Oct 19 00:53:53.623440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:53.636817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1147/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:52 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1318 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:53.636817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:53.636817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:53.641903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:53.658333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:53.658904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:53.659283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.660002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:53.660459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:53.660912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.661675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:53.662180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:53.662634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.663359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:53.663825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:53.664263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:53.706928 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:54.082514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.098035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.099469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.102337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aed78f1a-075c-4f15-8ac7-bf8d03284409 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.476852 Oct 19 00:53:54.102934 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1148/2213] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:53 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:54.127876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.130599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:54.131505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:54.138997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.139686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.140946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.141858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.142528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.142721 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-072142e1-7864-40d1-90be-a6454ccb8f97 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.522841 Oct 19 00:53:54.143492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.144185 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1066/2214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:53 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:54.500446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.518188 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b29d44a-9e5e-4961-80ad-ad0bc13b1ee4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.394039 Oct 19 00:53:54.518793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1149/2215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:54 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:54.535872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:54.536888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:54.544103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.549382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.557340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.558536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.559461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.560052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.651348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:54.652266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:54.667760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.671477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.672166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.677093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:54.678022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:54.681210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:54.801316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:54.815017 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2bf00cef-6299-4db6-b896-5472a107f117 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1286 microversion: 2.1 time: 0.282668 Oct 19 00:53:54.815792 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1067/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:54 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1286 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:55.098573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:55.107515 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a704e9e-c099-4be7-a565-a9ead2a70eed tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1508 microversion: 2.1 time: 0.461562 Oct 19 00:53:55.108660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1150/2217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:54 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:55.128926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:55.129733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:55.144040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.144607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.145701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.146805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.147395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.147848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.167338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:55.168192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:55.179404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.180100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.180562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.182985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.183657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.188750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.720227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:55.736556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:55.738418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:55.742015 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-309a4b35-041e-436c-86a1-b5acbb6aa253 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.618088 Oct 19 00:53:55.759129 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1068/2218] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:55 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:55.776970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:55.778013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:55.801909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.803219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.803845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.805224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.806274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.807377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.847675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:55.855558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-223640e3-775c-4372-9f1e-474e25d754f8 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.692045 Oct 19 00:53:55.856354 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1151/2219] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:55 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:55.888160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:55.893921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:55.909462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.909960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.910397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:55.911108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:55.911614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:55.911980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:56.574742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:56.593790 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3291cf1d-73fc-49c7-9813-326f8b9b247b tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.714048 Oct 19 00:53:56.597489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1152/2220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:55 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:56.758698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:56.768708 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25cd4c0f-4858-4053-b22a-e68c2d996fd0 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 1.007941 Oct 19 00:53:56.777374 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1069/2221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:55 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:56.792511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:56.793683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:56.811864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:56.820771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:56.821367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:56.822142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:56.822624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:56.823058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:56.884708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:56.885863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:56.897661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:56.905383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:56.913341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:56.914166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:56.914593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:56.915031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:57.651918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:57.665131 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e71a8e3-0b12-4cf9-b88f-34e78396fa58 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.785290 Oct 19 00:53:57.665972 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1070/2222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:56 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:53:57.693161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:57.705794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:57.711888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:57.712382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:57.712859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:57.713577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:57.714047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:57.714466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:57.742580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:57.760295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:57.762714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:57.764743 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09d6f7f9-8d98-45cc-b97e-42cb59dd544b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.991867 Oct 19 00:53:57.769676 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1153/2223] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:56 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:53:57.799781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:57.801136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:57.809965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:57.810982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:57.811624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:57.812343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:57.812907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:57.813386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.138038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:58.147254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-febb2616-6091-4a61-ab1b-ce8e80634830 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.461348 Oct 19 00:53:58.177577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1071/2224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:57 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:58.179760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:58.191362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4c58dc3b-7991-454c-aff7-bd91f555e853"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:58.197159 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c92b11f8-e63f-4813-9301-8adfbb22cdfa tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.401835 Oct 19 00:53:58.197893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:58.203034 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1154/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:57 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:58.217456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.218861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.222259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.223340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.224009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.231848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.355543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] HTTP exception thrown: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Request method failure captured: Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4/os-volume_attachments/110cc877-9019-42ce-9ab0-65fd34e10436 HTTP/1.1 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 74 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oZ8XO7upnGAPk26iR0Mdnahyn6AeYrYDgheyAkU2XCXDKTpBDLYxnzl5d8SU9sws2LysCaPz7DwsbrfuEaQCqWmyL3FtYHWXImTFkDuQxa6HHEOhYtLQ_qwBEbfGNemP7OIGChodFMz-4aN2dHE-CBgBwDWqOX6ZUCyM9f108AD_U Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9fd8811380834e25984c59a5db32dafe Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9fd8811380834e25984c59a5db32dafe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9fd8811380834e25984c59a5db32dafe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9fd8811380834e25984c59a5db32dafe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9fd8811380834e25984c59a5db32dafe"}]}] Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9fd8811380834e25984c59a5db32dafe Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-117981137 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesAdminNegativeTest-117981137-project-admin Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 0b496adf117b428690bf79ce25400371 Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesAdminNegativeTest-117981137-project-admin Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: {"volumeAttachment": {"volumeId": "4c58dc3b-7991-454c-aff7-bd91f555e853"}} Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: exception: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '12a5aab4-9499-4472-8ca2-ba03acb3fbe4', 'id': '110cc877-9019-42ce-9ab0-65fd34e10436', 'body': {'volumeAttachment': {'volumeId': '4c58dc3b-7991-454c-aff7-bd91f555e853'}}} Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. (HTTP 404) (Request-ID: req-c67a927a-478c-4d7c-951d-193a4b5631e4) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:53:58.358445 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] Returning 404 to user: Volume 110cc877-9019-42ce-9ab0-65fd34e10436 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ef54f6a-d7a1-4256-837c-62de0f2024c7 tempest-VolumesAdminNegativeTest-117981137 tempest-VolumesAdminNegativeTest-117981137-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4/os-volume_attachments/110cc877-9019-42ce-9ab0-65fd34e10436" status: 404 len: 109 microversion: 2.1 time: 0.181254 Oct 19 00:53:58.362268 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1072/2226] 10.222.0.27 () {60 vars in 1433 bytes} [Wed Oct 19 00:53:58 2022] PUT /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4/os-volume_attachments/110cc877-9019-42ce-9ab0-65fd34e10436 => generated 109 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:53:58.408555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03573bd1-2d71-4382-8407-79726c833604", "tag": "1588225c-2ab1-498b-9286-4cf2ed7f27c1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:53:58.431911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.434619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.435325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.473215 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] Creating event network-changed:1588225c-2ab1-498b-9286-4cf2ed7f27c1 for instance 03573bd1-2d71-4382-8407-79726c833604 on n-h1-master-1 Oct 19 00:53:58.503933 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1be70f7b-b940-4201-8dab-6c24f6d08fd7 req-0616d42f-7e5e-4743-883b-f143292f5907 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097313 Oct 19 00:53:58.505410 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1155/2227] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:53:58.694573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:58.695531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:58.714394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.719900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.723367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.724441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.725157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.726591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.796412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:58.797621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:58.830034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.830710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.833884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:58.836853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:58.839004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:58.842836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:59.572145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:59.587583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86d6c3db-80b4-47d5-bbf3-3693aceeb982 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.898163 Oct 19 00:53:59.590733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1073/2228] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:58 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:53:59.600405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:59.602202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:59.602338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:59.613132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:59.617778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:59.618530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:59.620456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:59.622199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:59.623713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:59.624988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:59.625687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:53:59.630485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63b52b61-a987-4b6d-bf4f-f409d1126c11 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.841630 Oct 19 00:53:59.633383 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1156/2229] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:53:58 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:53:59.645362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:53:59.650562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:53:59.665359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:59.668222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:59.668895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:59.669646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:53:59.674274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:53:59.675023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:53:59.771321 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:53:59.857425 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:00.176314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:00.187774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-afb25c6e-ce95-43ac-a96f-0c2be8fc1a72 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.553215 Oct 19 00:54:00.212691 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1157/2230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:59 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:00.406447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:00.418026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e70dd69-cbbf-439a-82f1-7ad151d4676c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.825881 Oct 19 00:54:00.419591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1074/2231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:53:59 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:00.613779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:00.614414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:00.628136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:00.628677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:00.629285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:00.630039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:00.632229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:00.636521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:00.664443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:00.665206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:00.680503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:00.681355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:00.685926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:00.687908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:00.688901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:00.691440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:01.603974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:01.620711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:01.622595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:01.623993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d866c18f-2ea0-41e4-8ad6-b9e4a9a16190 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.964838 Oct 19 00:54:01.625427 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1075/2232] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:00 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:01.632313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:01.633240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:01.648745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:01.649762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:01.650864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:01.652391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:01.653237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:01.653835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:01.894160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:01.910163 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c32c043-e443-4c19-8eeb-8caa96f9033d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 1.301839 Oct 19 00:54:01.911470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1158/2233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:00 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:01.916673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:01.920135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:01.932089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:01.935544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:01.938273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:01.939319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:01.946088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:01.946835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:01.995659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:02.013570 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b84616e-51c9-4f31-a28e-1c7ea567b97e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.381768 Oct 19 00:54:02.017686 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1076/2234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:01 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:02.529223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:02.546041 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b531b19-534e-42e4-9b45-853d69475895 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.630925 Oct 19 00:54:02.566814 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1159/2235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:01 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:02.655170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:02.655943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:02.670311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:02.670977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:02.671671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:02.672877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:02.675520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:02.676216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:02.938128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:02.940079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:02.961645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:02.962966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:02.964185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:02.965677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:02.971834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:02.973202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.183302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:03.203629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:03.209120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:03.214125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b30b5aeb-3c3a-4ff3-959f-279fd4aad370 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.563769 Oct 19 00:54:03.236009 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1077/2236] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:02 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:54:03.250306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:03.252887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:03.280485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.283156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.283883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.285409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.289325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.289966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.658784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:03.694002 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e4de27d-38b3-4679-9827-6109772917ba tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.759230 Oct 19 00:54:03.696736 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1160/2237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:02 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:03.710101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:03.716601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:03.726994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.738452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.738917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.740886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.741366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.741796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.800849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:03.821767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:03.837465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07b10044-e883-4826-a4c5-ec01652a704d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.587983 Oct 19 00:54:03.841518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1078/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:03 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:03.857976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:03.860876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:03.884744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.888318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.888863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:03.893899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:03.894424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:03.901635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.033278 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b956f16-b1a9-4a0e-b4aa-8802d4652957 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 204 len: 0 microversion: 2.1 time: 0.326407 Oct 19 00:54:04.037249 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1161/2239] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:03 2022] DELETE /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:04.051044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:04.052027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:04.058670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.059520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.060178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.061135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.061920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.062578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.399899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:04.410895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd4f6a33-cd67-4f7b-bd98-4651a969dfb2 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.568243 Oct 19 00:54:04.416088 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1079/2240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:03 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:04.434035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:04.434973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:04.452413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.454042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.467613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.470367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.472968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.478762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.578789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:04.607939 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-358c4ed9-bc75-4cc9-a20d-2d937e6754eb tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1514 microversion: 2.1 time: 0.568826 Oct 19 00:54:04.608541 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1162/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:04 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1514 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:04.723922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:04.724545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:04.734778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.737021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.737493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.743299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.743910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.744549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.894873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:04.920791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:04.922757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:04.924656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66fd12f0-037d-4149-8c8c-b7bb984343a5 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.507053 Oct 19 00:54:04.925183 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1080/2242] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:04 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:04.948698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:04.949694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:04.958592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.960372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.961078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.962179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:04.962808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:04.963404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:04.968160 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:05.194187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:05.197566 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:05.206712 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b79a9c5-bac7-4bf0-964b-3c80335f5639 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.487493 Oct 19 00:54:05.225014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1163/2243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:04 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:05.277190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:05.286806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5bac0568-4333-48a3-a1ae-f0bb7db14d74 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.344322 Oct 19 00:54:05.288455 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1081/2244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:04 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:05.443378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:05.445049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:05.454034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.455007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.455674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:05.457709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.458749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.459337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:05.634909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:05.635725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:05.639171 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:05.648599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.652471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.653199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:05.654286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.654833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.657396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:05.898248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:05.911066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd65df2c-fa40-40f7-8fa5-d7952a5beecc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.471488 Oct 19 00:54:05.912317 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1164/2245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:05 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:05.956173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:05.956784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:05.971978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.972834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.973437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:05.978542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:05.978823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:05.979275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:06.497102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:06.505655 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a94dce58-608c-4f64-924d-f9a4c24bf124 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1514 microversion: 2.1 time: 0.875819 Oct 19 00:54:06.510567 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1082/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:05 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1514 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:06.529520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:06.530377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:06.544644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:06.551253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:06.552554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:06.553591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:06.555270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:06.556016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:06.575929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:06.594601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:06.599169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:06.600448 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8029695-6a22-4678-b5ee-5e173b794a35 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.649595 Oct 19 00:54:06.601077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1165/2247] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:05 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:54:06.621152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:06.622653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:06.650313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:06.651100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:06.651614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:06.653258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:06.656436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:06.657251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.047649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:07.059981 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a25a6b35-bbaf-4195-800d-7b1dc6ec209c tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.545279 Oct 19 00:54:07.062936 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1083/2248] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:06 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:07.071570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:07.075451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:07.092405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.096201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:07.105427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.105807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.109109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.109612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.110063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.115391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ac3ff4a1-30bf-4206-8815-64ad1ef0077d tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1516 microversion: 2.1 time: 0.506794 Oct 19 00:54:07.118706 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1166/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:06 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:07.323815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a5aab4-9499-4472-8ca2-ba03acb3fbe4", "name": "network-vif-deleted", "tag": "49f7ee2e-62aa-41f2-ba1e-2b36488365bb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:07.334665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.335659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.337043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.359300 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] Creating event network-vif-deleted:49f7ee2e-62aa-41f2-ba1e-2b36488365bb for instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 on n-h1-master-1 Oct 19 00:54:07.366760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8d5b1904-9169-4bfc-88f0-61281f0fff68 req-243744b5-c154-43df-9875-e92a54b6f503 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246477 Oct 19 00:54:07.367976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1167/2250] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:07.449077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:07.466626 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f986e687-2c74-4a45-a8cc-634bef840c5f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.400003 Oct 19 00:54:07.467892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1084/2251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:07 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:07.538607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:07.539337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:07.577578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.578380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.580152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.581577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.584656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.586071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.630107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:07.630720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:07.652384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.659277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.660908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.662556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.664568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.665234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.721535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:07.723701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:07.724394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:07.735142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lazy-loading 'fault' on Instance uuid 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:08.003123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.011183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5ab440c-4e7d-451c-9bb1-7c66a79da197 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1308 microversion: 2.1 time: 0.479743 Oct 19 00:54:08.013574 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1168/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:07 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:08.019954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35151adf-1d29-46da-94bd-6b763b85c911", "name": "network-vif-plugged", "status": "completed", "tag": "38fba665-c513-49b8-b120-100135193616"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:08.043651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.044192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.048043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.094103 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] Creating event network-vif-plugged:38fba665-c513-49b8-b120-100135193616 for instance 35151adf-1d29-46da-94bd-6b763b85c911 on n-h1-master-1 Oct 19 00:54:08.108654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9ca99564-865a-424c-86a5-f7cd35188a36 req-24d7634a-f8ef-463f-8c12-2db4f213cd29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092151 Oct 19 00:54:08.109337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1169/2253] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:08.122908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:08.124437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:08.142353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.142859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.143390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.144126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.144582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.145039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.238802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.257879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.263032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.272195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-178e619b-c3ff-4be1-a715-f501a45304e4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.643992 Oct 19 00:54:08.273423 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1085/2254] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:07 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:54:08.289947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:08.291713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:08.313599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.314757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.315469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.316544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.320411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.321755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.477858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.499680 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1e8d1bb-7a47-447e-a27b-4bb685b46d17 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.381934 Oct 19 00:54:08.500836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1170/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:08 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:08.540211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:08.540899 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:08.554128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.557690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.558629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.559386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:08.559868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:08.560281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:08.599146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.615636 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a6732f86-c920-49b9-9612-f6f516cc4f92 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.332993 Oct 19 00:54:08.620264 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1086/2256] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:08 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:08.761328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:08.774313 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b3cfda1-42ef-4ebe-ad72-5f22bb9c8e6c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.271659 Oct 19 00:54:08.789743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1171/2257] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:08 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:09.039270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:09.040478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:09.066620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.069314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.072034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.073758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.075525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.076792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.168809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.169470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.170285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.170858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lazy-loading 'fault' on Instance uuid 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:09.240514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:09.251118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c18d831a-7c94-430d-8aee-8b8dad08f2b3 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 200 len: 1308 microversion: 2.1 time: 0.216388 Oct 19 00:54:09.252427 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1087/2258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:09 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:09.311407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:09.324966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:09.357196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.362977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.363863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.366156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.368269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.371113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.545583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:09.546848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:09.563505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.564539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.565332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.566308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.567601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.568482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.815359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:09.830588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:09.832246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:09.837677 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2bec22fa-152d-404f-9f42-54c91f5ee0b2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.537582 Oct 19 00:54:09.849827 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1172/2259] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:09 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:09.864329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:09.865509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:09.875112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.876450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.877395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:09.878342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:09.879648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:09.880255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.102163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:10.116223 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-36913b21-bc50-4661-9125-28d51383476b tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.584021 Oct 19 00:54:10.118019 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1088/2260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:09 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:10.122665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:10.123290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:10.141192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.158248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.158718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.159711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.159949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.167549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.507674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:10.524339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1228f87-a912-48e9-9592-2eb0b3fa4afb tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.672095 Oct 19 00:54:10.527328 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1173/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:09 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:10.544322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03573bd1-2d71-4382-8407-79726c833604", "name": "network-vif-plugged", "status": "completed", "tag": "1588225c-2ab1-498b-9286-4cf2ed7f27c1"}, {"server_uuid": "12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62", "name": "network-vif-unplugged", "status": "completed", "tag": "8548892a-985b-41ba-a94e-cdf0a07721da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:10.573923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:10.584775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.586595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.588728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a7cfd14-4645-4bca-b8ad-e7c99f8f8843 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.469658 Oct 19 00:54:10.589330 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1089/2262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:10 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:10.594365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:10.599731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.600897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 12a5aab4-9499-4472-8ca2-ba03acb3fbe4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:10.622097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.622882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.623502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.624475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.625377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.625974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.636880 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Creating event network-vif-plugged:1588225c-2ab1-498b-9286-4cf2ed7f27c1 for instance 03573bd1-2d71-4382-8407-79726c833604 on n-h1-master-1 Oct 19 00:54:10.638226 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] Creating event network-vif-unplugged:8548892a-985b-41ba-a94e-cdf0a07721da for instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 on n-h1-master-1 Oct 19 00:54:10.654195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] HTTP exception thrown: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Request method failure captured: Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 HTTP/1.1 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oJZXBfppS8xQuwoqB9E7A4k_77HIwsjsq6iLk-f-OrlOpkcB9nzdXC__T0AzDW-gWLW_nV-m6Jyc5ERBfNueapXmlqK6W_FFfbQuym3Yrdov1k3o5qB2kkAqY5ik6kjX8JZfXPk67hzXBycyPKyqiCkE-DxrbSERlShGAGTA92O1s Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8afb1bcb4dfd4a6c89c54312cb2e6377 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8afb1bcb4dfd4a6c89c54312cb2e6377", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}] Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8afb1bcb4dfd4a6c89c54312cb2e6377 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesAdminNegativeTest-236203894-project Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 7323365b46824abfacf50c9435816bbf Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesAdminNegativeTest-236203894-project Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '12a5aab4-9499-4472-8ca2-ba03acb3fbe4'} Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:10.657160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. Oct 19 00:54:10.661950 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:10.662359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4035bb9b-fb54-40e0-acbf-e8708ad63a0f req-6337cd16-0184-4a63-9e61-471146a13d22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.129500 Oct 19 00:54:10.662359 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1174/2263] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:10.667021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Returning 404 to user: Instance 12a5aab4-9499-4472-8ca2-ba03acb3fbe4 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:10.668388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a0d27ee-4f43-4f9d-b156-0c97cd40808d tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4" status: 404 len: 111 microversion: 2.1 time: 0.077965 Oct 19 00:54:10.672582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1090/2264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:10 2022] GET /compute/v2.1/servers/12a5aab4-9499-4472-8ca2-ba03acb3fbe4 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:10.869746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:10.871792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:10.901235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.902017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.902909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:10.903812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:10.904739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:10.905377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.141793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:11.142615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:11.153948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.156640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.157385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.159258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.162130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.163442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.228327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:11.241562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:11.243796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:11.246788 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd556dc2-3d70-4a17-a28b-42a4c59ba28a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1280 microversion: 2.25 time: 0.384045 Oct 19 00:54:11.261954 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1175/2265] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:10 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:11.533401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:11.551439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:11.552104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:11.563111 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d44ce6ba-be33-4327-806c-57c3a8e0d146 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.424857 Oct 19 00:54:11.568815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.569871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.570855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.572092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.572853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.573864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.579040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1091/2266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:11 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:11.618613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:11.619586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:11.629513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.630342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.631149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.632705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:11.633387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:11.634019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:11.972570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:11.987348 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a92f2bb3-3ca8-4135-bce3-2017e26bdbde tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1316 microversion: 2.1 time: 0.373077 Oct 19 00:54:11.989771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1092/2267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:11 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:12.005570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:12.019672 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-86137b9e-14e3-4b35-a5d3-229be3bc3587 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.473450 Oct 19 00:54:12.038888 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1176/2268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:11 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:12.278151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:12.279034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:12.301570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:12.303211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:12.306165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:12.307912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:12.309128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:12.311461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:12.591961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:12.592908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:12.605732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:12.606507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:12.607203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:12.608245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:12.609092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:12.609769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:12.652734 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:12.670193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:12.675595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:12.681606 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba06808c-ec86-411e-8bb9-2d433d7e108a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1476 microversion: 2.25 time: 0.404643 Oct 19 00:54:12.682736 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1093/2269] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:12 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:12.988366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:13.017253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e4b896e-9edc-4e90-a8f4-b2ddf6be4b06 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.423484 Oct 19 00:54:13.024060 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1177/2270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:12 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:13.040836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:13.042003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:13.069212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.079441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.080270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.086515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.087606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.089360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.373142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:13.374326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:13.397080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.400467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.401674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.403278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.405490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.409785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.456334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:13.469700 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f21d7665-24d8-4815-99bd-d812bf819734 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1465 microversion: 2.1 time: 0.440520 Oct 19 00:54:13.474156 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1178/2271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:13 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1465 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:13.493635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:13.494316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:13.521055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.526093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.526696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.533499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.534089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.534502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.860184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 35151adf-1d29-46da-94bd-6b763b85c911 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:13.896210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3e4d0ed-9ddf-46b1-9e31-322d4038366e tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1968 microversion: 2.25 time: 1.192266 Oct 19 00:54:13.897159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1094/2272] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:12 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1968 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:13.907863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:13.909483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:13.929808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.933615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.934339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.935708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.943450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:13.948818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.954081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.956129 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d9e049b-dddd-4c3f-9c0c-b7cfdc0f7808 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.480804 Oct 19 00:54:13.959210 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1179/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:13 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:13.973102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:13.974562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:13.991158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.991517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:13.992029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:13.992908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:13.993449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.007241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.578255 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01b775ae-cd40-4aa8-87a4-a21ef061ebcb tempest-ServersOnMultiNodesTest-1310087797 tempest-ServersOnMultiNodesTest-1310087797-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1616 microversion: 2.1 time: 0.677489 Oct 19 00:54:14.580259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1095/2274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:13 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1616 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:14.587046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:14.587685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:14.606737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 35151adf-1d29-46da-94bd-6b763b85c911 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:14.612689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.613223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.613681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.614426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.614895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.615338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.631086 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-50dd2772-7f2d-426d-98f4-e4beced38ce4 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1968 microversion: 2.25 time: 0.670010 Oct 19 00:54:14.632490 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1180/2275] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:13 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1968 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:14.646345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:14.647053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:14.661059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.662193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.662193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.663734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.664785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.665379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.718489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:14.723954 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:14.886757 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:14.893099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ccf6b6e1-39a3-4501-9f5e-68ea6ab599a8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 204 len: 0 microversion: 2.1 time: 0.257976 Oct 19 00:54:14.895088 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1181/2276] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:14 2022] DELETE /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:14.901352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:14.905476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.906097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.906621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.908122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.908717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.909470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.949312 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2f758c3-f1a9-4a50-a189-bece0fe7e8db tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052653 Oct 19 00:54:14.957960 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1182/2277] 10.222.0.27 () {60 vars in 1217 bytes} [Wed Oct 19 00:54:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:54:14.961313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:14.962288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:14.968915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.969511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.970642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.971478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:14.972003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:14.972336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:14.972832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:14.983224 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e6cf278-9187-4566-9cca-0b2e5b557e23 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.401798 Oct 19 00:54:14.983820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1096/2278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:14 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:15.001995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-master-1", "block_migration": "auto"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:15.004543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:15.046034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:15.046551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:15.049437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:15.050031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:15.050507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:15.053153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:15.109494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'flavor' on Instance uuid 35151adf-1d29-46da-94bd-6b763b85c911 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:15.134857 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:15.144148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Going to try to live migrate instance to n-h2-master-1 {{(pid=131450) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 00:54:15.287691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:15.297983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f45c3398-2439-4fb7-af09-a6f9ece6e5d7 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1471 microversion: 2.1 time: 0.340574 Oct 19 00:54:15.314901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1183/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:14 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:15.332471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:15.333337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:15.344362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:15.345417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:15.345871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:15.346593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:15.347054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:15.347484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:15.645842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:15.663139 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8192caf1-9543-460f-bb42-f4ebd812fb31 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.346795 Oct 19 00:54:15.678032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1184/2280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:15 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:16.014107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:16.014746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:16.034994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:16.044437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:16.048861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:16.050209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:16.055476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:16.060601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:16.519697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:16.545596 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9893a613-6800-44f5-9205-7204fe19a1cc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.532787 Oct 19 00:54:16.547336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1185/2281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:16 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:16.670511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-905376036", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:16.759876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] validate_networks() for [('fd2785cf-29f6-47df-b47b-4dd1279e43f8', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:54:17.558209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:54:17.558677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:54:17.559162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:54:17.559576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:54:17.560388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:54:17.573167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:17.574041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:17.574489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:17.575245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:17.575709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:17.576142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:17.625254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Getting quotas for project 488f8fabd15e4e7c8837ccd25c842e46. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:54:17.641321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Getting quotas for user ea919891e28b42fd9c7ea98cbf2362a4 and project 488f8fabd15e4e7c8837ccd25c842e46. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:54:17.675333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:54:17.678824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:54:17.783608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-288fb5c0-a45d-40e4-80b2-54fedc451345 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.235286 Oct 19 00:54:17.786703 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1186/2282] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:54:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:54:17.795479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:17.796216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:17.806103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:17.806739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:17.807523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:17.819858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:17.821378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:17.821931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:18.128162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:18.141228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-824a2d15-0487-494f-9f4a-c5005baa0101 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1471 microversion: 2.1 time: 0.352937 Oct 19 00:54:18.143121 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1187/2283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:17 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1471 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:18.168735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62", "name": "network-vif-plugged", "status": "completed", "tag": "8548892a-985b-41ba-a94e-cdf0a07721da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:18.181151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:18.181704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:18.182531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:18.213728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] Creating event network-vif-plugged:8548892a-985b-41ba-a94e-cdf0a07721da for instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 on n-h1-master-1 Oct 19 00:54:18.227624 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c5ee081e-248e-4b6b-8707-7f328b7a2f21 req-23857e4d-f4e7-44af-9f73-be46b21b6c1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063901 Oct 19 00:54:18.228536 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1188/2284] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:18.249065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:18.250695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:18.273196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:18.274305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:18.275347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:18.278233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:18.278792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:18.279301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:18.939978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:18.952882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54f98616-3fd0-4afc-8d43-e740769d0620 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1522 microversion: 2.1 time: 0.716222 Oct 19 00:54:18.958302 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1189/2285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:18 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:18.963422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:18.964051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:18.981062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:18.981476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:18.984078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:18.990454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:18.991159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:18.991764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.363718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:19.387982 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5250307-c6c4-4252-afe3-ba5159c49e20 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.428471 Oct 19 00:54:19.388585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1190/2286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:18 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:19.427788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:19.428296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:19.440473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.441216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.441815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.442710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.443321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.443934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.498040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:19.653814 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd1e6102-7ec8-44ee-a3c7-6d60258e0352 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911/action" status: 202 len: 0 microversion: 2.25 time: 4.655664 Oct 19 00:54:19.655023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1097/2287] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:54:14 2022] POST /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911/action => generated 0 bytes in 4670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:19.660591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:19.661247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:19.687047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.696154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.697145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.706040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.706830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.707499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.747971 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a87e710-b3f5-47ff-be97-e82d15271934 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "DELETE /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 204 len: 0 microversion: 2.1 time: 0.335596 Oct 19 00:54:19.752787 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1191/2288] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:19 2022] DELETE /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:19.757142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:19.757864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:19.764205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.764800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.765501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.766243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:19.766784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:19.769067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:19.947316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:19.954856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:19.971093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5761b9c0-ac92-4984-ab3f-b1ff693c5eec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1265 microversion: 2.1 time: 0.307744 Oct 19 00:54:19.972850 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1098/2289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:19 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:19.987338 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20d88885-b4cf-4412-bda8-0efe467b43e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1429 microversion: 2.1 time: 0.219451 Oct 19 00:54:19.988070 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1192/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:19 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1429 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:19.996824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:19.997676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:20.009536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:20.016402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:20.020285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.020833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.021286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.022014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.022475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.022905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.058993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.062033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.062588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.070397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.070918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.071372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.646663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:20.651136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:20.673434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91c75d9a-0abb-46a9-9aaa-a8dc836c15fe tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1679 microversion: 2.1 time: 0.679935 Oct 19 00:54:20.689455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:20.692399 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1193/2291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:19 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1679 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:20.694923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:20.701052 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-621b0db7-758e-446f-be07-63f0f730a309 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.726135 Oct 19 00:54:20.702388 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1099/2292] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:19 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:20.703593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:20.708827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:20.720941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03573bd1-2d71-4382-8407-79726c833604", "name": "network-vif-deleted", "tag": "1588225c-2ab1-498b-9286-4cf2ed7f27c1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:20.724915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.725838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.726490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.729808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.730559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.732830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.754619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.756920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.759046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.790151 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] Creating event network-vif-deleted:1588225c-2ab1-498b-9286-4cf2ed7f27c1 for instance 03573bd1-2d71-4382-8407-79726c833604 on n-h1-master-1 Oct 19 00:54:20.804082 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-48ab7734-99a7-4d05-af1d-7c98ad27fa28 req-62aa7850-d519-4d74-9b05-eaad90e7a4a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095417 Oct 19 00:54:20.805958 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1100/2293] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:20.822845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:20.824180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:20.834276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.835492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.836647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:20.837597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:20.838280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:20.838924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.100429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:21.112231 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d081d8dd-adc2-4878-8888-438bd6dd3888 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1507 microversion: 2.1 time: 0.418334 Oct 19 00:54:21.116985 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1194/2294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:20 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1507 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:21.125571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:21.129480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:21.150210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.150726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.151271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.151997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.152459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.153173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.387853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:21.393719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:21.399296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31c27b6b-7d53-46f7-b571-d6aed937f033 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1265 microversion: 2.1 time: 0.280871 Oct 19 00:54:21.401337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1195/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:21 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:21.411102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:21.415195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a72350bb-8487-4d41-9532-886103286e5e tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.607507 Oct 19 00:54:21.416552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:21.429692 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1101/2296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:20 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:21.438130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:21.440388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:21.440551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.441008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.443163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.446428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.447042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.448139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.451505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.454478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.467827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.479370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.480007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.481435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.497472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.498215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.498842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.499671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lazy-loading 'fault' on Instance uuid 03573bd1-2d71-4382-8407-79726c833604 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:21.566164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:21.570197 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:21.590056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6efc8d1-bd4d-4831-811f-03361dcdd559 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 200 len: 1306 microversion: 2.1 time: 0.186231 Oct 19 00:54:21.591140 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1196/2297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:21 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 1306 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:21.700842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:21.701752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:21.712589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.713008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.714125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.715024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:21.715495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:21.717088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:21.994761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:21.997623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:22.006978 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad6b7d10-f974-498a-9be1-8f240ffef4a2 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1679 microversion: 2.1 time: 0.311064 Oct 19 00:54:22.020809 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9de7fbf4-9c47-43df-a2de-412b6212e4e4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 200 len: 1507 microversion: 2.1 time: 0.589429 Oct 19 00:54:22.021397 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1197/2298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:21 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1679 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:22.032131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1102/2299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:21 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 1507 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:22.046303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:22.047277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:22.054083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:22.054821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:22.062626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:22.063122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:22.063825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:22.064309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:22.065072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:22.065203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:22.066006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:22.066520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:22.066978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:22.069506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:22.070218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:22.072437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:22.121095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:22.222620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52fb3e89-b01c-4870-9206-6a068f93ea80 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 204 len: 0 microversion: 2.1 time: 0.174164 Oct 19 00:54:22.224069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1103/2300] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:22 2022] DELETE /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:22.377060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1836890554", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ee5219f5-db7a-44ce-ab2c-d09ce7de3cef"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:22.464651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] validate_networks() for [('ee5219f5-db7a-44ce-ab2c-d09ce7de3cef', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:54:23.153055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:23.175629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:23.181977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:23.189018 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c1a4dbe-4ba7-44d1-8c8c-58f7b44d24e9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 1.164833 Oct 19 00:54:23.191715 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1198/2301] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:22 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:23.206311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:23.212198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:23.233222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:23.236614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:23.242684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:23.246035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:23.248828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:23.249474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:23.461364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:23.477550 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb2c39d5-8c98-40eb-b42d-d361cdcde17d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1273 microversion: 2.1 time: 0.282425 Oct 19 00:54:23.478451 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1199/2302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:23 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1273 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:23.483330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:23.489714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:23.508523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:23.509048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:23.509488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:23.510410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:23.511065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:23.511704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.187041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:24.202306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97ed1497-5210-4c8f-b93a-d40a5e7098be tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1523 microversion: 2.1 time: 0.722304 Oct 19 00:54:24.203060 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1200/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:23 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1523 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:24.215470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:24.217177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 03573bd1-2d71-4382-8407-79726c833604] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:24.233504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.234016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.234477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.235405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.236126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.236604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.254001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 HTTP/1.1 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '03573bd1-2d71-4382-8407-79726c833604'} Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:24.256377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. Oct 19 00:54:24.260323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:24.261572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance 03573bd1-2d71-4382-8407-79726c833604 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:24.262717 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95918968-ef27-4bd7-bc42-37b9879836d9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604" status: 404 len: 111 microversion: 2.1 time: 0.056409 Oct 19 00:54:24.263515 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1201/2304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:24 2022] GET /compute/v2.1/servers/03573bd1-2d71-4382-8407-79726c833604 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:24.270043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:24.270893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:24.278532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.279190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.279831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.280755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.281366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.281948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.414916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:24.425360 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-915488ad-6d5c-4251-af4d-3b6c810b527c tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1611 microversion: 2.1 time: 0.160619 Oct 19 00:54:24.427970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:54:24.428495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:54:24.429247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:54:24.429790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:54:24.430436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:54:24.430966 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1202/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:24 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1611 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:24.440547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:24.441266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:24.457695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.458589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.459489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.460111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.460702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.461098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.461506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.461776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.462240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.462660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.462769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.463586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.517873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:54:24.542083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Getting quotas for user 2542aef0e4464018bf9d4563ffe9030d and project 3642cd3632604ea8aa75cf14c9fef293. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:54:24.584740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:54:24.587600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:54:24.728484 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9cfb641a-f575-4aee-9e27-c3ca99c94bc9 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.355980 Oct 19 00:54:24.731156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1104/2306] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:54:24.738390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:24.739202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:24.747741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.748970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.749605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.764527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:24.772878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:24.773363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:24.874130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:25.034458 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae665403-1341-4436-bb15-557daa4e0178 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 204 len: 0 microversion: 2.1 time: 0.298733 Oct 19 00:54:25.035410 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1105/2307] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:24 2022] DELETE /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:25.056254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:25.057330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:25.082746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.083320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.086735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:25.090864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.091666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.092288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:25.252107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:25.265998 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c4f39aa-1540-4b40-a548-1f216905c079 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1271 microversion: 2.1 time: 0.226693 Oct 19 00:54:25.285509 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1106/2308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:25 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:25.290721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0395db2-eb9a-4e9e-a55e-21098f8c7fdd tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:25.292062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0395db2-eb9a-4e9e-a55e-21098f8c7fdd tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:25.650488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0395db2-eb9a-4e9e-a55e-21098f8c7fdd tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:25.663003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0395db2-eb9a-4e9e-a55e-21098f8c7fdd tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1218 microversion: 2.1 time: 0.375898 Oct 19 00:54:25.665555 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1107/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:25 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:25.674175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:25.674741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:25.690240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:25.699450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:25.700214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.700738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.706707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:25.708299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-76040558-c9ee-4272-908f-ac47caa6b954 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 1.276328 Oct 19 00:54:25.711874 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1203/2310] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:24 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:25.712450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:25.713319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.713801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.714249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:25.733964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:25.740703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:25.755824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.760827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.761394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:25.763047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:25.763704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:25.764962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.466356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:26.476316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:26.478182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a64eceee-a5a9-42e5-ab6a-c9c9df005f10 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1472 microversion: 2.1 time: 0.811396 Oct 19 00:54:26.479752 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1108/2311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:25 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1472 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:26.494673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:26.495609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:26.502220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e4c1a25-7de4-4582-a34a-e51092a16674 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1503 microversion: 2.1 time: 0.787348 Oct 19 00:54:26.503303 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1204/2312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:25 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1503 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:26.510656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "799bdcc4-8682-46f3-ada7-eadb0baa311d", "name": "network-vif-deleted", "tag": "3adb96e1-e4a5-4d02-9a9b-309c17c76577"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:26.511182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.511824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.512432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.513478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.514091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.521287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.539495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.539983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.543185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.571988 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] Creating event network-vif-deleted:3adb96e1-e4a5-4d02-9a9b-309c17c76577 for instance 799bdcc4-8682-46f3-ada7-eadb0baa311d on n-h2-master-1 Oct 19 00:54:26.580958 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a9b450c2-b32b-4dec-b3d7-8e910bea1dc8 req-4a974aa1-551d-439c-a313-71a317ba22a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075201 Oct 19 00:54:26.583087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1205/2313] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:26.583302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.583911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.584712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.585685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lazy-loading 'fault' on Instance uuid 799bdcc4-8682-46f3-ada7-eadb0baa311d {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:26.592175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1132122631", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "9446b0ca-5206-4e5e-895f-0e017561882d"}], "security_groups": [{"name": "tempest-securitygroup--1880826357"}], "key_name": "tempest-keypair-559977234", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "7202a56a-0ea1-474e-be4f-c36ac2fad938", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:26.827061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7323365b46824abfacf50c9435816bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8afb1bcb4dfd4a6c89c54312cb2e6377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:26.837128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c238ee8-93e9-4fde-9bbb-2c28189e91d6 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 200 len: 1330 microversion: 2.1 time: 0.355463 Oct 19 00:54:26.848201 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1109/2314] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:26 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 1330 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:26.857678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:26.885744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:26.917978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.923752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.924462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:26.930650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:26.931163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:26.931616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:27.419489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] validate_networks() for [('9446b0ca-5206-4e5e-895f-0e017561882d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:54:27.594180 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:27.664817 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:27.768652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:27.777301 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-72218def-d7a1-40a0-a07f-8935fe6f6bff tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1313 microversion: 2.1 time: 0.927649 Oct 19 00:54:27.780977 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1110/2315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:26 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1313 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:27.795307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b87b2c31-65e7-4f25-9e12-a7c89d436b72 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'create', calling method: .version_select at 0x7f2af48e01f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1223523193", "description": "tempest-description-525229049"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:29.235058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b87b2c31-65e7-4f25-9e12-a7c89d436b72 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.449501 Oct 19 00:54:29.235913 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1111/2316] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:54:27 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:29.254239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:29.255599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:29.269291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.270358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.271230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.272431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.273603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.274193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.288097 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:29.466709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:29.477206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30453b1b-b96c-419a-b4f7-7610f22158ac tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1276 microversion: 2.1 time: 0.240180 Oct 19 00:54:29.477813 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1112/2317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:29 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:29.508448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:29.514070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:29.530442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.531202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.531825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.543198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.543946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.545297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.579141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:54:29.608472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for user cdea18bdbdad41babeb869506d9e602f and project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:54:29.658034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:54:29.658928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:54:29.659668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:54:29.660290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:54:29.660954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:54:29.696535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.699691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.700365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.710268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:29.711078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:29.712414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:29.784720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:54:29.813463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Getting quotas for user cdea18bdbdad41babeb869506d9e602f and project 9c2fa98925ac4de19cd7cba6ef8b3b2c. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:54:29.942868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:29.957362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:29.958940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:29.960176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-284131a6-c0d5-4606-8979-ba3c78eb3b6f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.464019 Oct 19 00:54:29.968442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1113/2318] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:29 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:29.989557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:29.990612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:30.007665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:54:30.010855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7202a56a-0ea1-474e-be4f-c36ac2fad938',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:54:30.017176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.018169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.018789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.019720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.020434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.021119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.164292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:30.175044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-680b9f2c-01e0-4bc1-a77c-9c50712a9c7e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 200 len: 1430 microversion: 2.1 time: 0.205382 Oct 19 00:54:30.175974 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1114/2319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:29 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 1430 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:30.188117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:30.189621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] [instance: 799bdcc4-8682-46f3-ada7-eadb0baa311d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:30.201583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.203185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.204609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.205788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.206514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.207231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.223438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] HTTP exception thrown: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Request method failure captured: Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d HTTP/1.1 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oJZXBfppS8xQuwoqB9E7A4k_77HIwsjsq6iLk-f-OrlOpkcB9nzdXC__T0AzDW-gWLW_nV-m6Jyc5ERBfNueapXmlqK6W_FFfbQuym3Yrdov1k3o5qB2kkAqY5ik6kjX8JZfXPk67hzXBycyPKyqiCkE-DxrbSERlShGAGTA92O1s Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8afb1bcb4dfd4a6c89c54312cb2e6377 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8afb1bcb4dfd4a6c89c54312cb2e6377", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8afb1bcb4dfd4a6c89c54312cb2e6377"}]}] Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8afb1bcb4dfd4a6c89c54312cb2e6377 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-236203894 Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesAdminNegativeTest-236203894-project Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 7323365b46824abfacf50c9435816bbf Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesAdminNegativeTest-236203894-project Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '799bdcc4-8682-46f3-ada7-eadb0baa311d'} Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:30.225944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Returning 404 to user: Instance 799bdcc4-8682-46f3-ada7-eadb0baa311d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:30.230109 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7090a68-591e-495f-beed-92147153d596 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d" status: 404 len: 111 microversion: 2.1 time: 0.050469 Oct 19 00:54:30.231335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1115/2320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:30 2022] GET /compute/v2.1/servers/799bdcc4-8682-46f3-ada7-eadb0baa311d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:30.276333 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:30.301447 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7373f711-800f-4226-be61-8b97a223c09c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.714419 Oct 19 00:54:30.307897 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1206/2321] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:54:26 2022] POST /compute/v2.1/servers => generated 407 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:54:30.309006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62", "name": "network-vif-deleted", "tag": "8548892a-985b-41ba-a94e-cdf0a07721da"}, {"name": "network-changed", "server_uuid": "b1fa75e8-139e-446e-bb8c-9e673fdf4bb7", "tag": "2f8cebd8-ca9c-4030-be53-139b8e5b5af8"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:30.322070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.322645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.323856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.324210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-548735841", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "a55a4a86-d573-41c2-9832-7da403a3ce8b"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:30.333973 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:30.345428 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Creating event network-vif-deleted:8548892a-985b-41ba-a94e-cdf0a07721da for instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 on n-h1-master-1 Oct 19 00:54:30.346504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] Creating event network-changed:2f8cebd8-ca9c-4030-be53-139b8e5b5af8 for instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 on n-h2-master-1 Oct 19 00:54:30.357062 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b80bf610-446c-4ca7-846b-e9a8689980e1 req-644ced83-2ad7-4d2b-b286-f92db2a24c77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052682 Oct 19 00:54:30.357755 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1207/2322] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:30.363863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:30.364722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:30.372989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.373700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.374358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.375413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:30.377261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:30.377906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:30.409325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] validate_networks() for [('a55a4a86-d573-41c2-9832-7da403a3ce8b', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:54:31.041513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:31.065466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5098b16-9710-4055-9004-8101332e327d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1313 microversion: 2.1 time: 0.706141 Oct 19 00:54:31.066126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1208/2323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:30 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:31.078316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1223523193"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:31.078920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:31.099588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:31.100662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:31.101403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:31.102384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:31.103065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:31.103752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:31.427658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.network.security_group_api [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Adding security group c4b21518-a61f-44c1-92c2-95aa450b9da4 to port c21b2a02-fbf8-40d3-912d-9546093cec20 Oct 19 00:54:32.265198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:54:32.267129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:54:32.268235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:54:32.269195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:54:32.269922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:54:32.294419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.295220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.295860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.298666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.299155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.301063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.353416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Getting quotas for project 37640d2d06604d02b384e5a2625b69e9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:54:32.366052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Getting quotas for user ab81208ae8f64a04bd49c018d7bf5c13 and project 37640d2d06604d02b384e5a2625b69e9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:54:32.391833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:54:32.401277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:54:32.469397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62129410-e64e-4b6c-8e7a-00268ce04a0a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action" status: 202 len: 0 microversion: 2.1 time: 1.402102 Oct 19 00:54:32.472076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1209/2324] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:54:31 2022] POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action => generated 0 bytes in 1405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:54:32.479176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8654a2-8b7b-4e67-9a73-bd00ba7ed970", "name": "network-vif-deleted", "tag": "3571f0da-08de-4df1-b670-eab6a1f994f7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:32.480200 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-56738a62-bd08-4cb2-ac97-117243a56da7 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247692 Oct 19 00:54:32.481450 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1116/2325] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:54:32.488310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef7ac9b2-15d7-4767-97aa-cb4238936ff9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] Calling method '.version_select at 0x7f2af497f670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:32.514308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.516038 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef7ac9b2-15d7-4767-97aa-cb4238936ff9 tempest-VolumesAdminNegativeTest-236203894 tempest-VolumesAdminNegativeTest-236203894-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-696671186" status: 202 len: 0 microversion: 2.1 time: 0.033041 Oct 19 00:54:32.517562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.518473 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1117/2326] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:54:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-696671186 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:54:32.519388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.537672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:32.538846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:32.557142 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] Creating event network-vif-deleted:3571f0da-08de-4df1-b670-eab6a1f994f7 for instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 on n-h2-master-1 Oct 19 00:54:32.561010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.562758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.582826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.584036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.586359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.603424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.611585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d0732df7-cf29-480f-a997-4813d3c37a68 req-fd562216-d9bf-41f6-88b6-9fb65e8aca2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127291 Oct 19 00:54:32.613930 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1210/2327] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:32.631692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:32.646229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:32.682397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.683104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.683576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.692038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.694257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.694730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.904245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:32.918344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e8586746-7f2f-4b89-a896-fb4f450eb313 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1219 microversion: 2.1 time: 0.397526 Oct 19 00:54:32.919430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1118/2328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:32 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1219 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:32.925887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:32.926744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:32.947934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.949124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.949727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:32.953062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:32.954966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:32.955588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.019460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.031287 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-47b0ef73-d299-4b42-bdec-87b8e9a4b167 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1318 microversion: 2.1 time: 0.414129 Oct 19 00:54:33.048947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1211/2329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:32 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:33.053876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:33.054724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: bc8654a2-8b7b-4e67-9a73-bd00ba7ed970] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:33.070970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.075368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.075922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.076861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.077393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.078262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.104331 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 HTTP/1.1 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: exception: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'bc8654a2-8b7b-4e67-9a73-bd00ba7ed970'} Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:33.106423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. Oct 19 00:54:33.111013 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:33.112446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:33.114106 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8cc11118-fae5-429a-9b85-0f6978c4d6ef tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970" status: 404 len: 111 microversion: 2.1 time: 0.064033 Oct 19 00:54:33.114835 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1212/2330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:33 2022] GET /compute/v2.1/servers/bc8654a2-8b7b-4e67-9a73-bd00ba7ed970 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:33.119942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:33.122221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:33.129326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.130048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.130640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.131515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.132392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.132992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.470394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.497564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0884cc7-db4c-4aff-8c9a-d2f5e707f7ec tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1313 microversion: 2.1 time: 0.380932 Oct 19 00:54:33.502457 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1213/2331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:33 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:33.513075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7c681b-0496-494f-88b0-35fa57feab0e", "tag": "1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:33.565259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.572202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.580545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.585185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.601674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.605058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.611183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f510d6c-36d1-4895-926b-6de25c54100d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.689817 Oct 19 00:54:33.627441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1119/2332] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:32 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:33.646091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] Creating event network-changed:1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b for instance 0b7c681b-0496-494f-88b0-35fa57feab0e on n-h1-master-1 Oct 19 00:54:33.651433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1223523193"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:33.656058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:33.669367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2b12c938-0dd1-45de-9ee5-23c16fe153ff req-8163cf72-6849-4525-b3fb-28ee5a3ab1e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163707 Oct 19 00:54:33.670160 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1214/2333] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:33.677480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.678232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.679189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.680033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.680726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.686176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.695822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:33.698368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:33.742328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.744908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.746597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.748417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:33.753774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:33.754453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:33.976943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:33.985468 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eac8a19f-f44d-460b-93be-cd700ba6a677 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1231 microversion: 2.1 time: 0.309864 Oct 19 00:54:34.024984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1215/2334] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:33 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1231 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:34.038600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:34.039147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:34.053374 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Removing security group c4b21518-a61f-44c1-92c2-95aa450b9da4 from port c21b2a02-fbf8-40d3-912d-9546093cec20 Oct 19 00:54:34.059608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.060119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.060570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:34.065258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.065760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.069103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:34.140291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:34.289899 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:34.407882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a2df43ce-1907-4172-b933-a908fd216643 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 204 len: 0 microversion: 2.1 time: 0.376117 Oct 19 00:54:34.413614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1216/2335] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:34 2022] DELETE /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:34.426462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:34.428388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:34.445123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.445692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.446144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:34.446876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.447337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.447801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:34.709170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:34.723466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2beb40f-bc0e-4b99-82fb-6457653ab6bd tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1237 microversion: 2.1 time: 0.308401 Oct 19 00:54:34.741388 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1217/2336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:34 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1237 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:34.753158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:34.753789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:34.783797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.784318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.784804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:34.785544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:34.786006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:34.786440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.257663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:35.269165 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c52530db-f4c5-44db-abe9-97b38f069aad tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1318 microversion: 2.1 time: 0.526472 Oct 19 00:54:35.270503 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1218/2337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:34 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:35.275649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:35.276796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:35.284494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.285245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.285844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.286916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.287551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.288332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.574558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:35.612401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-407eccb2-c7d9-452a-abe3-eeaedcb2a475 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1472 microversion: 2.1 time: 0.338946 Oct 19 00:54:35.615847 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1219/2338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:35 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1472 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:35.639367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:35.641497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:35.676364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.677454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.678285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.686086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.687239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.688056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.698746 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18d74bd3-0c57-4ea4-89ed-c293c7f73d7d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action" status: 202 len: 0 microversion: 2.1 time: 2.068975 Oct 19 00:54:35.707041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1120/2339] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:54:33 2022] POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action => generated 0 bytes in 2072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:54:35.718497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:35.722250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:35.743279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.744167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.745104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:35.746663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:35.750001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:35.752022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:36.180211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:36.191732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:36.194273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:36.195856 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b285f4a1-0fcc-4764-8632-bd1e8a13766f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.494207 Oct 19 00:54:36.197703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1121/2340] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:35 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:36.207826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:36.238035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:36.239479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:36.241500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:36.272283 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] Creating event network-changed:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:54:36.278163 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-19db15e5-982f-4416-b954-8a3f23c1cde8 req-8468ac57-5961-4a32-913e-8161276d0890 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078998 Oct 19 00:54:36.279159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1122/2341] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:36.286395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:36.287217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:36.296978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:36.297583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:36.299693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:36.301072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:36.302063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:36.305666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:36.306458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:36.310610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9fd3f04-877a-414b-a26e-2e783ae785a3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1313 microversion: 2.1 time: 0.688124 Oct 19 00:54:36.318837 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1220/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:35 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:36.324176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-81a187bd-0efc-4a89-a44e-d0b0fb250771 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'create', calling method: .version_select at 0x7f2af5690e50>, body: {"pool": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:36.489461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:36.514387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-10090713-fa21-4bba-bd56-2f4e0e89d292 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1279 microversion: 2.1 time: 0.232395 Oct 19 00:54:36.523382 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1123/2343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:36 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:36.539074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:36.541459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:36.565143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:36.566425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:36.566941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:36.570268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:36.570785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:36.571295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:37.601629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:37.614243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9840c43b-c11c-40ee-98c1-b586878c1872 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1305 microversion: 2.1 time: 1.087360 Oct 19 00:54:37.615913 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1124/2344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:36 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1305 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:37.625700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:37.627861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:37.660296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:37.661608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:37.662380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:37.663707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:37.664597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:37.665283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.126741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:38.139313 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b72b2a24-785f-4f46-901c-fa316246caa4 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1318 microversion: 2.1 time: 0.521894 Oct 19 00:54:38.142586 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1125/2345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:37 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:38.157603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:38.158838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:38.177056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.178846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.179576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.181657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.184370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.185067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.266447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.267113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.269259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.270756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lazy-loading 'fault' on Instance uuid c5dd89cf-86bb-4858-a716-8f137d496f48 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:38.363390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:38.374188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30cd03d1-4d67-4789-b478-644afc09491a tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 200 len: 1306 microversion: 2.1 time: 0.230475 Oct 19 00:54:38.374794 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1126/2346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:38 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:38.382010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:38.388349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:38.402696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.403450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.404225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.405191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.405836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.407674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:38.804830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:38.817315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:38.819155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:38.826147 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-726e67cf-f4c0-47d1-afda-e3c4f8802679 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.448066 Oct 19 00:54:38.827377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1127/2347] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:38 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:38.962646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fa75e8-139e-446e-bb8c-9e673fdf4bb7", "name": "network-vif-plugged", "status": "completed", "tag": "2f8cebd8-ca9c-4030-be53-139b8e5b5af8"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:38.976316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:38.977611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:38.979358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:39.010469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] Creating event network-vif-plugged:2f8cebd8-ca9c-4030-be53-139b8e5b5af8 for instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 on n-h2-master-1 Oct 19 00:54:39.032927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2e9db345-7e17-4c2f-bf60-f9dc2561f978 req-8eddc399-e219-47da-b66c-96c8b4547d9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201924 Oct 19 00:54:39.043014 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1128/2348] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:39.059414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:39.063157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:39.085843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:39.086492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:39.087395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:39.089987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:39.091552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:39.094494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:39.688983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:39.698234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7582fda1-dafa-4119-aec6-a4554dc2865c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1313 microversion: 2.1 time: 0.653484 Oct 19 00:54:39.705721 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1129/2349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:39 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1313 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:39.711132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:39.714290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:39.728394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:39.728942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:39.729375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:39.730104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:39.730573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:39.731014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:39.735638 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:39.852101 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:39.975070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:39.991276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8df44f1b-f085-4fa4-a6fb-edce465944ce tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1285 microversion: 2.1 time: 0.284061 Oct 19 00:54:40.021525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1130/2350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:39 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1285 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:40.165579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}, {"server_uuid": "c5dd89cf-86bb-4858-a716-8f137d496f48", "name": "network-vif-deleted", "tag": "3d9b7c1f-825f-4f42-8c6a-7f1218888a18"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:40.190505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:40.191240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:40.192933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:40.218953 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Creating event network-changed:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:54:40.219513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] Creating event network-vif-deleted:3d9b7c1f-825f-4f42-8c6a-7f1218888a18 for instance c5dd89cf-86bb-4858-a716-8f137d496f48 on n-h2-master-1 Oct 19 00:54:40.243189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b932845e-42f7-469e-8d73-5cf953c3d01a req-c1fa9a6e-3949-475b-9afc-7750a49d6c99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.219921 Oct 19 00:54:40.245033 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1131/2351] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:40.261689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:40.262661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:40.285510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:40.286113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:40.286578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:40.291104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:40.291630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:40.303234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:40.837359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:40.851458 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e46c8c44-eace-426c-a82c-758c5b6bc686 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1305 microversion: 2.1 time: 0.603714 Oct 19 00:54:40.858633 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1132/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:40 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1305 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:40.885503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:40.885685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:40.904257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:40.904777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:40.913469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:40.914904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:40.915700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:40.916361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:40.925898 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:41.246850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-81a187bd-0efc-4a89-a44e-d0b0fb250771 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.926714 Oct 19 00:54:41.247945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1221/2353] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:54:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:41.255510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:41.256356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c5dd89cf-86bb-4858-a716-8f137d496f48] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:41.272413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.272943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.275564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.276521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.279119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.279778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.321287 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 HTTP/1.1 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c5dd89cf-86bb-4858-a716-8f137d496f48'} Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:41.324683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. Oct 19 00:54:41.329535 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:41.333055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance c5dd89cf-86bb-4858-a716-8f137d496f48 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:41.335305 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-49eed0f7-3c71-43c1-8397-cffa31d1d74e tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48" status: 404 len: 111 microversion: 2.1 time: 0.086404 Oct 19 00:54:41.337667 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1222/2354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:41 2022] GET /compute/v2.1/servers/c5dd89cf-86bb-4858-a716-8f137d496f48 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:41.347902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:41.350743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:41.362371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.362863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.363305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.364014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.364472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.364925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.436559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:41.447341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38b3e34c-0208-4bcf-8ffe-77c8a486b4e3 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1318 microversion: 2.1 time: 0.579536 Oct 19 00:54:41.451806 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1133/2355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:40 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:41.457435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c74d8ba-3f10-4092-9af2-8e81b6ae8476", "tag": "c5e1fc2d-c598-47ee-b664-93a8f4c3812c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:41.483405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.489037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.489505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.521519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] Creating event network-changed:c5e1fc2d-c598-47ee-b664-93a8f4c3812c for instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 on n-h1-master-1 Oct 19 00:54:41.527251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c248ed98-5692-4ed7-8ff7-9dffbc111644 req-f19880fc-605e-423b-8bbb-ebd152dc73aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073984 Oct 19 00:54:41.528387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1134/2356] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:41.537100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:41.545217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:41.558728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.559563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.560190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.561090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.562814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.563936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.908047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:41.930014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:41.932901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:41.938621 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28b9cf93-f958-4bb6-9dad-40c27121202a tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.595446 Oct 19 00:54:41.940180 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1223/2357] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:41 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:41.950027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:41.951047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:41.959139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.959956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.960422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:41.961317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:41.961997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:41.962583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.015487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:42.033371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7b06c34-4a4b-4e83-be7e-6ac750c03051 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1498 microversion: 2.1 time: 0.503526 Oct 19 00:54:42.049604 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1135/2358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:41 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1498 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:42.061454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.151"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:42.064734 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:42.081213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.081867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.082942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.083727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.090241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.090712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.132597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:54:42.145009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquired lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:54:42.286348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:42.298894 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7acf10d8-cc27-4524-9448-132470366c97 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1327 microversion: 2.1 time: 0.357118 Oct 19 00:54:42.302777 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1224/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:41 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1327 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:42.307502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7c681b-0496-494f-88b0-35fa57feab0e", "name": "network-vif-plugged", "status": "completed", "tag": "1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:42.327764 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:42.338537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.339279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.339866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.354984 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] Creating event network-vif-plugged:1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b for instance 0b7c681b-0496-494f-88b0-35fa57feab0e on n-h1-master-1 Oct 19 00:54:42.362255 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-767ca70d-39bc-4c2b-917a-cdfea782a541 req-eb5b7022-7147-4d78-bc37-2ab581343d7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058085 Oct 19 00:54:42.363563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1225/2360] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:42.371568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:42.372361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:42.381887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.382897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.383587 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=14 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:42.383796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.385298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.386919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.387534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.416767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:42.540813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dce47079-bf90-4f48-ade2-34fae6d15185 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 204 len: 0 microversion: 2.1 time: 0.175253 Oct 19 00:54:42.542848 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1226/2361] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:42 2022] DELETE /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:42.551780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:42.553215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:42.559693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.560395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.561059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.561776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.562388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.563346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.944067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:42.955100 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa29080b-a29e-454e-9306-24e241ebe000 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1305 microversion: 2.1 time: 0.410104 Oct 19 00:54:42.956382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1227/2362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:42 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1305 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:42.962526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:42.965360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:42.974688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.975667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.976118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:42.977016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:42.977518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:42.978005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.016288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lazy-loading 'flavor' on Instance uuid b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:43.178033 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21f3b870-07e7-46e0-9468-e7a2e17db80a tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "POST /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7/action" status: 200 len: 32 microversion: 2.1 time: 0.220176 Oct 19 00:54:43.184277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1228/2363] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:54:42 2022] POST /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:54:43.192417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:43.193446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:43.202626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.203372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.204987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.207144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.208562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.209464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.755120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:43.767962 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c67d542d-321f-4ca7-82be-56317ee07b75 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1318 microversion: 2.1 time: 0.581444 Oct 19 00:54:43.768892 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1229/2364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:43 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:43.795950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:43.796979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:43.804663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.805325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.805769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.806663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.807250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.807811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.846559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:43.905720 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:43.967522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-214b0269-9ec5-44f1-b6dd-65581fda6d14 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 204 len: 0 microversion: 2.1 time: 0.197041 Oct 19 00:54:43.968891 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1230/2365] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:43 2022] DELETE /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:43.974806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:43.976883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:43.982340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.982852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.983289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:43.984127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:43.984589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:43.985921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:44.363371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:44.376592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:44.378132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:44.379331 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6ae5134-d015-41f1-8934-3c7062167196 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.408876 Oct 19 00:54:44.380237 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1231/2366] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:43 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:44.385935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:44.386720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:44.395786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:44.396178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:44.396935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:44.397864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:44.398351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:44.398783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:44.737528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:44.751488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b50861b0-db78-4be3-841a-e2927e9d9398 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.369533 Oct 19 00:54:44.752883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1232/2367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:44 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:44.758535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:44.759233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:44.774642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:44.775585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:44.776209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:44.777435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:44.778087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:44.778770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:45.005515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:54:45.140343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:45.167094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60c6c751-972d-4049-bb1a-6accb2e20ad5 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1327 microversion: 2.1 time: 0.412709 Oct 19 00:54:45.168208 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1233/2368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:44 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1327 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:45.174270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da83972a-c45f-441e-a375-73d8537ad69b", "tag": "46c19a31-2106-4a3d-9b0b-77b237cb94f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:45.193066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:45.193665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:45.194204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:45.229272 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] Creating event network-changed:46c19a31-2106-4a3d-9b0b-77b237cb94f5 for instance da83972a-c45f-441e-a375-73d8537ad69b on n-h2-master-1 Oct 19 00:54:45.241102 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9ed70a8b-8126-4ca7-a9d9-9ac9a6a3384e req-bb670412-8243-4c7f-8e0a-cc37320e925e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071339 Oct 19 00:54:45.242175 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1234/2369] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:45.249211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:45.250852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:45.259271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:45.260425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:45.261006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:45.261977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:45.262553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:45.263271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:45.651971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:45.667012 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18f2b6a7-67e3-4032-8f53-50a102f3b0ee tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 200 len: 1475 microversion: 2.1 time: 0.423318 Oct 19 00:54:45.668111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1235/2370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:45 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 1475 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:45.693712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:45.694393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:45.702119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:45.702875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:45.708349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:45.717583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:45.717583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:45.717583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.247461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:46.268439 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-655863c2-37f0-40fb-89f0-a3513874beb6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.581729 Oct 19 00:54:46.269196 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1236/2371] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:45 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:46.310551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:46.311970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:46.333499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.334263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.334905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.336184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.336936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.337596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.618629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Updating instance_info_cache with network_info: [{"id": "c21b2a02-fbf8-40d3-912d-9546093cec20", "address": "fa:16:3e:bd:79:72", "network": {"id": "7caf4a4c-b471-4e13-93bb-24ca2036a7b9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-292028227-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9868d1ede07c453e9a0cb24d0fcdd4df", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc21b2a02-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:54:46.635717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Releasing lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:54:46.640606 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dea27e19-b542-4897-9ee0-c6a81bea77d3 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action" status: 202 len: 0 microversion: 2.1 time: 4.589426 Oct 19 00:54:46.642171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1136/2372] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:54:42 2022] POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action => generated 0 bytes in 4592 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:54:46.649699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:46.665528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.666405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.667011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.697030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] Creating event network-changed:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:54:46.704502 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-42d05005-71e5-45dc-b363-25726f7894ae req-4421fd75-d2bd-4470-b6e6-b4a2689e300e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057258 Oct 19 00:54:46.706034 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1137/2373] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:46.711972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:46.712756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:46.728347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:46.732135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.732665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.733137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.733866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.734332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.735383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.739922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ca85c8a-30a5-46b8-8259-8e6736986b2a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1508 microversion: 2.1 time: 0.449592 Oct 19 00:54:46.757946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1237/2374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:46 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1508 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:46.777262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:46.777940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:46.787507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.787967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.788424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:46.789198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:46.789668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:46.790273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:47.881847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:47.896154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ff15689-ed84-4fbc-bcba-cbda109dd739 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 1.131077 Oct 19 00:54:47.897566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1238/2375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:46 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:47.905439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:47.909112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:47.927965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:47.928733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:47.929942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:47.931538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:47.933354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:47.933969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.061130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:48.075053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:48.079873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:48.094276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b90f4d7-3cdb-48c5-92a1-6359ed1d4f91 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 1.386629 Oct 19 00:54:48.095620 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1138/2376] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:46 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:48.100685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.151"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:48.516871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:48.558129 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-70770b77-1730-48f8-9ae7-ac55032b012d tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1327 microversion: 2.1 time: 0.658659 Oct 19 00:54:48.561279 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1239/2377] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:47 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1327 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:48.572080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:48.572743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: c32edf59-dcf2-4e71-b7f7-28ee0db9c80a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:48.593371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.594042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.594757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.595637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.598120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.598743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.643279 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a HTTP/1.1 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c32edf59-dcf2-4e71-b7f7-28ee0db9c80a'} Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:48.646166 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:48.650780 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a2110f6-56c9-491d-a8f8-4a3de436b8c1 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a" status: 404 len: 111 microversion: 2.1 time: 0.086826 Oct 19 00:54:48.655010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1240/2378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:48 2022] GET /compute/v2.1/servers/c32edf59-dcf2-4e71-b7f7-28ee0db9c80a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:48.667303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:48.668400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:48.682190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.683522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.686111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.690369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.691030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.693092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.744999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:48.754043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.754828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.755438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:48.756319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:48.756966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:48.757896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.207321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:49.226130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e2bca5f-3056-441a-89b2-9acb4c119647 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1508 microversion: 2.1 time: 0.564795 Oct 19 00:54:49.228989 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1241/2379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:48 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1508 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:49.235658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:49.235955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:49.257170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.257937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.258539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.259412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.260011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.260844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.588845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:54:49.589330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquired lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:54:49.695285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:49.713984 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2be7816c-f152-4785-9586-34b90249d8a4 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.483723 Oct 19 00:54:49.714718 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1242/2380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:49 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:49.723164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35151adf-1d29-46da-94bd-6b763b85c911", "name": "network-vif-unplugged", "status": "completed", "tag": "38fba665-c513-49b8-b120-100135193616"}, {"name": "network-changed", "server_uuid": "35151adf-1d29-46da-94bd-6b763b85c911", "tag": "38fba665-c513-49b8-b120-100135193616"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:49.759817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.760448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.761100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.790079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Creating event network-vif-unplugged:38fba665-c513-49b8-b120-100135193616 for instance 35151adf-1d29-46da-94bd-6b763b85c911 on n-h1-master-1 Oct 19 00:54:49.790605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] Creating event network-changed:38fba665-c513-49b8-b120-100135193616 for instance 35151adf-1d29-46da-94bd-6b763b85c911 on n-h1-master-1 Oct 19 00:54:49.809598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9fb6fa19-ef8e-4fb2-8c9f-71c2cd6cd63b req-eec8dbd5-63d7-47d8-a897-e9f680e178e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.089895 Oct 19 00:54:49.814956 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1243/2381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:49.833906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:49.834798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:49.842247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.843157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.843831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.844865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.845595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.846259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.902538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:49.903323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:49.904385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:49.905431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lazy-loading 'fault' on Instance uuid d7a82de8-3025-495c-b4a1-3173250c497f {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:49.969803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:49.981388 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e2e6d15-bc9f-4079-993f-5d0455a3af18 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 200 len: 1309 microversion: 2.1 time: 0.161366 Oct 19 00:54:49.982587 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1244/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:49 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:49.988385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c32edf59-dcf2-4e71-b7f7-28ee0db9c80a", "name": "network-vif-deleted", "tag": "453af2ef-4c55-4f45-862a-bc3d831666f7"}, {"server_uuid": "d7a82de8-3025-495c-b4a1-3173250c497f", "name": "network-vif-deleted", "tag": "687bb940-b707-4221-ac61-c58dafaa2e14"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:50.003152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.003783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.011466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.030218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Creating event network-vif-deleted:453af2ef-4c55-4f45-862a-bc3d831666f7 for instance c32edf59-dcf2-4e71-b7f7-28ee0db9c80a on n-h2-master-1 Oct 19 00:54:50.030655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] Creating event network-vif-deleted:687bb940-b707-4221-ac61-c58dafaa2e14 for instance d7a82de8-3025-495c-b4a1-3173250c497f on n-h1-master-1 Oct 19 00:54:50.040576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ef84bb85-125b-42fc-858b-6e07ceb7e7ee req-2eb2bbc3-77ad-421a-a826-1a9b1d318acb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056640 Oct 19 00:54:50.041357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1245/2383] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:50.056481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:50.057340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:50.064480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.064995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.065433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.066201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.066731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.067156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.434481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:50.447398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cbce46c9-49eb-4081-b586-3287095ac6de tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.404743 Oct 19 00:54:50.462099 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1246/2384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:50 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:50.477076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:50.478020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:50.486765 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:50.488230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.493106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.494329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.495183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.495917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.496846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.877237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:50.896321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:50.899972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:50.901890 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e6908fc-95c7-4ecb-b57e-4330d758f93f tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.438188 Oct 19 00:54:50.903810 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1247/2385] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:50 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:50.910437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:50.916332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:50.926390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.927570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.928646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:50.929605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:50.930301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:50.931711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:51.049129 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:51.056833 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3a47173-8a98-4db2-9882-09adeddc8dc1 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1080 microversion: 2.1 time: 0.151095 Oct 19 00:54:51.071962 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1248/2386] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:54:50 2022] PUT /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1080 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:51.077649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:51.077855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:51.084829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:51.085333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:51.085781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:51.086500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:51.086957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:51.087393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:51.341629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:54:51.835814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:51.851365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f1c1158-828a-4a34-8229-7391f3b14ad1 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1327 microversion: 2.1 time: 0.778168 Oct 19 00:54:51.851978 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1249/2387] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:51 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1327 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:51.856792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:51.857590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:51.864668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:51.865353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:51.865982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:51.866869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:51.867486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:51.868079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.376835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:52.386168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4342d3b9-e463-4114-bb57-64b4b715c71f tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.532841 Oct 19 00:54:52.386782 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1250/2388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:51 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:52.392506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:52.393164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: d7a82de8-3025-495c-b4a1-3173250c497f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:52.413352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.425338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.426095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.427278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.429888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.431212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.454782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f HTTP/1.1 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd7a82de8-3025-495c-b4a1-3173250c497f'} Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:52.458846 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. Oct 19 00:54:52.462554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:52.464484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance d7a82de8-3025-495c-b4a1-3173250c497f could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:52.465631 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc6da371-0cdf-49f3-8d59-8b0145197f3c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f" status: 404 len: 111 microversion: 2.1 time: 0.077914 Oct 19 00:54:52.466787 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1251/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:52 2022] GET /compute/v2.1/servers/d7a82de8-3025-495c-b4a1-3173250c497f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:52.477293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:52.478399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:52.490027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.490794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.491344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.492180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.492896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.493546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.877629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:52.889083 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8acbf8b2-dab3-49b3-9dfb-e1c16ff54d8c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1506 microversion: 2.1 time: 0.420934 Oct 19 00:54:52.889706 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1252/2390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:52 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:52.900901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:52.901538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:52.917154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.917880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.918502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:52.919831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:52.921814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:52.924036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.090084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Updating instance_info_cache with network_info: [{"id": "c21b2a02-fbf8-40d3-912d-9546093cec20", "address": "fa:16:3e:bd:79:72", "network": {"id": "7caf4a4c-b471-4e13-93bb-24ca2036a7b9", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-292028227-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "9868d1ede07c453e9a0cb24d0fcdd4df", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc21b2a02-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:54:53.111290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Releasing lock "refresh_cache-c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:54:53.112514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35a1cd00-1a5e-4b48-ba0b-56b6244c4cca tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action" status: 202 len: 0 microversion: 2.1 time: 5.015625 Oct 19 00:54:53.114665 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1139/2391] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:54:48 2022] POST /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94/action => generated 0 bytes in 5018 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:54:53.119887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.120814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:53.130323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.131209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.131881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.133820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.134462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.135117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.138880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.148609 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa0846d7-bf9d-40e7-869c-e4b3092d615c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.257811 Oct 19 00:54:53.150488 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1253/2392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:52 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:53.156121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:53.167274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.168133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.168872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.193083 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] Creating event network-changed:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:54:53.199000 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-926f7179-6abc-47e5-a89b-0197e2d186b2 req-f2e91762-e571-4873-a5ab-51bbf46cbfca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046739 Oct 19 00:54:53.200443 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1254/2393] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:53.206562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43b23a0a-c8ec-4e5c-ad82-8fde739991ec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.243602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43b23a0a-c8ec-4e5c-ad82-8fde739991ec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/2f70bd14-fda0-4715-8a9a-a52577a20a4f" status: 204 len: 0 microversion: 2.1 time: 0.041575 Oct 19 00:54:53.245325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1255/2394] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:54:53 2022] DELETE /compute/v2.1/os-server-groups/2f70bd14-fda0-4715-8a9a-a52577a20a4f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:53.254373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da83972a-c45f-441e-a375-73d8537ad69b", "name": "network-vif-plugged", "status": "completed", "tag": "46c19a31-2106-4a3d-9b0b-77b237cb94f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:53.269216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.270281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.271338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.289310 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] Creating event network-vif-plugged:46c19a31-2106-4a3d-9b0b-77b237cb94f5 for instance da83972a-c45f-441e-a375-73d8537ad69b on n-h2-master-1 Oct 19 00:54:53.294970 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-11bd4d00-9d8d-4bc8-a765-79e64063d279 req-40c12c8c-e2ca-4497-836b-a28b0e01b86f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045333 Oct 19 00:54:53.295684 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1256/2395] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:53.302442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.303449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:53.312726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.313488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.314163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.315743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.316444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.317116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.362699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.389349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.392590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.394249 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3be74afa-2970-408a-84cc-8001ee40667b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.278353 Oct 19 00:54:53.419831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1140/2396] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:53 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:53.441842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.443133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:53.452974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.455083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.456322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.457560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.459295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.460084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.689376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.702810 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7ffbb1e-163a-418d-a714-31c5b3c49450 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1327 microversion: 2.1 time: 0.405213 Oct 19 00:54:53.704606 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1257/2397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:53 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1327 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:53.715752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55e732cc-df79-4302-8b22-18edb7fcba5d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '.version_select at 0x7f2af93d3dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.801260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:53.817875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a3384ad-9bf8-4e7f-913c-10c7279df3ae tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1506 microversion: 2.1 time: 0.396566 Oct 19 00:54:53.818663 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1141/2398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:53 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:53.823947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.824709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:53.831739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.832238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.832710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.833430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.833895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.834368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.866097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:53.960829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3344f74-b357-4eb1-a57e-bc743549b6c8 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 204 len: 0 microversion: 2.1 time: 0.140670 Oct 19 00:54:53.962148 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1142/2399] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:53 2022] DELETE /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:53.970125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:53.970860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:53.977445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.977951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.978463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:53.979189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:53.979652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:53.980317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.305855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:54.315471 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-986daff4-7326-476a-9d3a-361502dea812 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.352044 Oct 19 00:54:54.316177 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1143/2400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:53 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:54.321230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:54.324268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:54.334151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.334701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.335231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.336014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.336537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.337120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.423080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b2aebcb-3bba-4df0-b4dc-2bc3828466a8 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1082 microversion: 2.1 time: 0.104472 Oct 19 00:54:54.423726 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1144/2401] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:54:54 2022] PUT /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1082 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:54.435929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:54.436858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:54.446430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.448230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.448985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.449909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.450370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.450832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.481970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:54.535315 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=5,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:54.575076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37828ff4-c481-4892-9443-2ea2593826cc tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 204 len: 0 microversion: 2.1 time: 0.149720 Oct 19 00:54:54.576030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1145/2402] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:54 2022] DELETE /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:54.582460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:54.583296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:54.591017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.591801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.592423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.593369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.594718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.595366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.909294 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55e732cc-df79-4302-8b22-18edb7fcba5d tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/c74736f2-30aa-483b-8ed0-355de441bc93" status: 202 len: 0 microversion: 2.1 time: 1.203184 Oct 19 00:54:54.911096 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1258/2403] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:54:53 2022] DELETE /compute/v2.1/os-floating-ips/c74736f2-30aa-483b-8ed0-355de441bc93 => generated 0 bytes in 1205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:54:54.920201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:54.921370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:54.926872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:54.930383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.930883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.931663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.932810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.933437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.934111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.936453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a53a622-2f49-468c-b20c-5d98cdb2a4a5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.358826 Oct 19 00:54:54.937161 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1146/2404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:54 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:54.943468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:54.944245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:54.950937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.951692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.952329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:54.953271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:54.954576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:54.955233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.166605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.170381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.178870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.179174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f7f3588c-175b-4d4a-8381-51262a87399c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1508 microversion: 2.1 time: 0.239430 Oct 19 00:54:55.179755 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1147/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:54 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:55.193260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.193260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:55.193260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.193260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.193619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.194183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.194575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.195001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.201708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.203430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a803299-0d58-461a-a18c-16eca5f6645c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1486 microversion: 2.25 time: 0.290341 Oct 19 00:54:55.204029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1259/2406] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:54 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1486 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:55.219555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.220790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:55.230337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.231104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.232533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.233432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.233961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.234402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.551868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.554279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.569062 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85adca3d-f603-4028-bd3b-12ad59eb0a65 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1473 microversion: 2.1 time: 0.388206 Oct 19 00:54:55.571999 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-56912b30-ec1a-4189-aa79-376e8e594235 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1527 microversion: 2.1 time: 0.359928 Oct 19 00:54:55.588883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1260/2407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:55 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1527 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:55.589083 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1148/2408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:55 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1473 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:55.589198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38a252a1-1108-4282-8241-3ff16e6dbdbc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '.version_select at 0x7f2af4f2c940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.589279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.589279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:55.599831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.600424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.601207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.602204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.602826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.603421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.858604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:55.870460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-716cdbe7-e8fe-4a94-a04f-3d01fa035d44 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1508 microversion: 2.1 time: 0.292204 Oct 19 00:54:55.871987 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1149/2409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:55 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:55.889604 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38a252a1-1108-4282-8241-3ff16e6dbdbc tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c4b21518-a61f-44c1-92c2-95aa450b9da4" status: 202 len: 0 microversion: 2.1 time: 0.314223 Oct 19 00:54:55.893212 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1261/2410] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:54:55 2022] DELETE /compute/v2.1/os-security-groups/c4b21518-a61f-44c1-92c2-95aa450b9da4 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:54:55.902698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c74d8ba-3f10-4092-9af2-8e81b6ae8476", "name": "network-vif-plugged", "status": "completed", "tag": "c5e1fc2d-c598-47ee-b664-93a8f4c3812c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:55.909642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.911484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:55.931292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.936414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.936765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.937416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.938728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.939585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.940182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.940745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.945220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.967087 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] Creating event network-vif-plugged:c5e1fc2d-c598-47ee-b664-93a8f4c3812c for instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 on n-h1-master-1 Oct 19 00:54:55.972922 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c6b2a999-d074-4799-8572-0eaa2da0048e req-a0869e31-54b7-4769-ac38-023d4f32e3a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099380 Oct 19 00:54:55.978257 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1150/2411] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:54:55.984189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:55.985226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:55.987271 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:55.993845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.995039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.995483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:55.996192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:55.996684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:55.997115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.197767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.208181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd267215-4d1e-4e25-93b4-a29d027ef089 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.311971 Oct 19 00:54:56.208810 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1262/2412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:55 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:56.212520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.214746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.215544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.222913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.223741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.224590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.225450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.225979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.226486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.241754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0977bbd6-f8bc-490c-b6fc-b7a2e5171770 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1527 microversion: 2.1 time: 0.261179 Oct 19 00:54:56.256774 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1151/2413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:55 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1527 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:56.256968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.257855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.259396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:56.270520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.270997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.271443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.272422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.272824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.274014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.304981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:56.359307 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbebe1ae-31d6-4c6b-8bc2-00972b2f9269 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 204 len: 0 microversion: 2.1 time: 0.149007 Oct 19 00:54:56.359978 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1263/2414] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:56 2022] DELETE /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:56.365357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.366216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.374872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.375456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.376000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.376902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.377499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.377922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.418070 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85ede168-f722-4871-83d1-af395c577896 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 204 len: 0 microversion: 2.1 time: 0.172132 Oct 19 00:54:56.419187 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1152/2415] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:56 2022] DELETE /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:56.426238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.427006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.435700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.436568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.437253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.439264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.439932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.440541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.625049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.638156 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b5a5e2a-99d8-4c52-9c79-e980951e2901 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.276904 Oct 19 00:54:56.639080 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1264/2416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:56 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:56.653808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.671459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.673599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:56.675142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49eeb8cd-b8b5-4d87-ae81-5bc9c82fe5be tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1476 microversion: 2.25 time: 0.254096 Oct 19 00:54:56.676374 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1153/2417] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:56 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1476 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:56.691163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.691940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.703449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.705008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.705654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.706543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.707388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.708020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.752694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:56.827552 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Instance is already in deleting state, ignoring this request Oct 19 00:54:56.829800 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6675d929-9d19-4a0c-a664-286c800f1209 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 204 len: 0 microversion: 2.1 time: 0.151678 Oct 19 00:54:56.830963 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1154/2418] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:56 2022] DELETE /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:56.836749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.838175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.845231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.846071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.846828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.847773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.848452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.849114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.910313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.911545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.919499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.920205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.920837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.923163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.923845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.924442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.945112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] HTTP exception thrown: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Request method failure captured: Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b HTTP/1.1 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0rEVyYvzoWz8JKOx6YOBbTKdZxOEFrTf_HNIismVes5HQAeWzG-kB7daOnke_6eyT7tJItcfr4tVUxu48QrYFh2WE7fGdHUGmAd1_53HI5HolAqTAkQq1E3JnvjBgUCmB6n4pJnBFcjMgb2QgWj81QsbQCg_E9VnQz4qAZchhdpJpg Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f7f8e91f5c3a4069b89f5982180cc085 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7f8e91f5c3a4069b89f5982180cc085", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7f8e91f5c3a4069b89f5982180cc085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7f8e91f5c3a4069b89f5982180cc085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7f8e91f5c3a4069b89f5982180cc085"}]}] Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f7f8e91f5c3a4069b89f5982180cc085 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1391481863-project Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9c74540f9b343618e9989940a802d41 Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863-project Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: exception: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'da83972a-c45f-441e-a375-73d8537ad69b'} Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:56.947238 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Returning 404 to user: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:56.952130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f387dcc1-ca2d-49fd-824c-8b6421e5d9c0 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 404 len: 111 microversion: 2.1 time: 0.308321 Oct 19 00:54:56.955341 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1265/2419] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:56 2022] DELETE /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 111 bytes in 315 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:56.960397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:56.961254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:56.967970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.968732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.969366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:56.970245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:56.970846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:56.971418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.026703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:57.037416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3278d25-f921-49c6-ae76-ff645458be94 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1509 microversion: 2.1 time: 0.205151 Oct 19 00:54:57.038311 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1155/2420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:56 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:57.046369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67d768c5-15a8-466c-95ab-00bab0f2a571 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '.version_select at 0x7f2af4cb8430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.053641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67d768c5-15a8-466c-95ab-00bab0f2a571 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.054313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67d768c5-15a8-466c-95ab-00bab0f2a571 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.054963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67d768c5-15a8-466c-95ab-00bab0f2a571 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.067803 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67d768c5-15a8-466c-95ab-00bab0f2a571 tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.028283 Oct 19 00:54:57.069080 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1156/2421] 10.222.0.27 () {60 vars in 1184 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:57.075345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.076180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.085685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.086429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.086870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.088652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.089331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.091308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.210504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:57.219651 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d4fd431e-3999-4960-835b-5e8d04179265 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1473 microversion: 2.1 time: 0.262399 Oct 19 00:54:57.220600 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1266/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:56 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1473 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:57.227323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.228251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.237931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.239573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.240119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.241488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.242152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.242644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.334511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:57.344911 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d4be8a3-fd4a-4a72-9fd0-ac69a4b8bf6b tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1514 microversion: 2.1 time: 0.273228 Oct 19 00:54:57.360757 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1157/2423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1514 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:57.360757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.360757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.360757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.360757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.361415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.362214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.363106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.363565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.472824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:57.486701 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6533e900-7134-4ee0-80af-ea5c8735408b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1527 microversion: 2.1 time: 0.258975 Oct 19 00:54:57.511944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1267/2424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1527 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:57.519892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.526737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.534718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.535558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.536148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.540525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.541260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.541639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.558157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] Lazy-loading 'services' on Instance uuid 35151adf-1d29-46da-94bd-6b763b85c911 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:54:57.572193 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cce8c779-cfa8-4bff-abce-a0aaf31cdefd tempest-LiveAutoBlockMigrationV225Test-659283215 tempest-LiveAutoBlockMigrationV225Test-659283215-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1968 microversion: 2.25 time: 0.225104 Oct 19 00:54:57.573090 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1158/2425] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1968 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:57.578362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Action: 'update', calling method: >, body: {"server": {"name": "da83972a-c45f-441e-a375-73d8537ad69b_new"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:54:57.581291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.587978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.588827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.589639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.590577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.591260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.591915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.626951 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] HTTP exception thrown: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Request method failure captured: Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b HTTP/1.1 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 64 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0rEVyYvzoWz8JKOx6YOBbTKdZxOEFrTf_HNIismVes5HQAeWzG-kB7daOnke_6eyT7tJItcfr4tVUxu48QrYFh2WE7fGdHUGmAd1_53HI5HolAqTAkQq1E3JnvjBgUCmB6n4pJnBFcjMgb2QgWj81QsbQCg_E9VnQz4qAZchhdpJpg Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f7f8e91f5c3a4069b89f5982180cc085 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f7f8e91f5c3a4069b89f5982180cc085", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7f8e91f5c3a4069b89f5982180cc085"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f7f8e91f5c3a4069b89f5982180cc085"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f7f8e91f5c3a4069b89f5982180cc085"}]}] Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f7f8e91f5c3a4069b89f5982180cc085 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1391481863-project Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9c74540f9b343618e9989940a802d41 Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1391481863-project Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "da83972a-c45f-441e-a375-73d8537ad69b_new"}} Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: exception: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'da83972a-c45f-441e-a375-73d8537ad69b', 'body': {'server': {'name': 'da83972a-c45f-441e-a375-73d8537ad69b_new'}}} Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:54:57.629968 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] Returning 404 to user: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28154c9b-84b5-4d72-a4b0-1f42e12c5897 tempest-ServersNegativeTestMultiTenantJSON-1391481863 tempest-ServersNegativeTestMultiTenantJSON-1391481863-project] 10.222.0.27 "PUT /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 404 len: 111 microversion: 2.1 time: 0.057203 Oct 19 00:54:57.633403 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1159/2426] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:54:57 2022] PUT /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:54:57.637509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.638922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.646890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.647678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.648131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.648890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.649509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.649954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.685042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:57.690144 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:57.729454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:57.744200 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7fdb17b7-d6e3-41b8-8c5d-ca365ca7bbfb tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.231427 Oct 19 00:54:57.745417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1268/2427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:57.751082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.751891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.759038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.759816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.760570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.761467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.762145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.762913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.785271 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:54:57.801674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:54:57.807119 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5f8abb6f-50d7-47a4-a64a-92bd6b378746 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 204 len: 0 microversion: 2.25 time: 0.173343 Oct 19 00:54:57.807709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1160/2428] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:54:57 2022] DELETE /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:54:57.814640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.815381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.822627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.823124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.823566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.824677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.825335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.825772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.895688 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6697281d-431c-4e86-b2ef-e90bc52649c2 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 204 len: 0 microversion: 2.1 time: 0.149114 Oct 19 00:54:57.896879 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1269/2429] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:54:57 2022] DELETE /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:54:57.905333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:57.906070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:57.913330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.914767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.915408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:57.916337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:57.918633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:57.919495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.000647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.008983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-74f8605a-5cd7-4a51-bb28-75c4ff7fd256 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.199667 Oct 19 00:54:58.009836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1161/2430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:58.015451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:58.017347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:58.025634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.027207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.027685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.028541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.029053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.029498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.133698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.144889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.147162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.148733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e41d423-ee6c-4acb-b3b5-00f40a4abdf6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1482 microversion: 2.25 time: 0.247707 Oct 19 00:54:58.149658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1270/2431] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:57 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1482 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:54:58.154667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:58.155291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:58.163549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.164363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.165034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.166238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.170037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.171066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.219890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.230228 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46ddb04d-4721-4152-b8f1-6ba4313851de tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1533 microversion: 2.1 time: 0.218658 Oct 19 00:54:58.230872 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1162/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:58 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1533 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:58.251715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:58.252500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:58.261473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.261977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.263267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.263620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.264657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.265299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.467995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:58.483781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6bb688f8-03b3-4cfe-9d2b-a088f36f9450 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1509 microversion: 2.1 time: 0.330052 Oct 19 00:54:58.506318 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1271/2433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:58 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:58.516752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:58.517903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:58.535120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.536357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.538555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:58.542624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:58.543122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:58.543686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.142404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:59.158467 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b1f7781-4b83-4520-8a40-0a305d48920c tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1473 microversion: 2.1 time: 0.911165 Oct 19 00:54:59.164884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1163/2434] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:58 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1473 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:54:59.172305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:59.173965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:59.197005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.197802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.199024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.200454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.201077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.204237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.304514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:59.313472 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-edfb18ec-c63e-4a71-b030-04df6635df2c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1514 microversion: 2.1 time: 0.805845 Oct 19 00:54:59.314618 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1272/2435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:58 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1514 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:59.321758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:59.322963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:59.332315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.333059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.333646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.334540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.335145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.335713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.810816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:59.819941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:54:59.838357 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e9115c6-95f5-46fd-bf04-8f85f19b34b7 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1293 microversion: 2.1 time: 0.670093 Oct 19 00:54:59.840752 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1164/2436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:59 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1293 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:59.842574 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f088cf1c-da92-4d27-8703-45be8dc16872 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.526180 Oct 19 00:54:59.847252 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1273/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:59 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:54:59.853019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:59.853908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:59.855095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:54:59.857720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:54:59.871384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.888434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.892928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.894429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.895899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.896352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.897246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.898784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:54:59.900016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.901316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:54:59.902526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:54:59.903196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.430715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.438243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-90eeff44-1931-4405-8efa-569aca81664b tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1533 microversion: 2.1 time: 0.588928 Oct 19 00:55:00.439765 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1274/2438] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:54:59 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1533 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:00.445219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:00.446079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:00.452828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.454175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.454797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.455698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.456319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.456938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.599370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.616850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.618779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.625985 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03e2f94d-291b-4ea6-94c8-acd282513017 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1482 microversion: 2.25 time: 0.782278 Oct 19 00:55:00.627239 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1165/2439] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:54:59 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1482 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:00.633972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c7163f-af4b-459d-9159-5d9113442701", "name": "network-vif-deleted", "tag": "945afe1c-8c35-4a40-b299-044ef48d3d88"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:00.654217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.654837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.655376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.671141 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] Creating event network-vif-deleted:945afe1c-8c35-4a40-b299-044ef48d3d88 for instance f4c7163f-af4b-459d-9159-5d9113442701 on n-h1-master-1 Oct 19 00:55:00.678448 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f71df147-b959-464b-96bd-48374abf2785 req-2a6743bc-bb03-4665-9920-89ddd7e97b04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049592 Oct 19 00:55:00.679655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1166/2440] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:00.686506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:00.687657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:00.696688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.697564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.698252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.699966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.700886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.701702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.745166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.745943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.746595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.747219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lazy-loading 'fault' on Instance uuid f4c7163f-af4b-459d-9159-5d9113442701 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:55:00.887039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.890017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:00.901568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4edd0db5-a8e1-4595-bb90-7a5da9d9795f tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1509 microversion: 2.1 time: 0.460140 Oct 19 00:55:00.908645 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1275/2441] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:00 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1509 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:00.913849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:00.925817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:00.932740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.933539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.934163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.935035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:00.943638 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e29cc3a1-d4cc-492c-810a-2236ed3bee32 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 200 len: 1308 microversion: 2.1 time: 0.261365 Oct 19 00:55:00.944649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:00.945279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:00.946049 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1167/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:00 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:00.985736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:00.989164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:01.005642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.006729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.007410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.008435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.009819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.010470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.014298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.014789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.015228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.015734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lazy-loading 'fault' on Instance uuid 0b7c681b-0496-494f-88b0-35fa57feab0e {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:55:01.250910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2542aef0e4464018bf9d4563ffe9030d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3642cd3632604ea8aa75cf14c9fef293', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:01.264430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b5a0962-d6d8-4af9-97f3-2de737fc592c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 200 len: 1308 microversion: 2.1 time: 0.354261 Oct 19 00:55:01.265406 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1276/2443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:00 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:01.279887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:01.280805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:01.295280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.296335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.309577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.310648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.311278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.311865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.642362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:01.655898 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ddad0af-f38f-4090-8975-9b60dc7a4bde tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1484 microversion: 2.1 time: 0.687493 Oct 19 00:55:01.664094 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1168/2444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:00 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1484 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:01.682540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8224761-768d-4fa3-b5d1-cf77735a2be0", "name": "network-vif-deleted", "tag": "021e3676-581e-4552-bd2b-40731b3f0b37"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:01.713787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.714307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.714762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.746147 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] Creating event network-vif-deleted:021e3676-581e-4552-bd2b-40731b3f0b37 for instance f8224761-768d-4fa3-b5d1-cf77735a2be0 on n-h1-master-1 Oct 19 00:55:01.758782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1d6f50f9-341f-4ee9-945d-45810f20856d req-df772a8b-bc48-4fa3-a31c-e15c36c09d16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091885 Oct 19 00:55:01.760196 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1169/2445] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:01.772884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:01.774105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:01.784223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.785960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:01.786561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.788521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.790496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.791152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.792065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.812424 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0511334c-2e1c-490b-8fd0-3f9f00d6a263 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.540311 Oct 19 00:55:01.815466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1277/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:01 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:01.835726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:01.836754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:01.881743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.900649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.902577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:01.903610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:01.907269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:01.908708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:02.341619 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:02.355460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-642c196e-81f7-4b90-b23c-3e6b8eb8b44a tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1533 microversion: 2.1 time: 0.593242 Oct 19 00:55:02.359595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1170/2447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:01 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1533 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:02.368133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:02.373216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:02.415805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:02.416604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:02.417182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:02.419939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:02.421621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:02.426851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:02.917216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:02.938650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:02.941053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:02.943074 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c263f7e9-9788-4808-8ff8-e1d78ecdba76 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1482 microversion: 2.25 time: 1.123748 Oct 19 00:55:02.944139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1278/2448] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:01 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1482 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:02.950423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:02.951313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:02.962692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:02.967738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:02.972241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:02.976082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:02.977207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:02.977831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:02.980185 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29bb56e8-e940-4dca-977f-a3de99eea1c1 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.619089 Oct 19 00:55:02.981339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1171/2449] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:55:02 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476/os-interface => generated 284 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:02.994595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:02.995652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f4c7163f-af4b-459d-9159-5d9113442701] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.012672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.013360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.014104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.014994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.016171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.018765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.054001 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 HTTP/1.1 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: exception: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f4c7163f-af4b-459d-9159-5d9113442701'} Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.055989 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. Oct 19 00:55:03.060726 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.062182 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance f4c7163f-af4b-459d-9159-5d9113442701 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:03.065442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8429f74-1280-4ba3-8e6a-4481a27a68e5 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701" status: 404 len: 111 microversion: 2.1 time: 0.074729 Oct 19 00:55:03.074067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1172/2450] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:02 2022] GET /compute/v2.1/servers/f4c7163f-af4b-459d-9159-5d9113442701 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:03.080172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:03.081036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 0b7c681b-0496-494f-88b0-35fa57feab0e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.088060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.088869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.089500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.090551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.091173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.091764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.123516 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] HTTP exception thrown: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Request method failure captured: Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e HTTP/1.1 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0ook52GF5mwdQYOg9l0vkJf9yS1QpU6MAra3La_hqsXt70Xq_4CnjuS5XxOBQvV8MVZRl6mBjsT2EghwIWRjlP4JEw2drIW-IbhgRv0wdGP3MF48koevpTbdOmr_uCAoesJfzT9z9d14ZFe0-FqGuDvhVkIJuHS17RTA5azcQiu064 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3642cd3632604ea8aa75cf14c9fef293", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}] Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2542aef0e4464018bf9d4563ffe9030d Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0b7c681b-0496-494f-88b0-35fa57feab0e'} Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.125643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. Oct 19 00:55:03.130131 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.130611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Returning 404 to user: Instance 0b7c681b-0496-494f-88b0-35fa57feab0e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:03.131423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78265da1-4884-4d34-ac3f-7b2451fd421c tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e" status: 404 len: 111 microversion: 2.1 time: 0.056133 Oct 19 00:55:03.146347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.146853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.153203 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1173/2451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:03 2022] GET /compute/v2.1/servers/0b7c681b-0496-494f-88b0-35fa57feab0e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:03.155471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.159308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lazy-loading 'fault' on Instance uuid c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:55:03.160172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7c681b-0496-494f-88b0-35fa57feab0e", "name": "network-vif-deleted", "tag": "1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b"}, {"server_uuid": "c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94", "name": "network-vif-deleted", "tag": "c21b2a02-fbf8-40d3-912d-9546093cec20"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:03.216566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.218976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.219681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.269852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Creating event network-vif-deleted:1a772c8f-2548-4ff6-bf4e-0dea27d8cb2b for instance 0b7c681b-0496-494f-88b0-35fa57feab0e on n-h1-master-1 Oct 19 00:55:03.271852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] Creating event network-vif-deleted:c21b2a02-fbf8-40d3-912d-9546093cec20 for instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 on n-h2-master-1 Oct 19 00:55:03.298960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-441f1143-7804-41ed-9caa-c19a76a54c73 req-9ac9c58b-c692-47d1-8546-8247a66faa15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144171 Oct 19 00:55:03.306043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1174/2452] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:03.321126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:03.322131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.349480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.353747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.361405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.365420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.366207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.369793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.674377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eaebe4f02ee4634b92407e4e066beab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9868d1ede07c453e9a0cb24d0fcdd4df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:03.684248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f22d5b0e-4bda-42a3-b7fc-0b9c31a771a0 tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 200 len: 1312 microversion: 2.1 time: 0.738734 Oct 19 00:55:03.685461 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1279/2453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:02 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 1312 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:03.691936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:03.692865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: f8224761-768d-4fa3-b5d1-cf77735a2be0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.702688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.704127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.706490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.708012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.708762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.710860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.735597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 HTTP/1.1 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f8224761-768d-4fa3-b5d1-cf77735a2be0'} Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.738475 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. Oct 19 00:55:03.742189 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.757389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance f8224761-768d-4fa3-b5d1-cf77735a2be0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:03.759896 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e77210f-fbb5-432a-b880-0fa4aac4104f tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0" status: 404 len: 111 microversion: 2.1 time: 0.072917 Oct 19 00:55:03.761153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1280/2454] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:03 2022] GET /compute/v2.1/servers/f8224761-768d-4fa3-b5d1-cf77735a2be0 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:03.767028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:03.767840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.782114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.783068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.783766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.784863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.785584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.786297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.811431 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] HTTP exception thrown: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Request method failure captured: Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 HTTP/1.1 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ook52GF5mwdQYOg9l0vkJf9yS1QpU6MAra3La_hqsXt70Xq_4CnjuS5XxOBQvV8MVZRl6mBjsT2EghwIWRjlP4JEw2drIW-IbhgRv0wdGP3MF48koevpTbdOmr_uCAoesJfzT9z9d14ZFe0-FqGuDvhVkIJuHS17RTA5azcQiu064 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3642cd3632604ea8aa75cf14c9fef293", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}] Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2542aef0e4464018bf9d4563ffe9030d Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62'} Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:03.814660 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Returning 404 to user: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:03.819026 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5dd7c4f1-234e-4da5-88bf-b099e1a4ef55 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 404 len: 111 microversion: 2.1 time: 0.054497 Oct 19 00:55:03.820938 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1281/2455] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:55:03 2022] DELETE /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:03.835936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:03.837155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:03.847908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.849873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.851217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.852184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:03.853023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:03.853817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:03.869796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:03.893826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8870f415-4208-4570-bfac-06ccb5017254 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.585307 Oct 19 00:55:03.898029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1175/2456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:03 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:03.922542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-beb0acdf-6486-4f41-8cdf-0c5484ce4cfa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.002118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-beb0acdf-6486-4f41-8cdf-0c5484ce4cfa tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/0a27359a-4e9d-4bdb-93f8-63338d196704" status: 204 len: 0 microversion: 2.1 time: 0.094275 Oct 19 00:55:04.006726 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1176/2457] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:55:03 2022] DELETE /compute/v2.1/os-server-groups/0a27359a-4e9d-4bdb-93f8-63338d196704 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:04.018205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da83972a-c45f-441e-a375-73d8537ad69b", "name": "network-vif-deleted", "tag": "46c19a31-2106-4a3d-9b0b-77b237cb94f5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:04.022745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81208ae8f64a04bd49c018d7bf5c13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37640d2d06604d02b384e5a2625b69e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:04.033414 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2f7487a-2565-483d-abce-7858e7443436 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 200 len: 1491 microversion: 2.1 time: 0.211399 Oct 19 00:55:04.040066 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1282/2458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:03 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 1491 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:04.045483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.046217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.046924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.048457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.049121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:04.075601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.076924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.077704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.079897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.080541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.083563 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] Creating event network-vif-deleted:46c19a31-2106-4a3d-9b0b-77b237cb94f5 for instance da83972a-c45f-441e-a375-73d8537ad69b on n-h2-master-1 Oct 19 00:55:04.085811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.113486 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c3085650-abf3-4382-9298-3332c750d8fb req-b53bb5c4-5f0d-4ad4-a9c7-a314b8a3eb71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105804 Oct 19 00:55:04.114708 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1177/2459] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:04.132999 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] HTTP exception thrown: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Request method failure captured: Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 HTTP/1.1 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ook52GF5mwdQYOg9l0vkJf9yS1QpU6MAra3La_hqsXt70Xq_4CnjuS5XxOBQvV8MVZRl6mBjsT2EghwIWRjlP4JEw2drIW-IbhgRv0wdGP3MF48koevpTbdOmr_uCAoesJfzT9z9d14ZFe0-FqGuDvhVkIJuHS17RTA5azcQiu064 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3642cd3632604ea8aa75cf14c9fef293", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}] Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2542aef0e4464018bf9d4563ffe9030d Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62'} Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:04.135589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. Oct 19 00:55:04.141223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.142530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Returning 404 to user: Instance 12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:04.144573 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-962fbdfb-a9b9-442b-af0e-e5c5e3f295a2 tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62" status: 404 len: 111 microversion: 2.1 time: 0.103160 Oct 19 00:55:04.145209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.146104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:04.152986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.153966 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1283/2460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:04 2022] GET /compute/v2.1/servers/12a1a0e2-4ec5-4695-a1f5-ba0b9ae34d62 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:04.154173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.154766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.155652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.156943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.157535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.167599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.173475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:04.186252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.188345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.193523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.194688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.195316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.195922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.255026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:55:04.308638 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:04.399694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87cabcc1-1e48-4000-81e3-d1250833decb tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "DELETE /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 204 len: 0 microversion: 2.1 time: 0.240271 Oct 19 00:55:04.407291 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1284/2461] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:55:04 2022] DELETE /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:04.414655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.415799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:04.423363 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:04.426031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.426618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.427291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.430434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.430434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.430434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.453217 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] HTTP exception thrown: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Request method failure captured: Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d HTTP/1.1 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ook52GF5mwdQYOg9l0vkJf9yS1QpU6MAra3La_hqsXt70Xq_4CnjuS5XxOBQvV8MVZRl6mBjsT2EghwIWRjlP4JEw2drIW-IbhgRv0wdGP3MF48koevpTbdOmr_uCAoesJfzT9z9d14ZFe0-FqGuDvhVkIJuHS17RTA5azcQiu064 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3642cd3632604ea8aa75cf14c9fef293", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}] Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2542aef0e4464018bf9d4563ffe9030d Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3236026c-f0e1-43f4-a2d6-063ce663801d'} Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:04.455718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Returning 404 to user: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:04.459236 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a5d64a75-9579-446d-918e-73911fa9347a tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 404 len: 111 microversion: 2.1 time: 0.048099 Oct 19 00:55:04.462428 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1285/2462] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:55:04 2022] DELETE /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:04.468871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:04.470497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:04.486758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.488037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.488582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.489303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:04.489838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:04.490328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:04.976940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:04.987271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:04.995280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:04.997704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2696d18d-c0bc-42a9-9603-af3e6a842448 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1265 microversion: 2.25 time: 0.881499 Oct 19 00:55:04.999959 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1178/2463] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:04 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1265 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:05.008350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:05.009654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] [instance: 3236026c-f0e1-43f4-a2d6-063ce663801d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:05.023614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.024083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.024673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.026843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.027323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.027773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.035895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:05.053504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] HTTP exception thrown: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Request method failure captured: Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d HTTP/1.1 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0ook52GF5mwdQYOg9l0vkJf9yS1QpU6MAra3La_hqsXt70Xq_4CnjuS5XxOBQvV8MVZRl6mBjsT2EghwIWRjlP4JEw2drIW-IbhgRv0wdGP3MF48koevpTbdOmr_uCAoesJfzT9z9d14ZFe0-FqGuDvhVkIJuHS17RTA5azcQiu064 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3642cd3632604ea8aa75cf14c9fef293", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3642cd3632604ea8aa75cf14c9fef293"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3642cd3632604ea8aa75cf14c9fef293"}]}] Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 3642cd3632604ea8aa75cf14c9fef293 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2145830032 Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2542aef0e4464018bf9d4563ffe9030d Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiskConfigTestJSON-2145830032-project Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3236026c-f0e1-43f4-a2d6-063ce663801d'} Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.055575 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. Oct 19 00:55:05.060075 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.061485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] Returning 404 to user: Instance 3236026c-f0e1-43f4-a2d6-063ce663801d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:05.062326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e31b722-fedf-4702-990a-9b1d567f5acd tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1473 microversion: 2.1 time: 0.595951 Oct 19 00:55:05.062914 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8042f4d2-8301-4e2e-b145-b9df65455c2e tempest-ServerDiskConfigTestJSON-2145830032 tempest-ServerDiskConfigTestJSON-2145830032-project] 10.222.0.27 "GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d" status: 404 len: 111 microversion: 2.1 time: 0.058883 Oct 19 00:55:05.064139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1286/2464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:04 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1473 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:05.079166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:05.080783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1179/2465] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:05 2022] GET /compute/v2.1/servers/3236026c-f0e1-43f4-a2d6-063ce663801d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:05.081264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] [instance: c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:05.097241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.097484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:05.098213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.098491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:05.098870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.099707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.100280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.101024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.107079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.107950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.108558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.109524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.110155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.110753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.137951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] HTTP exception thrown: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Request method failure captured: Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 HTTP/1.1 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0qBkYP_fXamGr2M8Z4y2SE5Um7fJUqJNUqISUDVDCRnqhO7oU0r2myn9_ijv7Tu9Wqx9YwPsf_PcXx32AqGFqg8UAYdEHs97DLXVboz1iRv7NOPpmbLHvptEe8Tiggr-5fuMYp7O-a1q0S6FsZnUbRK0c1DzpFiIsKHLWehfPEuxvk Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9868d1ede07c453e9a0cb24d0fcdd4df Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-449955385 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9868d1ede07c453e9a0cb24d0fcdd4df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9868d1ede07c453e9a0cb24d0fcdd4df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9868d1ede07c453e9a0cb24d0fcdd4df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9868d1ede07c453e9a0cb24d0fcdd4df"}]}] Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-449955385 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9868d1ede07c453e9a0cb24d0fcdd4df Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-449955385 Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueTestJSONUnderV235-449955385-project Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4eaebe4f02ee4634b92407e4e066beab Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-449955385-project Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94'} Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.139734 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. Oct 19 00:55:05.144612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.148357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] Returning 404 to user: Instance c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:05.149420 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc97a4f8-195b-4539-bd4d-70ba9e25fb4a tempest-ServerRescueTestJSONUnderV235-449955385 tempest-ServerRescueTestJSONUnderV235-449955385-project] 10.222.0.27 "GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94" status: 404 len: 111 microversion: 2.1 time: 0.081945 Oct 19 00:55:05.152067 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1287/2466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:05 2022] GET /compute/v2.1/servers/c4fc930b-26c0-4fb1-bb2e-0b766d8b6d94 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:05.161434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:05.164378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] [instance: da83972a-c45f-441e-a375-73d8537ad69b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:05.184840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.185749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.186428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.187690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.188604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.189301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.221457 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] HTTP exception thrown: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Request method failure captured: Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b HTTP/1.1 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0qwqk2PvLAv6IQbB3EFg7PV5SwVQkDOsUtIYucRHQOP92PPsM98x16Sq0d4kgBFsyzhqI7qsHJ613ithBdkk44Z-iSY95J088_wSgQMSUrdSD7uUTZxlWbN7HbVXe5L5vp6ITk6CzutatI3xWBy78Fc0ifHSu_vDi7GiQRwAMz13NY Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 37640d2d06604d02b384e5a2625b69e9 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-665328139 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_37640d2d06604d02b384e5a2625b69e9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37640d2d06604d02b384e5a2625b69e9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/37640d2d06604d02b384e5a2625b69e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/37640d2d06604d02b384e5a2625b69e9"}]}] Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-665328139 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 37640d2d06604d02b384e5a2625b69e9 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-665328139 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestMultiTenantJSON-665328139-project Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ab81208ae8f64a04bd49c018d7bf5c13 Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-665328139-project Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: exception: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'da83972a-c45f-441e-a375-73d8537ad69b'} Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:55:05.226420 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. Oct 19 00:55:05.230769 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:05.235546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] Returning 404 to user: Instance da83972a-c45f-441e-a375-73d8537ad69b could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:05.236718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-89bdb9ff-f4a2-442a-ac5d-45176d8142e4 tempest-ServersNegativeTestMultiTenantJSON-665328139 tempest-ServersNegativeTestMultiTenantJSON-665328139-project] 10.222.0.27 "GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b" status: 404 len: 111 microversion: 2.1 time: 0.083280 Oct 19 00:55:05.237435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1288/2467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:05 2022] GET /compute/v2.1/servers/da83972a-c45f-441e-a375-73d8537ad69b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:05.270520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:05.271086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:05.286520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.287381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.289092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.290703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.292063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.292614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.740144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:05.748918 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29469fc3-13ae-4da6-b307-93518937f5b5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.666404 Oct 19 00:55:05.749522 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1180/2468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:05 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:05.760009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35151adf-1d29-46da-94bd-6b763b85c911", "name": "network-vif-deleted", "tag": "38fba665-c513-49b8-b120-100135193616"}, {"name": "network-changed", "server_uuid": "3c74d8ba-3f10-4092-9af2-8e81b6ae8476", "tag": "c5e1fc2d-c598-47ee-b664-93a8f4c3812c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:05.817101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:05.817609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:05.818055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:05.865119 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Creating event network-vif-deleted:38fba665-c513-49b8-b120-100135193616 for instance 35151adf-1d29-46da-94bd-6b763b85c911 on n-h2-master-1 Oct 19 00:55:05.865648 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] Creating event network-changed:c5e1fc2d-c598-47ee-b664-93a8f4c3812c for instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 on n-h1-master-1 Oct 19 00:55:05.896189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cc35ab5f-7e94-4047-85f8-c891bf187f61 req-92d415ea-a6ca-46f3-be31-af7aca9fd84e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139557 Oct 19 00:55:05.901045 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1181/2469] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:05.968686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:05.977783 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09393340-e728-4669-b789-e000cf743341 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1484 microversion: 2.1 time: 0.712627 Oct 19 00:55:06.004273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1289/2470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:05 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1484 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:06.026155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:06.027483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:06.043235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.055973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.056445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:06.057245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.057719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.063342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:06.071387 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:06.165228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d801df37-5568-4605-81b8-210105708ffc tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Calling method '.version_select at 0x7f2af4568550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:06.272814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:06.286822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:06.288132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d801df37-5568-4605-81b8-210105708ffc tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.238186 Oct 19 00:55:06.288312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:06.288747 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1290/2471] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:55:06 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:55:06.298617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a0262c5-607e-4356-8104-d54872a2cc53 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1265 microversion: 2.25 time: 0.276712 Oct 19 00:55:06.302936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:06.303569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:06.304403 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1182/2472] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:06 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:06.309420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7024cb7d-5972-4539-b6e5-5c3e1e6f6405 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Action: 'create', calling method: .version_select at 0x7f2af4cb8160>, body: {"pool": "non_exist_pool"} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:06.315865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.316367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.320965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:06.321791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.322269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.322709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:06.416525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7024cb7d-5972-4539-b6e5-5c3e1e6f6405 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] HTTP exception thrown: Floating IP pool not found. Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7024cb7d-5972-4539-b6e5-5c3e1e6f6405 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Request method failure captured: Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 26 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0rpQF5VaajTEO4kyixwDMO_S2RxeEtfy2pKhpZ4cjZ_SDHU3OtZL5Ga08Zpl9tVKxA1-LMsvXk0YCuAVf__Kxdf8l-_LKI6FNdr9mh_RkoVRUmBeyDbYSwvfC6XQmjgTrxN72nzGPbhWx-nNvum7g4Wl3ELku9peq18EvvdOHCeMQM Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b89687ea02364fd18d14ea3d813d663e Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b89687ea02364fd18d14ea3d813d663e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b89687ea02364fd18d14ea3d813d663e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b89687ea02364fd18d14ea3d813d663e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b89687ea02364fd18d14ea3d813d663e"}]}] Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b89687ea02364fd18d14ea3d813d663e Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FloatingIPsNegativeTestJSON-634434953-project Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fb88a7f8e2db4789be47f010250c22f0 Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-634434953-project Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: {"pool": "non_exist_pool"} Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: exception: Floating IP pool not found. Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:06.418844 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:06.422725 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 19 00:55:06.422725 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.426315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7024cb7d-5972-4539-b6e5-5c3e1e6f6405 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Returning 404 to user: Floating IP pool not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:06.427590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7024cb7d-5972-4539-b6e5-5c3e1e6f6405 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.121901 Oct 19 00:55:06.429046 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1183/2473] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:55:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:55:06.439096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Calling method '.version_select at 0x7f2af4d52d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:06.596461 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d7d14014-44c5-4454-9509-b28c1f374d14 could not be found", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:55:06.597560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] HTTP exception thrown: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Request method failure captured: Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-floating-ips/d7d14014-44c5-4454-9509-b28c1f374d14 HTTP/1.1 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0rpQF5VaajTEO4kyixwDMO_S2RxeEtfy2pKhpZ4cjZ_SDHU3OtZL5Ga08Zpl9tVKxA1-LMsvXk0YCuAVf__Kxdf8l-_LKI6FNdr9mh_RkoVRUmBeyDbYSwvfC6XQmjgTrxN72nzGPbhWx-nNvum7g4Wl3ELku9peq18EvvdOHCeMQM Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b89687ea02364fd18d14ea3d813d663e Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b89687ea02364fd18d14ea3d813d663e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b89687ea02364fd18d14ea3d813d663e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b89687ea02364fd18d14ea3d813d663e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b89687ea02364fd18d14ea3d813d663e"}]}] Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b89687ea02364fd18d14ea3d813d663e Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-634434953 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FloatingIPsNegativeTestJSON-634434953-project Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fb88a7f8e2db4789be47f010250c22f0 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-634434953-project Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: exception: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'd7d14014-44c5-4454-9509-b28c1f374d14'} Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d7d14014-44c5-4454-9509-b28c1f374d14 could not be found Oct 19 00:55:06.599765 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-827a955a-420e-4900-b861-2819325a8d42'] Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14. Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14 Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14 Oct 19 00:55:06.603242 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:06.610058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] Returning 404 to user: Floating IP not found for ID d7d14014-44c5-4454-9509-b28c1f374d14 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:06.611234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5f35da5-61a2-4e18-99fe-cd3f7e2f7904 tempest-FloatingIPsNegativeTestJSON-634434953 tempest-FloatingIPsNegativeTestJSON-634434953-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d7d14014-44c5-4454-9509-b28c1f374d14" status: 404 len: 111 microversion: 2.1 time: 0.177271 Oct 19 00:55:06.612177 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1184/2474] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:55:06 2022] DELETE /compute/v2.1/os-floating-ips/d7d14014-44c5-4454-9509-b28c1f374d14 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:55:06.776824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:06.777689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:06.791115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.795134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.795794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:06.798347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:06.801279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:06.801928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:07.004521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:07.019155 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc80d934-43b3-4155-82a9-f6a2c3f1a0c9 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1473 microversion: 2.1 time: 0.719254 Oct 19 00:55:07.020111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1291/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:06 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1473 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:07.091869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:07.103209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39f7512c-cfb4-49f2-b295-3fe4f10c0f06 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.331554 Oct 19 00:55:07.113357 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1185/2476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:06 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:55:07.330560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:07.331187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:07.342434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:07.343202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:07.345209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:07.346126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:07.349775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:07.350545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:07.804555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:07.829247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:07.833333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:07.836194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0237a2d7-cb39-48f2-856c-70eb47fc0f8e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1265 microversion: 2.25 time: 0.510396 Oct 19 00:55:07.844659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1292/2477] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:07 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1265 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:07.993586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60adecb6-1821-4de4-b712-ac428eda4096", "name": "network-vif-deleted", "tag": "cbd33da5-634c-4218-9dcf-a6dfb6411e39"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:08.014398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.016385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.021623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.043883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:08.046170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:08.056770 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] Creating event network-vif-deleted:cbd33da5-634c-4218-9dcf-a6dfb6411e39 for instance 60adecb6-1821-4de4-b712-ac428eda4096 on n-h1-master-1 Oct 19 00:55:08.067714 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1c601bd9-6827-45c2-9a59-9295472b199b req-562659b9-a45d-4d18-8db1-f35854d6da9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078072 Oct 19 00:55:08.068700 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1186/2478] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:55:08.070039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.074029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.075282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.078715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.087732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.088373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.128270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:08.129690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:08.136774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.137536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.138144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.139651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.140324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.141479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.358240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02e52a53aba2448096ac85fcfaa598a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5685c970486040e2bc073d3bc1a5e577', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:08.367838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-463729c2-94ee-47cb-86c4-5846a238eeec tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 200 len: 1302 microversion: 2.1 time: 0.328048 Oct 19 00:55:08.369006 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1293/2479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:08 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 1302 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:55:08.576859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:08.591355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e981067-6a27-4574-a1ec-19e6c542e2f3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.467622 Oct 19 00:55:08.598964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1187/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:08 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:55:08.865643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:08.866289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:08.880422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.880951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.881394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:08.882123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:08.887926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:08.888724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:09.196189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:09.212460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:09.213961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:09.215133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a065b8e-39cf-4204-8988-703f83e5a6d8 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1265 microversion: 2.25 time: 0.353687 Oct 19 00:55:09.215749 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1294/2481] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:08 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:09.394190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:09.395036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] [instance: 60adecb6-1821-4de4-b712-ac428eda4096] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:09.407566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:09.407988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:09.408445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:09.409203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:09.414338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:09.415082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:09.460659 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] HTTP exception thrown: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Request method failure captured: Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 HTTP/1.1 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0oAyDxa2CI8obDI6hHKL9ToOet6sPW7ZpzU-n_WDqaLsX50NvQLWx1ZxyrSAEscCe1C27HBw9qJB3HbZlKNUs7nzn6EEmknbZ-HbAEnZw8d24NxOxKv8Mb6_RSSj953mnSMaDfQMXasAoSSON-96WWKHGSxTl81EUpkhCHtVWO_ixs Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5685c970486040e2bc073d3bc1a5e577", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5685c970486040e2bc073d3bc1a5e577"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5685c970486040e2bc073d3bc1a5e577"}]}] Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5685c970486040e2bc073d3bc1a5e577 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1664383081 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 02e52a53aba2448096ac85fcfaa598a1 Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersOnMultiNodesTest-1664383081-project Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '60adecb6-1821-4de4-b712-ac428eda4096'} Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:09.480998 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. Oct 19 00:55:09.486321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:09.489844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] Returning 404 to user: Instance 60adecb6-1821-4de4-b712-ac428eda4096 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:09.493848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3a13151-4177-4bf1-b179-661d66860dd4 tempest-ServersOnMultiNodesTest-1664383081 tempest-ServersOnMultiNodesTest-1664383081-project] 10.222.0.27 "GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096" status: 404 len: 111 microversion: 2.1 time: 0.104624 Oct 19 00:55:09.498850 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1188/2482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:09 2022] GET /compute/v2.1/servers/60adecb6-1821-4de4-b712-ac428eda4096 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:55:09.626025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:09.626758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:09.641796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:09.642303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:09.642748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:09.644361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:09.644858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:09.649307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:10.179548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:10.195320 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-527229f2-7784-447e-9b49-4c3c51930245 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.574528 Oct 19 00:55:10.202841 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1295/2483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:09 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:10.243414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:10.244275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:10.255129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:10.258699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:10.259528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:10.261165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:10.262376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:10.266319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:10.541706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:10.556022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:10.559764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:10.564893 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d70825bd-4263-4b2b-ad73-7e353c3afbc2 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 200 len: 1265 microversion: 2.25 time: 0.328174 Oct 19 00:55:10.579714 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1189/2484] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:10 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 1265 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:11.223749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:11.225060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:11.239741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:11.240520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:11.245525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:11.246617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:11.247475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:11.247992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:11.592040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:11.592780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 35151adf-1d29-46da-94bd-6b763b85c911] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:11.607308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:11.608102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:11.609277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:11.610151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:11.610622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:11.611094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:11.645172 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] HTTP exception thrown: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Request method failure captured: Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 HTTP/1.1 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0k8h3GYHQqcAgpTw5kHaiy1baZ4d6lJWWsmdy7iQAYYfOUGDtMr2_dbaIi3POBBVnt-rkBgVVOC5sdvOGEZS2f4QOPg6WqP4PEFANImNUcilW20FAuTO3bAXnV23rV8fXgL61LZbyxwekoi2leuS4bHMZX_yoE3KR9s9iy06hHKw-Q Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9189bd828c41a88fe9333fb5ec9351", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}] Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5d0158da7efc485ebd6a1e1db617b5e7 Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '35151adf-1d29-46da-94bd-6b763b85c911'} Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. Oct 19 00:55:11.646798 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Returning 404 to user: Instance 35151adf-1d29-46da-94bd-6b763b85c911 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:11.651377 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67fdd12a-4287-4ac7-a4de-03b5a020ba07 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911" status: 404 len: 111 microversion: 2.25 time: 0.063721 Oct 19 00:55:11.655363 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1190/2485] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:11 2022] GET /compute/v2.1/servers/35151adf-1d29-46da-94bd-6b763b85c911 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:55:11.713620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:11.726433 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc21e1e3-a087-458f-ac05-86511bcb4a26 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.507582 Oct 19 00:55:11.730952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1296/2486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:11 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:12.759954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:12.760590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:12.791649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:12.792214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:12.799711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:12.805803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:12.809642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:12.809995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:13.628959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:13.653809 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6405c072-bdc6-4b8c-ae14-c02614f4c9b1 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 0.897979 Oct 19 00:55:13.658870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1191/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:12 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:14.683920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:14.685161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:14.713312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:14.718272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:14.724053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:14.744097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:14.744606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:14.745087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:15.292459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-42de8922-cec5-4be3-903c-3b9be61f991e tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:15.307673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-42de8922-cec5-4be3-903c-3b9be61f991e tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.352272 Oct 19 00:55:15.340854 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1192/2488] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:55:14 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:15.759097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:15.769167 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41f8a773-68f6-46a8-9de0-bbdc0e504158 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1504 microversion: 2.1 time: 1.090120 Oct 19 00:55:15.769770 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1297/2489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:14 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1504 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:16.793901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:16.794533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:16.818641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:16.819151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:16.819605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:16.821134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:16.821975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:16.826369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:17.368224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1530416134", "imageRef": "5315f0cc-6892-4964-a851-44e4a05bef03", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:17.490776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:17.754748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:17.771389 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1855e72-c6ca-4fe6-8444-bbc97edd92c2 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1484 microversion: 2.1 time: 0.977331 Oct 19 00:55:17.773155 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1193/2490] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:16 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1484 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:18.055415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1780801290", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:18.124729 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:18.177804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] validate_networks() for [('fd2785cf-29f6-47df-b47b-4dd1279e43f8', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:18.596014 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] Request method failure captured: Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 143 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0ryxsup1-CTLvnPZA_sdBMH3EFXn_lMqbhObbxOeDv663cMG2Gm76AqiGwk5w3xnix_YdYvTDG9EJPZBb3pkpXvYU3YQqlerxO04nhI7bbD-uu9fBn84yq6o3JfHpSleldtYn5Hn-83ACnluSAeBeWdYzhfT0eDD1Q6_xoMfGsULiQ Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: c9918f1aecd448a5b236066379ad0efa Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FlavorsV2NegativeTest-1554287010 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c9918f1aecd448a5b236066379ad0efa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9918f1aecd448a5b236066379ad0efa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c9918f1aecd448a5b236066379ad0efa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c9918f1aecd448a5b236066379ad0efa"}]}] Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FlavorsV2NegativeTest-1554287010 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: c9918f1aecd448a5b236066379ad0efa Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1554287010 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FlavorsV2NegativeTest-1554287010-project Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 386a33909e8a4633863c237f69e857f3 Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FlavorsV2NegativeTest-1554287010-project Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1530416134", "imageRef": "5315f0cc-6892-4964-a851-44e4a05bef03", "flavorRef": "452"}} Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor's memory is too small for requested image. Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1530416134', 'imageRef': '5315f0cc-6892-4964-a851-44e4a05bef03', 'flavorRef': '452'}}} Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:55:18.598066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-797a9c01-620a-4074-9379-a4028d8937ba tempest-FlavorsV2NegativeTest-1554287010 tempest-FlavorsV2NegativeTest-1554287010-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.236139 Oct 19 00:55:18.604225 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1298/2491] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:17 2022] POST /compute/v2.1/servers => generated 93 bytes in 1237 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 19 00:55:19.830733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:19.831355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:19.852432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:19.858676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:19.860423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:19.861459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:19.862105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:19.862540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:19.929669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:55:20.108187 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-232a57e8-bc8e-4047-a7cb-498325ad3901 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 204 len: 0 microversion: 2.25 time: 0.283817 Oct 19 00:55:20.108828 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1299/2492] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:55:19 2022] DELETE /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:55:20.128388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:20.129391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:20.135878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:20.136655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:20.137263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:20.138141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:20.138753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:20.139343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:20.546877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:55:20.547512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:55:20.549617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:55:20.550327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:55:20.550998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:55:20.572850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:20.575595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:20.576303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:20.580931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:20.581841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:20.582508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:20.622256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Getting quotas for project 488f8fabd15e4e7c8837ccd25c842e46. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:20.673863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Getting quotas for user ea919891e28b42fd9c7ea98cbf2362a4 and project 488f8fabd15e4e7c8837ccd25c842e46. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:20.704995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:55:20.713326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:20.817461 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fdaa5cb6-6365-4931-b506-4c3269c47459 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.773380 Oct 19 00:55:20.819332 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1194/2493] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:55:20.832702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4591cafd-7ca2-4d70-ac10-625a88b07649 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:20.833805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4591cafd-7ca2-4d70-ac10-625a88b07649 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:21.087415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:21.102887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:21.104281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:21.105774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95fbb716-6fb2-4ac7-81b1-68f7163155f9 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1730 microversion: 2.25 time: 0.983656 Oct 19 00:55:21.122125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1300/2494] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:20 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1730 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:21.167798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4591cafd-7ca2-4d70-ac10-625a88b07649 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:21.178039 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4591cafd-7ca2-4d70-ac10-625a88b07649 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1214 microversion: 2.1 time: 0.349911 Oct 19 00:55:21.178937 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1195/2495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:20 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:55:22.133714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:22.134967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:22.152096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:22.152601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:22.153107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:22.153824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:22.154426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:22.154717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:22.201840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:22.203703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:22.214814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:22.217253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:22.221301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:22.222120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:22.222613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:22.223061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:22.402608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:22.417351 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8d5a4b4-aca6-4e83-bf12-577fd82d5eaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1266 microversion: 2.1 time: 0.219531 Oct 19 00:55:22.438747 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1196/2496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:22 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:22.951296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:22.971026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:22.973113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:22.977530 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d9b546f-1f40-4e55-b26b-e2cf8cf91774 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1730 microversion: 2.25 time: 0.847274 Oct 19 00:55:22.979798 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1301/2497] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:22 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1730 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:23.446705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:23.448144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:23.473566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:23.476089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:23.477795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:23.481424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:23.482133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:23.483333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:23.746517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:23.766553 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ab1decc-4307-42b7-bb98-ba096a52d884 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1272 microversion: 2.1 time: 0.318589 Oct 19 00:55:23.769412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1197/2498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:23 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:55:24.007167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:24.007806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:24.019784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:24.020332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:24.021121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:24.022460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:24.023121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:24.023718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:24.291266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:24.309050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:24.311318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:24.312164 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af5d2de7-876e-46c1-9eca-233b44599a7d tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1662 microversion: 2.25 time: 0.311093 Oct 19 00:55:24.326784 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1302/2499] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:23 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1662 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:24.579262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9be8cfff-9cd8-4932-a3c4-ec93e641a830", "name": "network-vif-deleted", "tag": "c67aa4c5-bb76-4831-9df1-a78939c821de"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:24.604549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:24.605443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:24.606922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:24.661749 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] Creating event network-vif-deleted:c67aa4c5-bb76-4831-9df1-a78939c821de for instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 on n-h2-master-1 Oct 19 00:55:24.685449 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-51954297-3b78-4822-9966-18280aaa2b3e req-73e576b7-c147-4187-8b21-81f70231b5fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108810 Oct 19 00:55:24.688931 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1198/2500] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:24.795776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:24.797304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:24.817166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:24.819497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:24.822810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:24.825815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:24.832404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:24.835693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:24.915760 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:25.037658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:25.049060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee48b118-ccb2-4f53-b8bb-227c16e389e9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1272 microversion: 2.1 time: 0.256296 Oct 19 00:55:25.060675 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1303/2501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:24 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:25.343901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:25.345001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:25.360117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:25.363324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:25.364185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:25.369942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:25.371315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:25.372181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:25.540130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:25.540807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:25.541284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:25.542135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lazy-loading 'fault' on Instance uuid 9be8cfff-9cd8-4932-a3c4-ec93e641a830 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:55:25.720611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:25.736465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:25.746137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:25.752653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b8a9a97-71fa-4dca-b3ae-91a5506830c4 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 200 len: 1372 microversion: 2.25 time: 0.413538 Oct 19 00:55:25.753312 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1199/2502] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:25 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 1372 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:25.831642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6783984-501e-46ca-bc6c-9a6059fc4fa1 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af45ab8b0>, body: {"keypair": {"name": "tempest-keypair-14612974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN4rQpnz11uHXXawoNwbL6cAXw/9tQ89LlHH/0Pu+JhWHQQv7B4qcg9zBXjrwjIeCu5hppWvm0tQIqufw8AFcbFg/Q6T+xZ6/uV/5GTNgLfPCqaMIbvB42Tx9+aE8BiEQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:25.875153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a6783984-501e-46ca-bc6c-9a6059fc4fa1 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:25.891443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a6783984-501e-46ca-bc6c-9a6059fc4fa1 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:25.923433 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6783984-501e-46ca-bc6c-9a6059fc4fa1 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.388095 Oct 19 00:55:25.924774 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1304/2503] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 390 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:25.945148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07b5b63a-661f-40a8-8dff-a42f98b50819 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4f7be50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:25.960135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07b5b63a-661f-40a8-8dff-a42f98b50819 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-14612974" status: 200 len: 511 microversion: 2.2 time: 0.023950 Oct 19 00:55:25.961396 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1200/2504] 10.222.0.27 () {60 vars in 1252 bytes} [Wed Oct 19 00:55:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-14612974 => generated 511 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:25.973441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-779bd842-e2ba-42cc-ab20-26b0e5b1d2c7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4588040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.000996 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-779bd842-e2ba-42cc-ab20-26b0e5b1d2c7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-14612974" status: 204 len: 0 microversion: 2.2 time: 0.031893 Oct 19 00:55:26.001999 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1305/2505] 10.222.0.27 () {60 vars in 1255 bytes} [Wed Oct 19 00:55:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-14612974 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.014807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bf9ae82-0ac7-42d0-a7d3-7ee5ef034511 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af93494c0>, body: {"keypair": {"name": "tempest-keypair-2022901704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrBZOrRfjhOi31H12aZ5pu8EiSWzrQtwAjHN3p+de0a1oKF6i/7Ruk+O/2caI5Jxb3l7fTEH8V8j4qQgLDa3kmnmc+TuzTGaUARx2B/T00FuKTqm8QYgwQqrNUpFGj80A=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:26.040192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4bf9ae82-0ac7-42d0-a7d3-7ee5ef034511 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:26.059055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4bf9ae82-0ac7-42d0-a7d3-7ee5ef034511 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:26.079060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.080138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:26.104322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:26.105619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:26.107493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:26.111050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:26.111737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:26.112969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:26.139595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4bf9ae82-0ac7-42d0-a7d3-7ee5ef034511 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.128248 Oct 19 00:55:26.142829 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1201/2506] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 133 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:26.154615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a840e13c-d2aa-4866-966d-ea6b63d00add tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af93839d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.216278 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a840e13c-d2aa-4866-966d-ea6b63d00add tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022901704" status: 204 len: 0 microversion: 2.2 time: 0.063730 Oct 19 00:55:26.219331 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1202/2507] 10.222.0.27 () {60 vars in 1261 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022901704 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.231351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a1813e1-3ecc-4352-a545-a8622c1270ed tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af4f7a310>, body: {"keypair": {"name": "tempest-keypair-133983509", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:26.255060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9a1813e1-3ecc-4352-a545-a8622c1270ed tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:26.262840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9a1813e1-3ecc-4352-a545-a8622c1270ed tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:26.306561 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a1813e1-3ecc-4352-a545-a8622c1270ed tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.081813 Oct 19 00:55:26.307608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1203/2508] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:26 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:26.322186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b22ae125-c569-4da5-828c-93bc059f4e80 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af936c280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.362091 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b22ae125-c569-4da5-828c-93bc059f4e80 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133983509" status: 204 len: 0 microversion: 2.2 time: 0.045750 Oct 19 00:55:26.363213 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1204/2509] 10.222.0.27 () {60 vars in 1258 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133983509 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.377833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be01ab59-a6bb-46bc-9b8a-853cef29c3cb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af93499d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-322892827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcQeTwCVupwNM0XjNKUXX6IdBfcj9G9hw66kSi2I2NtYd63O2EialH6rCvkbAZcjnR0FapcSn+krwOUstdNFts4jhXIxPAwYo/RIG5c631Bx5sZmhIPncFyYV3rpRCf/A=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:26.411152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-be01ab59-a6bb-46bc-9b8a-853cef29c3cb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:26.420258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-be01ab59-a6bb-46bc-9b8a-853cef29c3cb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:26.488737 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be01ab59-a6bb-46bc-9b8a-853cef29c3cb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.117468 Oct 19 00:55:26.490205 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1205/2510] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:26 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:26.505751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c3fccfa-77d3-4811-9a4f-9bfb09d0741f tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af93833a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1020199023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmM94sOB6uIXq4fNFJEVdi1fA093o9Ptedvdb61obYLhdP1XB+s8SpBvr+rKxvgqoFMj546IIf6hIi4NV1KRCuvw7PtQa+KK347fYF2CI0IuK9rKR/jsF8nyvOXffCikg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:26.526611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5c3fccfa-77d3-4811-9a4f-9bfb09d0741f tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:26.535104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5c3fccfa-77d3-4811-9a4f-9bfb09d0741f tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:26.574624 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c3fccfa-77d3-4811-9a4f-9bfb09d0741f tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.073127 Oct 19 00:55:26.584935 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1206/2511] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:26 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 19 00:55:26.592200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-09b45389-450c-4848-affe-0ad1897a73e7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af4f7bca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-163512562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASujuZWbHk4xQDi8B9KTe2WyBNPhqvXxSeQVVHMJv2VmZRfwMCUr0TIY3t7TMBd+/PGxqCsT0Lu0WmrSGUzqncXsk1AKXKmPWbjIKrDPI9q5fCWBvjTEpVjrnxqCCzZsA=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:26.614919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-09b45389-450c-4848-affe-0ad1897a73e7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:26.622197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-09b45389-450c-4848-affe-0ad1897a73e7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:26.658525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-09b45389-450c-4848-affe-0ad1897a73e7 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072131 Oct 19 00:55:26.665535 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1207/2512] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:26 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:26.671752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8838a6bd-d12a-463f-9fb3-29b2d608e7bb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4c223a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.676031 n-d-master-1 devstack@n-api.service[131450]: WARNING oslo_db.sqlalchemy.utils [None req-8838a6bd-d12a-463f-9fb3-29b2d608e7bb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:55:26.677693 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:26.684483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8838a6bd-d12a-463f-9fb3-29b2d608e7bb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.017121 Oct 19 00:55:26.692734 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1208/2513] 10.222.0.27 () {60 vars in 1177 bytes} [Wed Oct 19 00:55:26 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:26.707749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b1f2592-ebb2-4c6f-897e-3ad5f30cb913 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4ff41f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.735366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b1f2592-ebb2-4c6f-897e-3ad5f30cb913 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-163512562" status: 204 len: 0 microversion: 2.2 time: 0.039955 Oct 19 00:55:26.740077 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1209/2514] 10.222.0.27 () {60 vars in 1318 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-163512562 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.745446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b87fc35-d736-4983-9bac-a840b0259acb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af9383ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.783323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b87fc35-d736-4983-9bac-a840b0259acb tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1020199023" status: 204 len: 0 microversion: 2.2 time: 0.042692 Oct 19 00:55:26.788735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1210/2515] 10.222.0.27 () {60 vars in 1321 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1020199023 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.805833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.807303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 9be8cfff-9cd8-4932-a3c4-ec93e641a830] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:26.821835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:26.822402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:26.824139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:26.825123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:26.827123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:26.831536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:26.871297 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] HTTP exception thrown: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Request method failure captured: Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 HTTP/1.1 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0k8h3GYHQqcAgpTw5kHaiy1baZ4d6lJWWsmdy7iQAYYfOUGDtMr2_dbaIi3POBBVnt-rkBgVVOC5sdvOGEZS2f4QOPg6WqP4PEFANImNUcilW20FAuTO3bAXnV23rV8fXgL61LZbyxwekoi2leuS4bHMZX_yoE3KR9s9iy06hHKw-Q Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9189bd828c41a88fe9333fb5ec9351", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}] Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5d0158da7efc485ebd6a1e1db617b5e7 Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9be8cfff-9cd8-4932-a3c4-ec93e641a830'} Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. Oct 19 00:55:26.873420 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Returning 404 to user: Instance 9be8cfff-9cd8-4932-a3c4-ec93e641a830 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e14babb5-5396-4a0b-a3ef-741651049e7e tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830" status: 404 len: 111 microversion: 2.25 time: 0.088158 Oct 19 00:55:26.880066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1211/2516] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:26 2022] GET /compute/v2.1/servers/9be8cfff-9cd8-4932-a3c4-ec93e641a830 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:55:26.885533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b7ca71a9-8d0a-47c4-a1c8-b6eaf23b06b0 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4b97820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:26.931057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b7ca71a9-8d0a-47c4-a1c8-b6eaf23b06b0 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-322892827" status: 204 len: 0 microversion: 2.2 time: 0.053022 Oct 19 00:55:26.931803 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1212/2517] 10.222.0.27 () {60 vars in 1318 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-322892827 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:26.943954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb2bdd19-cf1f-4bdb-a799-81f7d851cf26 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '.version_select at 0x7f2af4d39f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.001691 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb2bdd19-cf1f-4bdb-a799-81f7d851cf26 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946116781" status: 204 len: 0 microversion: 2.25 time: 0.067687 Oct 19 00:55:27.005319 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1213/2518] 10.222.0.27 () {60 vars in 1259 bytes} [Wed Oct 19 00:55:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946116781 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:55:27.019827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b9d296e-91e3-4451-9a9e-1fa12cafd065 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af4d67d30>, body: {"keypair": {"name": "tempest-keypair-783077401", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEFppyUeXNFdOF8rtG0T7nDOvG5nPhubeqdWFc21mKPpjzmgOH6Ro0mQAVwKOJKKM6jrwhSbbkbnsRBp+KR0zqucRLbXMUr9J3id5loJygB1hTwblxeX86/UhqSBHpsYQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:27.064016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9b9d296e-91e3-4451-9a9e-1fa12cafd065 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:27.079282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9b9d296e-91e3-4451-9a9e-1fa12cafd065 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:27.146868 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b9d296e-91e3-4451-9a9e-1fa12cafd065 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.140407 Oct 19 00:55:27.153271 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1214/2519] 10.222.0.27 () {62 vars in 1199 bytes} [Wed Oct 19 00:55:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:55:27.162290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-045bffbd-06c2-4999-b0ad-d2b755e374e6 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4c2b8b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.188203 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-045bffbd-06c2-4999-b0ad-d2b755e374e6 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-783077401" status: 200 len: 512 microversion: 2.2 time: 0.031886 Oct 19 00:55:27.189881 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1215/2520] 10.222.0.27 () {60 vars in 1255 bytes} [Wed Oct 19 00:55:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-783077401 => generated 512 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:27.204412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb949d2a-ceec-4b0f-a83b-6e1c70c99b18 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af9422310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.211852 n-d-master-1 devstack@n-api.service[131450]: WARNING oslo_db.sqlalchemy.utils [None req-eb949d2a-ceec-4b0f-a83b-6e1c70c99b18 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:55:27.218781 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb949d2a-ceec-4b0f-a83b-6e1c70c99b18 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.020336 Oct 19 00:55:27.220591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1216/2521] 10.222.0.27 () {60 vars in 1177 bytes} [Wed Oct 19 00:55:27 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:27.231144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3be063fd-d229-417e-92a0-cd594c7d2596 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4e33670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.262450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3be063fd-d229-417e-92a0-cd594c7d2596 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783077401" status: 204 len: 0 microversion: 2.2 time: 0.035323 Oct 19 00:55:27.264069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1217/2522] 10.222.0.27 () {60 vars in 1258 bytes} [Wed Oct 19 00:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783077401 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:55:27.282492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Action: 'create', calling method: .version_select at 0x7f2af4cb8ee0>, body: {"keypair": {"name": "tempest-keypair-847677622", "type": "x509"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:27.306040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:27.306651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:27.320794 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-510063b3-7e45-4ed6-9264-f1178c17ade5 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 1.247874 Oct 19 00:55:27.322233 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1306/2523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:26 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:27.344211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:27.381826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.processutils [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmptyb8cyga/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptyb8cyga/temp.key -subj /CN=d2db51d6d02e4884abab02dde674f062 -extensions v3_req_client {{(pid=131450) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 00:55:27.704263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.processutils [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmptyb8cyga/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmptyb8cyga/temp.key -subj /CN=d2db51d6d02e4884abab02dde674f062 -extensions v3_req_client" returned: 0 in 0.322s {{(pid=131450) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 00:55:27.706168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.processutils [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmptyb8cyga/temp.key -password pass: {{(pid=131450) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 19 00:55:27.739268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.processutils [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] CMD "openssl pkcs12 -export -inkey /tmp/tmptyb8cyga/temp.key -password pass:" returned: 0 in 0.032s {{(pid=131450) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 19 00:55:27.849234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:27.856659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Getting quotas for user d2db51d6d02e4884abab02dde674f062 and project 8a2038ef05604eabb5fa8183ef4a9b95. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:27.891530 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b851a10f-7352-4eb5-b841-2260476997a5 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.621082 Oct 19 00:55:27.897683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1218/2524] 10.222.0.27 () {62 vars in 1198 bytes} [Wed Oct 19 00:55:27 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 623 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:27.904003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e61969de-b48d-4573-a2ca-303cc27fc933 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af453b820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.918555 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e61969de-b48d-4573-a2ca-303cc27fc933 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-847677622" status: 200 len: 1533 microversion: 2.2 time: 0.018981 Oct 19 00:55:27.926371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1307/2525] 10.222.0.27 () {60 vars in 1255 bytes} [Wed Oct 19 00:55:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-847677622 => generated 1533 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:27.935898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64595c29-6e4e-484d-89f9-53e559a02df2 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4d52040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:27.951901 n-d-master-1 devstack@n-api.service[131450]: WARNING oslo_db.sqlalchemy.utils [None req-64595c29-6e4e-484d-89f9-53e559a02df2 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:55:27.959629 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64595c29-6e4e-484d-89f9-53e559a02df2 tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.030071 Oct 19 00:55:27.964683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1219/2526] 10.222.0.27 () {60 vars in 1177 bytes} [Wed Oct 19 00:55:27 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:27.974917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f58c2522-4659-4440-9f20-6a36816242bc tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] Calling method '.version_select at 0x7f2af4521160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:28.016020 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f58c2522-4659-4440-9f20-6a36816242bc tempest-KeyPairsV22TestJSON-667708666 tempest-KeyPairsV22TestJSON-667708666-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-847677622" status: 204 len: 0 microversion: 2.2 time: 0.047463 Oct 19 00:55:28.025107 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1308/2527] 10.222.0.27 () {60 vars in 1258 bytes} [Wed Oct 19 00:55:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-847677622 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:55:28.352028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:28.352967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:28.376227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:28.382002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:28.383171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:28.387648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:28.392297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:28.394250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:28.509442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c116bff-b502-4bf6-a4b4-ab28b6b13aa9", "tag": "78717d72-62a5-4334-87db-f83b1087bbff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:28.538257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:28.539012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:28.539645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:28.566899 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] Creating event network-changed:78717d72-62a5-4334-87db-f83b1087bbff for instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 on n-h1-master-1 Oct 19 00:55:28.575652 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5eb474eb-07a3-4e5f-a46b-a2666d76d211 req-38bdb42a-4fb9-4f02-ac6b-6ffcc14ea768 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076047 Oct 19 00:55:28.583333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1309/2528] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:55:29.217883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:29.231832 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cfd859ef-2480-4aaa-8649-7a1601d29890 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 0.882472 Oct 19 00:55:29.233545 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1220/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:28 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:29.475867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:29.476901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:29.497328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:29.498058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:29.498693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:29.499748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:29.500423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:29.501160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:29.567688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:55:29.734947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02c4966f-2785-4095-9329-266dacb1d265 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 204 len: 0 microversion: 2.25 time: 0.263958 Oct 19 00:55:29.736122 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1310/2530] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:55:29 2022] DELETE /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:55:29.745735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:29.746420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:29.761522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:29.762149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:29.762620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:29.766916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:29.767431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:29.768106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:30.263215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:30.264140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:30.284909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:30.285895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:30.286700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:30.287771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:30.288554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:30.289391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:30.613061 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:30.977121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:30.989571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:30.991703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:30.998013 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02f75e0a-1548-4141-af94-aef46c9350ab tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1549 microversion: 2.25 time: 1.251481 Oct 19 00:55:31.002242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1221/2531] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:29 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1549 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:31.326184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:31.336533 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f54b788c-d3b7-438f-8bec-323b936c71a9 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 1.077949 Oct 19 00:55:31.355964 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1311/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:30 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:32.032592 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:32.033803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:32.043410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:32.051366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:32.052060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:32.054224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:32.055212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:32.055953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:32.365144 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:32.366199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:32.380335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:32.382168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:32.383810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:32.388377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:32.388959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:32.391755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:33.524344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:33.543358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c47f2301-37db-4e5c-aea1-cbd6495812c3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 1.183405 Oct 19 00:55:33.549002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1312/2533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:32 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:33.554674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bfd31f-98ce-4bd1-8214-d862c74e8247", "name": "network-vif-deleted", "tag": "d17e1f5f-3261-4df3-8cf7-372e2857c241"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:33.576899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:33.579216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:33.580869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:33.610742 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] Creating event network-vif-deleted:d17e1f5f-3261-4df3-8cf7-372e2857c241 for instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 on n-h2-master-1 Oct 19 00:55:33.625197 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c933bc76-b8a1-4ed4-ad0d-8b074d15798b req-15c49c46-a21b-41f8-8366-fc679749abac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074342 Oct 19 00:55:33.626052 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1313/2534] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:33.817321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:33.831175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:33.840297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:33.844550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-079eac5a-d1f5-4d01-905a-5f876b4faf1b tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 200 len: 1549 microversion: 2.25 time: 1.817399 Oct 19 00:55:33.867790 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1222/2535] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:32 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 1549 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:34.572522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:34.573890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:34.593615 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:34.595818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.596549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.597257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:34.598187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.598822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.599412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:34.877754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:34.879175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: 79bfd31f-98ce-4bd1-8214-d862c74e8247] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:34.888130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.889180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.890474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:34.891853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.892892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.893736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:34.917204 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] HTTP exception thrown: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Request method failure captured: Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 HTTP/1.1 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0k8h3GYHQqcAgpTw5kHaiy1baZ4d6lJWWsmdy7iQAYYfOUGDtMr2_dbaIi3POBBVnt-rkBgVVOC5sdvOGEZS2f4QOPg6WqP4PEFANImNUcilW20FAuTO3bAXnV23rV8fXgL61LZbyxwekoi2leuS4bHMZX_yoE3KR9s9iy06hHKw-Q Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9189bd828c41a88fe9333fb5ec9351", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}] Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5d0158da7efc485ebd6a1e1db617b5e7 Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '79bfd31f-98ce-4bd1-8214-d862c74e8247'} Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. Oct 19 00:55:34.920892 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. Oct 19 00:55:34.926360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:55:34.930122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Returning 404 to user: Instance 79bfd31f-98ce-4bd1-8214-d862c74e8247 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:34.931323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d024b4b-dcbd-4e5a-9407-892e9c10964c tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247" status: 404 len: 111 microversion: 2.25 time: 0.059659 Oct 19 00:55:34.932574 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1223/2536] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:34 2022] GET /compute/v2.1/servers/79bfd31f-98ce-4bd1-8214-d862c74e8247 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:55:34.944177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:34.945267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:34.960529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.961456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.963218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:34.965120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:34.965724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:34.966510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:35.021410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:55:35.133413 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:35.180089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:35.196705 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0328f9aa-391d-427a-ae84-2c6eb2c44ddf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 0.626489 Oct 19 00:55:35.198489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1314/2537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:34 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:35.236039 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53ff632d-1715-444a-b877-d4709e7c6817 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 204 len: 0 microversion: 2.25 time: 0.297564 Oct 19 00:55:35.236822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1224/2538] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:55:34 2022] DELETE /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:55:35.245530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:35.246392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:35.259748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:35.260319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:35.260789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:35.261501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:35.263834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:35.265837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:35.904911 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:36.179932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:36.200297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:36.206295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:36.209954 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a36d39b4-7e38-4b45-baf1-b838bbc1c547 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1564 microversion: 2.25 time: 0.968643 Oct 19 00:55:36.211572 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1315/2539] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:35 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1564 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:36.237553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:36.238884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:36.246606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:36.247515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:36.248252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:36.249764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:36.250443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:36.251092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:36.955734 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:36.967858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32389f78-5793-4290-b657-fcf2a98cdaaf tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 0.736051 Oct 19 00:55:36.971470 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1225/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:36 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:37.242723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:37.243470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:37.265557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:37.270777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:37.271497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:37.284345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:37.285787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:37.288071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:37.392469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2b94506-e150-46f4-a7a3-b340d0ccb6d0", "name": "network-vif-deleted", "tag": "ab9bd828-572a-4f51-b2af-60a415f3fd21"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:37.425311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:37.426336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:37.426977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:37.445420 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] Creating event network-vif-deleted:ab9bd828-572a-4f51-b2af-60a415f3fd21 for instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 on n-h2-master-1 Oct 19 00:55:37.460251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff8e0102-d048-48ec-af31-80e76a4422cf req-a1d9d747-308a-46cc-abbd-7dc63f48c41a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075920 Oct 19 00:55:37.462949 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1226/2541] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:55:37.662916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:37.693413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:37.695137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5d0158da7efc485ebd6a1e1db617b5e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9189bd828c41a88fe9333fb5ec9351', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:37.700037 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-055b0024-acb4-443e-9789-05dc7d392a54 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 200 len: 1522 microversion: 2.25 time: 0.462061 Oct 19 00:55:37.715113 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1316/2542] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:37 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:55:37.880074 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=40 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:38.000598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:38.001586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:38.023060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:38.023874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:38.024719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:38.026351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:38.031311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:38.032123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:38.214189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1847499586", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "21eb6968-4e21-4c3c-9e27-1e05098f2503"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:38.321354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] validate_networks() for [('21eb6968-4e21-4c3c-9e27-1e05098f2503', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:38.936212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:38.953436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a67d7d0-3d80-4522-b54d-2a23a9577d09 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 0.958410 Oct 19 00:55:38.956363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1317/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:37 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:38.970271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:38.974861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] [instance: e2b94506-e150-46f4-a7a3-b340d0ccb6d0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:38.988835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:38.989487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:38.989745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:38.990655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:38.991344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:38.991930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:39.022054 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] HTTP exception thrown: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Request method failure captured: Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 HTTP/1.1 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0k8h3GYHQqcAgpTw5kHaiy1baZ4d6lJWWsmdy7iQAYYfOUGDtMr2_dbaIi3POBBVnt-rkBgVVOC5sdvOGEZS2f4QOPg6WqP4PEFANImNUcilW20FAuTO3bAXnV23rV8fXgL61LZbyxwekoi2leuS4bHMZX_yoE3KR9s9iy06hHKw-Q Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.25 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9189bd828c41a88fe9333fb5ec9351", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9189bd828c41a88fe9333fb5ec9351"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9189bd828c41a88fe9333fb5ec9351"}]}] Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4c9189bd828c41a88fe9333fb5ec9351 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 5d0158da7efc485ebd6a1e1db617b5e7 Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1268152477-project Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e2b94506-e150-46f4-a7a3-b340d0ccb6d0'} Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. Oct 19 00:55:39.024996 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. Oct 19 00:55:39.030823 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:55:39.034415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] Returning 404 to user: Instance e2b94506-e150-46f4-a7a3-b340d0ccb6d0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:55:39.035530 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e218156-9822-4b65-85d8-6f9f7c4559b6 tempest-LiveAutoBlockMigrationV225Test-1268152477 tempest-LiveAutoBlockMigrationV225Test-1268152477-project] 10.222.0.27 "GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0" status: 404 len: 111 microversion: 2.25 time: 0.076204 Oct 19 00:55:39.037701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1318/2544] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:55:38 2022] GET /compute/v2.1/servers/e2b94506-e150-46f4-a7a3-b340d0ccb6d0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:55:39.046447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c116bff-b502-4bf6-a4b4-ab28b6b13aa9", "name": "network-vif-plugged", "status": "completed", "tag": "78717d72-62a5-4334-87db-f83b1087bbff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:39.060910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:39.062341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:39.063447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:39.090962 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] Creating event network-vif-plugged:78717d72-62a5-4334-87db-f83b1087bbff for instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 on n-h1-master-1 Oct 19 00:55:39.102419 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-93d0aeb7-74a0-4b19-8483-f768de196e36 req-eb5723ff-f51d-4205-8bbd-ba63580b7a24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062869 Oct 19 00:55:39.103906 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1319/2545] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:39.984806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:39.985565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:39.998035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:40.001747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:40.002420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:40.003354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:40.005646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:40.007957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:40.939824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:40.949901 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b056002-5249-446a-b0da-c10b2a07e6b3 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1314 microversion: 2.1 time: 0.972068 Oct 19 00:55:40.950864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1320/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:39 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1314 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:40.964074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:55:40.965364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:55:40.966163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:55:40.966874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:55:40.967671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:55:40.982818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:40.984969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:40.985784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:40.986687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:40.987271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:40.987866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:41.020853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Getting quotas for project 072952a76c8f483d9d8b5912b2e0ecb3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:41.028785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Getting quotas for user d76c8fd5fe0a49da9bad854cbe8c74e0 and project 072952a76c8f483d9d8b5912b2e0ecb3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:41.059997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:55:41.064955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:41.143414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ca3a64c1-9809-4573-834e-73e55d12aef9 tempest-ComputeTenantNetworksTest-2037314446 tempest-ComputeTenantNetworksTest-2037314446-project] Calling method '.version_select at 0x7f2af452aca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:41.144777 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39ed9b95-2fe6-4e3b-a3aa-e1952286a969 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.539288 Oct 19 00:55:41.152605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1227/2547] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:55:41.240331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1860576366", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:41.252321 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=5,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:41.339190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:42.123912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ca3a64c1-9809-4573-834e-73e55d12aef9 tempest-ComputeTenantNetworksTest-2037314446 tempest-ComputeTenantNetworksTest-2037314446-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.172008 Oct 19 00:55:42.131880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1321/2548] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 00:55:40 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:42.137555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:42.138520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:42.147139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.149264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.150003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:42.150956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.151670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.152445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:42.453546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:42.473267 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b8571e0f-b714-464d-9608-5a123facbb3f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1220 microversion: 2.1 time: 0.339685 Oct 19 00:55:42.476244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1322/2549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:42 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1220 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:42.487297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:42.502679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:42.503840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Searching by: {'deleted': False, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:55:42.509822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.512194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.512958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:42.513996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.514789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.516003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:42.547522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:55:42.614745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08e32b75-6a22-42c3-ac4e-e1fa21396986 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.136593 Oct 19 00:55:42.616085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1323/2550] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:55:42 2022] GET /compute/v2.1/servers => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:42.629725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:42.630659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:42.644842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.645408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.646078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:42.647034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:42.647700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:42.648427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:44.370588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:44.388940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb6e9a68-00e5-4dad-a889-7aeabfb28784 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1500 microversion: 2.1 time: 1.764429 Oct 19 00:55:44.388940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1324/2551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:42 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1500 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:44.424247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-368b9072-1313-43ff-b3a1-2f0be3ef14b8 tempest-ComputeTenantNetworksTest-2037314446 tempest-ComputeTenantNetworksTest-2037314446-project] Calling method '.version_select at 0x7f2af45ab8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:44.954532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:55:44.955237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:55:44.956825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:55:44.957322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:55:44.957929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:55:44.982959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:44.984413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-368b9072-1313-43ff-b3a1-2f0be3ef14b8 tempest-ComputeTenantNetworksTest-2037314446 tempest-ComputeTenantNetworksTest-2037314446-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/a7bf7d58-76a6-49be-b454-2ea16714a1bd" status: 200 len: 139 microversion: 2.1 time: 0.594392 Oct 19 00:55:44.992546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:44.992546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:44.992546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:44.994067 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1325/2552] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:55:44 2022] GET /compute/v2.1/os-tenant-networks/a7bf7d58-76a6-49be-b454-2ea16714a1bd => generated 139 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:45.001120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:45.005042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.005619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:45.010676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:45.011724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Searching by: {'deleted': False, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:55:45.021463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:45.022171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.022770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:45.024864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:45.025740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.026729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:45.062191 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:45.063993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:45.068033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:55:45.078601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:45.123895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:55:45.129186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:45.133888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:45.136438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:45.137140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.137735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:45.226719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-403e10ed-b63a-48a4-b6bd-2aaf71636841 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.072574 Oct 19 00:55:45.234871 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1228/2553] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 4081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:55:45.241259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:45.241971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:45.250953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:45.251760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.252378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:45.253373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:45.254041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:45.254932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:46.707501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5be00fb-59d7-4ec6-87b5-141e56da20b8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.710732 Oct 19 00:55:46.708335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1326/2554] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:55:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:46.714712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:46.721679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:46.732226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:46.733180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:46.734026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:46.734973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:46.735642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:46.736423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:46.758537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:46.766461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lazy-loading 'flavor' on Instance uuid 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:55:46.767207 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c700cf9f-87ae-443e-ab9c-2b2f3f1f14a5 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1324 microversion: 2.1 time: 1.530944 Oct 19 00:55:46.767807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1229/2555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:45 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1324 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:46.785258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:46.785761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:46.802134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:46.806149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:46.806149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:46.806149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:46.806149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:46.806149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:46.946496 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-162994e9-436d-4012-8d83-f8591203873f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "POST /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9/action" status: 200 len: 32 microversion: 2.1 time: 0.236375 Oct 19 00:55:46.952410 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1327/2556] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:55:46 2022] POST /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:55:46.960983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:46.976414 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-931ce36f-03af-41c0-9a31-09cc418b8abf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1245 microversion: 2.1 time: 0.197626 Oct 19 00:55:46.979742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1230/2557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:46 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1245 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:46.985336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:46.991543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d2172b7-ccc0-4bf2-93fc-4e653683ebf6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:46.999365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.000083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.000731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.010328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d2172b7-ccc0-4bf2-93fc-4e653683ebf6 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029230 Oct 19 00:55:47.010940 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1231/2558] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:55:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:47.018398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] Creating event network-changed:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:55:47.026928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dc95d00b-427e-46d2-a6f8-cbef15764124 req-e7c3c41b-627e-4671-b7f4-a29593eb83d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059905 Oct 19 00:55:47.028790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1328/2559] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:47.035090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:47.036007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:47.063869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.064387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.064871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.065604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.066075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.066508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.344341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:47.345386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:47.388127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.388677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.394625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.398947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.408037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.408504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.483903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:55:47.662359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25589a6f-0aa9-4d87-8590-39fff11d1f5c tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 204 len: 0 microversion: 2.1 time: 0.323549 Oct 19 00:55:47.667804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1329/2560] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:55:47 2022] DELETE /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:55:47.675709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:47.676684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:47.685219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.685961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.687268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:47.688207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:47.688849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:47.689616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:48.168332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:48.178701 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b28dc6d0-9380-45f1-ab12-17a31bb5d55c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 1.156387 Oct 19 00:55:48.180441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1232/2561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:47 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:48.201652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:48.202275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:48.209194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:48.209690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:48.210385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:48.211274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:48.212061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:48.212672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:48.224151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:48.238957 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32f6663c-c862-4b7f-9773-8098ab8e46e8 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1609 microversion: 2.1 time: 0.569078 Oct 19 00:55:48.240064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1330/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:47 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1609 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:48.247279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:48.248098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:48.257325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:48.258170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:48.258825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:48.259863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:48.260560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:48.261533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:48.450982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:48.465044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16c1155b-b39f-4c2d-b1ef-e00e25f3f70e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1251 microversion: 2.1 time: 0.223213 Oct 19 00:55:48.481945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1331/2563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:48 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1251 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:48.805203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c55f74f9-4848-4c50-af1d-bf0fae0c76cd tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Action: 'create', calling method: .version_select at 0x7f2af45c3280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1207622619"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:49.250965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:49.275370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fcad3ea8-0550-47df-b1be-84c13cf6ad89 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1324 microversion: 2.1 time: 1.076610 Oct 19 00:55:49.279715 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1233/2564] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:48 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1324 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:49.307917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:49.310460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:49.341154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:49.346032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:49.347300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:49.350476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:49.352257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:49.355864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:49.646402 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c55f74f9-4848-4c50-af1d-bf0fae0c76cd tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.163018 Oct 19 00:55:49.647021 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1332/2565] 10.222.0.27 () {60 vars in 1155 bytes} [Wed Oct 19 00:55:48 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1164 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 00:55:49.647021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:49.647021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:49.674719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:49.675210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:49.675665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:49.676384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:49.676874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:49.677307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:50.106194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:50.118577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-09d9868f-acf6-47c6-bb80-2a8c7fb956ef tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.835276 Oct 19 00:55:50.122085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1234/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:49 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:50.135517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:50.136201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:50.157970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:50.158858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:50.159552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:50.160600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:50.161294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:50.161933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:50.466939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:50.493116 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-178463f8-2890-47df-a6cf-f0d3c888dc1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1251 microversion: 2.1 time: 0.367574 Oct 19 00:55:50.493891 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1235/2567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:50 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1251 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:50.515397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7bd2c442-7ef9-499b-b383-42259842ade2 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af9349d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:50.637619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:50.649668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d19f2953-4f7f-49c2-9681-e348d66fbc81 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1609 microversion: 2.1 time: 1.001529 Oct 19 00:55:50.650373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1333/2568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:49 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1609 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:50.654416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7bd2c442-7ef9-499b-b383-42259842ade2 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 200 len: 345 microversion: 2.1 time: 0.158700 Oct 19 00:55:50.655832 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1236/2569] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:55:50 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:50.661062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:50.662049 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:50.678373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:50.679293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:50.679972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:50.681071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:50.682022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:50.682676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:50.819733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-822965244", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "46ba71fa-e628-448d-a535-bada2351f4e3"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:50.943147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] validate_networks() for [('46ba71fa-e628-448d-a535-bada2351f4e3', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:51.676921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:51.684984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c75c3579-4227-4735-bf64-93858d82c89d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1324 microversion: 2.1 time: 1.027723 Oct 19 00:55:51.689922 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1237/2570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:50 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1324 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:51.698815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:51.699896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:51.708435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:51.725497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:51.734655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:51.736930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:51.738516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:51.739314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:52.823491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:52.840541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca577c49-8cbb-4c6d-a15a-f597abe3207e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 1.149266 Oct 19 00:55:52.843069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1238/2571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:51 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:52.853135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:52.855787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:52.890731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:52.891650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:52.901800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:52.902888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:52.904453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:52.906384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:53.986370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:55:53.986825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:55:53.987278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:55:53.987693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:55:53.988210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:55:54.014702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.015758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.017733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.019652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.026163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.029164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.078116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:54.094181 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32fb3e27-bdca-4386-b667-5f4190b126c4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 1.245706 Oct 19 00:55:54.095629 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1239/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:52 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:54.105419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Getting quotas for project f527fed1e48e443785be3b655deb762b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:54.115565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Getting quotas for user ded977ea8c0b4e18bbef90de6a59a7d3 and project f527fed1e48e443785be3b655deb762b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:54.128867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8eefd164-c74a-498f-b934-9e734788ad58 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4d67f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:54.143915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:55:54.152918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:54.259336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8eefd164-c74a-498f-b934-9e734788ad58 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 200 len: 346 microversion: 2.1 time: 0.158055 Oct 19 00:55:54.260440 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1240/2573] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:55:54 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:54.267715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:54.270084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:54.292529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.293235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.293889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.296659 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-763465b2-a859-4862-b671-12e342986a83 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.626896 Oct 19 00:55:54.297175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.298019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1334/2574] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:55:54.303398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:54.304535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:54.306275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.308589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.317094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.317601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.318048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.323732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.324744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.330482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.483540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:54.492907 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98efeec6-f075-4292-b828-50869498215a tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1252 microversion: 2.1 time: 0.230939 Oct 19 00:55:54.498269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1241/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:54 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1252 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:54.513320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c74d8ba-3f10-4092-9af2-8e81b6ae8476", "name": "network-vif-deleted", "tag": "c5e1fc2d-c598-47ee-b664-93a8f4c3812c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:54.557064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.557721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.560467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.612639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] Creating event network-vif-deleted:c5e1fc2d-c598-47ee-b664-93a8f4c3812c for instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 on n-h1-master-1 Oct 19 00:55:54.626056 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9b9daef2-c937-4318-85fc-18e835fc2e60 req-5349c2a0-c194-4d27-b93f-c18b131438a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125639 Oct 19 00:55:54.626752 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1242/2576] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:54.646585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:54.647316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:54.659394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.659907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.662597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:54.663392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:54.663822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:54.664268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.034221 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:55.102714 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:55.125554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:55.139868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29ec361f-21b3-4d5d-aacf-469e3f2fd4dc tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1324 microversion: 2.1 time: 0.838201 Oct 19 00:55:55.141730 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1335/2577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:54 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1324 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:55.157254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "name": "network-vif-plugged", "status": "completed", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:55.172075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:55.172563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:55.173245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.189069 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] Creating event network-vif-plugged:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:55:55.194758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-13b8e8ef-60fe-4256-8a86-e48bafdc1100 req-5ce3afe5-ede9-44f5-98e3-048efa406877 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050669 Oct 19 00:55:55.195581 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1336/2578] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:55.204251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3c16132-c51e-4ae7-b0d2-cab6ac19fd75 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Action: 'create', calling method: .version_select at 0x7f2af45ff1f0>, body: {"snapshot": {"volume_id": "87c7a3b3-c594-434a-9817-0510134f432d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-163167033"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:55.307050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:55.327940 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26a1a45b-9823-4e67-bd8b-9ec94e25abaa tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.685741 Oct 19 00:55:55.328605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1243/2579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:54 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:55.340180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:55.340870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:55.371526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:55.372038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:55.372532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.375008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:55.380196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:55.380913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.596434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3c16132-c51e-4ae7-b0d2-cab6ac19fd75 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.399100 Oct 19 00:55:55.597099 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1337/2580] 10.222.0.27 () {60 vars in 1162 bytes} [Wed Oct 19 00:55:55 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:55.687068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:55.741891 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e10787a8-d5d2-4642-84b0-7b0a434b5685 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1220 microversion: 2.1 time: 0.410710 Oct 19 00:55:55.772559 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1244/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:55 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1220 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:55.779146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:55.780672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:55.787433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:55.788486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:55.789192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.790943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:55.803110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:55.806344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:55.831152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-384809324", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8bb3b367-cc1e-4e97-bbd9-3cb6c648a11f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:55.985474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] validate_networks() for [('8bb3b367-cc1e-4e97-bbd9-3cb6c648a11f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:55:56.839126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:56.860250 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-339d5f6c-a400-4e9a-abc5-c599af613a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 1.085850 Oct 19 00:55:56.869494 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1245/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:55 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:56.891044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:56.892026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:56.899289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:56.900109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:56.900800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:56.901762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:56.902422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:56.903050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:57.022447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:57.026127 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:55:57.045079 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9d450da-935a-4e29-8df5-471c3dd77b9d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1252 microversion: 2.1 time: 0.160122 Oct 19 00:55:57.063643 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1246/2583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:56 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1252 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:57.067159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d8fc039-9914-49d8-94c0-b921f257f8fe tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4d399d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:57.140727 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d8fc039-9914-49d8-94c0-b921f257f8fe tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05" status: 200 len: 286 microversion: 2.1 time: 0.086516 Oct 19 00:55:57.141536 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1247/2584] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:55:57 2022] GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:57.146740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:57.147663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:57.159669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:57.163150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:57.163917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:57.164879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:57.166722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:57.172216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.232376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:58.242631 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39a20d25-607d-48af-9b6f-a3f2ee6d7c13 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1324 microversion: 2.1 time: 1.099813 Oct 19 00:55:58.243251 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1248/2585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:57 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1324 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:58.256286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:58.259125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:58.272379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.276218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.276959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.284532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.285515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.286404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.413176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:55:58.413695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:55:58.414078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:55:58.414500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:55:58.414921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:55:58.438521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.439067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.439537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.440290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.440781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.441219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.493313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Getting quotas for project 5017de8e297545248369595fa5db2f7d. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:55:58.500990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Getting quotas for user b8c5c0d3f9394736829782c7ac69ff05 and project 5017de8e297545248369595fa5db2f7d. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:55:58.559864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Going to run 3 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:55:58.567661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:58.665918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=f2b2c023-b2ff-4239-92d4-a36a544617d9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:58.724588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=43266cbd-2735-482a-b9da-f53806435449,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:55:58.875451 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e5ad0f3-366c-4080-87f1-fa439c0b1eab tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.268297 Oct 19 00:55:58.876594 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1338/2586] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:55:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:55:58.882995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:58.884182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:58.901334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.902003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.902541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:58.903400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:58.903956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:58.904503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.347943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:59.367952 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe9bcbd6-178a-4e29-bab6-f070afbd4d30 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 1.118607 Oct 19 00:55:59.391780 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1249/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:58 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:59.401141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-845d8b0a-678e-4316-9534-28e70c9c70a8 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af93490d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:59.513676 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-845d8b0a-678e-4316-9534-28e70c9c70a8 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.119142 Oct 19 00:55:59.514950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1250/2588] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 00:55:59 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:59.525010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2", "tag": "38fb0bfd-8693-4276-af89-25bcd04edb6d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:55:59.533369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:55:59.542839 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-70ef7bce-9d06-4c54-9ad3-4b28daf5b641 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.665102 Oct 19 00:55:59.558140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:59.558901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:59.559580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.561668 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1339/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:58 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:55:59.596956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:59.621514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:59.627626 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] Creating event network-changed:38fb0bfd-8693-4276-af89-25bcd04edb6d for instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 on n-h1-master-1 Oct 19 00:55:59.641760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:59.646293 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e0796b3e-1667-446c-923e-ce4246c5de7f req-3be33ad6-a194-4c45-9c58-4614c4e1a12a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127428 Oct 19 00:55:59.646510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:59.647088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.647897 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1251/2590] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:55:59.649248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:59.653119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:59.656043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:55:59.657604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.658286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:55:59.677548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:59.678359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:59.679054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.680513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:55:59.681816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:55:59.682690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:55:59.992463 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:00.026539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b49570b0-20ca-4997-b99e-6b80ec742b84 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1252 microversion: 2.1 time: 0.360013 Oct 19 00:56:00.032498 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1252/2591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:59 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1252 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:00.052731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:00.083555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:00.084703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:00.149894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:00.151093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:00.151737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:00.153730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:00.155852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:00.156854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:00.191204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Listed batch of 1 results from cell out of 997 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:56:00.235569 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd1f3baa-7565-42f2-8a50-4dab1b2fd75f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.201611 Oct 19 00:56:00.236796 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1253/2592] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:56:00 2022] GET /compute/v2.1/servers => generated 1015 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:00.243202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:00.244114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:00.252440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:00.253257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:00.253883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:00.255645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:00.256302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:00.257026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:00.908467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:00.930685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-526d1d61-05aa-497e-a7c3-4ae275e5c3ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 1.334487 Oct 19 00:56:00.940728 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1340/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:55:59 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:00.965508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af086990-288f-4ce5-81fe-ddf9e7ede169 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af453be50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:01.002356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:01.010881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9be6f93-411c-4868-9148-2e63a011c480 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1517 microversion: 2.1 time: 0.772530 Oct 19 00:56:01.023078 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1254/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:00 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1517 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:01.036442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:01.037201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:01.068995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.078415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.078415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:01.079386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.079966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.080535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:01.082415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af086990-288f-4ce5-81fe-ddf9e7ede169 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05" status: 200 len: 287 microversion: 2.1 time: 0.148803 Oct 19 00:56:01.083196 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1341/2595] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:56:00 2022] GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:01.091153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:01.092099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:01.114748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.127784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.128486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:01.129605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.133023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.133661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:01.496897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:01.509259 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd6c105b-07ee-46a9-b9bd-033bfde6e8c2 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1226 microversion: 2.1 time: 0.483553 Oct 19 00:56:01.509878 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1255/2596] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:01 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1226 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:01.524093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:01.528694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:01.545861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.550377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.553479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:01.560158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:01.561946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:01.563368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:02.648368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:02.656935 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34843a72-0ca2-48e1-a1b2-115f01c16e90 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 1.572484 Oct 19 00:56:02.657545 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1342/2597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:01 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:02.690613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad9cfb5c-362a-40e0-800d-09f654e34952 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'create', calling method: .version_select at 0x7f2af452baf0>, body: {"pool": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:03.150632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:03.164379 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e87470cd-9fd4-4355-8f6e-0e068de17765 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 1.653344 Oct 19 00:56:03.176691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1256/2598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:01 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:03.181903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:03.181903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:03.208434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:03.209419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:03.212656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:03.213536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:03.214876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:03.219858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:03.304282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:03.309319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:03.310114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:03.311590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lazy-loading 'fault' on Instance uuid 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:56:03.478187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdea18bdbdad41babeb869506d9e602f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c2fa98925ac4de19cd7cba6ef8b3b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:03.492409 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c478db7-dd66-4465-a811-2271936ffe28 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 200 len: 1257 microversion: 2.1 time: 0.321051 Oct 19 00:56:03.497601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1257/2599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:03 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 1257 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:03.503432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9bdf32b1-ad1b-487d-85f3-7d060c26175c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4c74ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:03.760738 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9bdf32b1-ad1b-487d-85f3-7d060c26175c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05" status: 202 len: 0 microversion: 2.1 time: 0.261369 Oct 19 00:56:03.761453 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1258/2600] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 00:56:03 2022] DELETE /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:03.767762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:03.767960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:03.792833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:03.793501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:03.794199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:03.801883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:03.803330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:03.817949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:04.516060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:04.525496 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b52050c4-a337-467c-b044-ea3535137599 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 0.762599 Oct 19 00:56:04.526102 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1259/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:03 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:04.544946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:04.546071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:04.578590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:04.579527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:04.580147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:04.581075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:04.581699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:04.582298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:04.960320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:04.969572 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f5c0e9e-c784-47d0-8ca9-2ca96391d316 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1280 microversion: 2.1 time: 0.431560 Oct 19 00:56:04.980228 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1260/2602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:04 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:04.985504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:04.986137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:04.998119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:04.999869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:05.000504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:05.001464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:05.002101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:05.002722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:05.886266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:05.899086 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6da3e027-7aa7-4252-a3e7-0039bbc9e45c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.917564 Oct 19 00:56:05.901897 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1261/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:04 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:05.910179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f4a306c-3231-4f04-b2e1-d1232c77cc3b tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af93833a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:05.975595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f4a306c-3231-4f04-b2e1-d1232c77cc3b tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05" status: 200 len: 286 microversion: 2.1 time: 0.072093 Oct 19 00:56:05.976402 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1262/2604] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:56:05 2022] GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:05.981454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:05.983739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:06.005591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.008788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.013498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.014739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.015392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.021731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.773841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:06.790445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb4ad5c6-441b-4555-982f-e4a9acf2d5c2 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.812468 Oct 19 00:56:06.793962 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1263/2605] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:05 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:06.804871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:06.809443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] [instance: 3c74d8ba-3f10-4092-9af2-8e81b6ae8476] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:06.826225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.829958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.835013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.836209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.836997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.838028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.876984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] HTTP exception thrown: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Request method failure captured: Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 HTTP/1.1 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0qZLY91ooygmT7xBHxHzdvsg0wDGgj21ZMEfAWCXwOsc9mNIyABrqjmAqyrqOaXmipp9jZji0N1p73fI78aYQ6DyAoXjHdw7Z2EDDBL-WDUcFx3C20-QRoV1fTYxUNnEcTlAaSyXUWPY41k7RlOBihofGN0wc5AdsCHDgrwwXl825s Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 9c2fa98925ac4de19cd7cba6ef8b3b2c Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestBootFromVolume-61959946 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c2fa98925ac4de19cd7cba6ef8b3b2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2fa98925ac4de19cd7cba6ef8b3b2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c2fa98925ac4de19cd7cba6ef8b3b2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c2fa98925ac4de19cd7cba6ef8b3b2c"}]}] Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestBootFromVolume-61959946 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 9c2fa98925ac4de19cd7cba6ef8b3b2c Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestBootFromVolume-61959946 Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestBootFromVolume-61959946-project Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cdea18bdbdad41babeb869506d9e602f Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestBootFromVolume-61959946-project Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3c74d8ba-3f10-4092-9af2-8e81b6ae8476'} Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:06.886250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. Oct 19 00:56:06.891291 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:06.895362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Returning 404 to user: Instance 3c74d8ba-3f10-4092-9af2-8e81b6ae8476 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:06.898064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b42f5ea5-1439-4399-869b-6b5054e7133d tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476" status: 404 len: 111 microversion: 2.1 time: 0.102786 Oct 19 00:56:06.901232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1264/2606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:06 2022] GET /compute/v2.1/servers/3c74d8ba-3f10-4092-9af2-8e81b6ae8476 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:06.909833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3863db-620b-4d51-9a2d-24b90fa88195", "tag": "150c50fc-7e19-4384-810b-a7c76d13524f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:06.922825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.926877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.927920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.947723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] Creating event network-changed:150c50fc-7e19-4384-810b-a7c76d13524f for instance 3b3863db-620b-4d51-9a2d-24b90fa88195 on n-h2-master-1 Oct 19 00:56:06.960727 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-25ddc2db-961f-4f27-8af0-cada57236b3f req-ab26f5f4-8786-4f15-9e17-85fe26e40ac8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056998 Oct 19 00:56:06.964309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1265/2607] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:06.972865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:06.973883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:06.984524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.985389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.986130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:06.987062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:06.987936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:06.988604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.216775 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:07.227819 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-467069f7-0e62-490c-9402-f286f84a36bd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 0.261451 Oct 19 00:56:07.229303 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1266/2608] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:06 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:07.241045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:07.245420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:07.259086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:07.259586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:07.260036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.265029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:07.265659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:07.266122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.719127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:07.728477 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-590972c6-b788-44f1-a491-4fc9d2dcf2ca tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.497398 Oct 19 00:56:07.728930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1267/2609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:07 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:07.744759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2", "name": "network-vif-plugged", "status": "completed", "tag": "38fb0bfd-8693-4276-af89-25bcd04edb6d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:07.765045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:07.765539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:07.765978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.784355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] Creating event network-vif-plugged:38fb0bfd-8693-4276-af89-25bcd04edb6d for instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 on n-h1-master-1 Oct 19 00:56:07.796020 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-89e857a2-3269-4907-9fc4-4c3238408f11 req-30b00044-f9be-40c2-9104-caa73eb4ca2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065017 Oct 19 00:56:07.801248 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1268/2610] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:07.808364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e13854f6-2389-43e5-adc1-dc6fc9b01137 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] Calling method '.version_select at 0x7f2af4fafca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:07.836728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e13854f6-2389-43e5-adc1-dc6fc9b01137 tempest-ServersTestBootFromVolume-61959946 tempest-ServersTestBootFromVolume-61959946-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-559977234" status: 202 len: 0 microversion: 2.1 time: 0.033487 Oct 19 00:56:07.839280 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1269/2611] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:56:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-559977234 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:07.851985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:07.853284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:07.868925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:07.869858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:07.871131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.872080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:07.873544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:07.874190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:07.895637 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:08.257988 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad9cfb5c-362a-40e0-800d-09f654e34952 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.572081 Oct 19 00:56:08.259589 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1343/2612] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:56:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:08.265203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be15a831-ea33-4b6a-9da9-a3207753ff96 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4504d30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:08.302617 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-be15a831-ea33-4b6a-9da9-a3207753ff96 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] HTTP exception thrown: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be15a831-ea33-4b6a-9da9-a3207753ff96 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Request method failure captured: Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 HTTP/1.1 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sTJw08xpQQAzUA9PB_dEEFnpcozqfzukC1iarLa5LdDL51dEMpPVMFxKgQPknckx9xtAlj5uXntR1z1_a4Hq2Ev49apZyJgTil4wX5kIAD1-0tqO57DCwu9eBOpwevZM7ZfLAiWpFR1xHZPL7tbj4AH0lvGfjK4ErS-Kzan_ZEzX8 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af067aa2424f4529b0fe9908bdc1e1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}] Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 310cf7ecbd9c40bdbd1bdbcea54e6a95 Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: exception: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b45aa9f4-e254-4034-a02b-9c126fbeee05'} Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. (HTTP 404) (Request-ID: req-33848560-af77-4231-8d10-6ee6e43476bc) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:08.310774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. Oct 19 00:56:08.315202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:08.319666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be15a831-ea33-4b6a-9da9-a3207753ff96 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Returning 404 to user: Snapshot b45aa9f4-e254-4034-a02b-9c126fbeee05 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:08.320958 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be15a831-ea33-4b6a-9da9-a3207753ff96 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05" status: 404 len: 111 microversion: 2.1 time: 0.059879 Oct 19 00:56:08.322237 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1344/2613] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 00:56:08 2022] GET /compute/v2.1/os-snapshots/b45aa9f4-e254-4034-a02b-9c126fbeee05 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:08.332314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:08.338782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:08.345462 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:08.353069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:08.365076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:08.365810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:08.366420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:08.366894 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7a9adc41-6876-43b7-a2ef-e83ef92a02b0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.524981 Oct 19 00:56:08.383412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1270/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:07 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:08.384902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:08.385063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:08.385830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:08.385954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:08.386984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:08.399856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:08.405703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:08.406480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:08.415389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:08.419448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:08.423460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:08.468721 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:08.527417 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:08.960578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:08.969906 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbeb1fea-4aee-413d-afc3-33cb4abbacd0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.646385 Oct 19 00:56:08.971189 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1345/2615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:08 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:08.977550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ffb7d2e-9d07-42ea-a02b-1afcc8e3e92e tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af45043a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:09.060031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:09.077618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a698b5ae-f98a-4dd3-b736-23ddbd9e06cd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1293 microversion: 2.1 time: 0.703990 Oct 19 00:56:09.078306 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1271/2616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:08 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1293 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:09.101048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ffb7d2e-9d07-42ea-a02b-1afcc8e3e92e tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 202 len: 0 microversion: 2.1 time: 0.128519 Oct 19 00:56:09.101754 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1346/2617] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:56:08 2022] DELETE /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:09.113290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:09.114545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:09.125532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1954975635", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "21eb6968-4e21-4c3c-9e27-1e05098f2503"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:09.129696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:09.131276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:09.133775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:09.135798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:09.138337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:09.138805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:09.187019 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:09.236068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] validate_networks() for [('21eb6968-4e21-4c3c-9e27-1e05098f2503', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:56:09.634197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:09.645674 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f730ded6-7256-4b26-960a-47cdcbe1db23 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.542453 Oct 19 00:56:09.652011 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1347/2618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:09 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:09.660407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-75bab372-47c0-48b7-bfdf-438d9d78747b tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4588af0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:09.764892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-75bab372-47c0-48b7-bfdf-438d9d78747b tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 200 len: 345 microversion: 2.1 time: 0.110891 Oct 19 00:56:09.765585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1348/2619] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:09 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:09.785275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:09.786872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:09.795332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:09.796263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:09.796925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:09.799134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:09.802023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:09.802707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.171706 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:10.418232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:10.437656 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbb5156d-83f6-4690-919c-94e173162942 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.670251 Oct 19 00:56:10.439969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1349/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:09 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:10.472372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:56:10.473063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:56:10.474240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:56:10.475023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:56:10.475685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:56:10.488588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b2c023-b2ff-4239-92d4-a36a544617d9", "tag": "9451413f-0cad-45a2-a6b6-2a90969aa380"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:10.492927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.493723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.496263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.499036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.502233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.503868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.522045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.522999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.523690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.575203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] Creating event network-changed:9451413f-0cad-45a2-a6b6-2a90969aa380 for instance f2b2c023-b2ff-4239-92d4-a36a544617d9 on n-h2-master-1 Oct 19 00:56:10.595892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-76bacae0-b180-4d22-868b-9ff36893033b req-22a4a227-4527-459b-823f-427f3e764a45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129412 Oct 19 00:56:10.600194 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1350/2621] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:10.612095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Getting quotas for project 072952a76c8f483d9d8b5912b2e0ecb3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:10.614902 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:10.617361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:10.620174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:10.625357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Getting quotas for user d76c8fd5fe0a49da9bad854cbe8c74e0 and project 072952a76c8f483d9d8b5912b2e0ecb3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:10.641136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.644166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.647493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.649676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.651772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.653541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.666626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:56:10.669687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:56:10.782246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-311be6ab-d214-423b-aa96-cb49a4186dff tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.662815 Oct 19 00:56:10.783146 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1272/2622] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:56:10.794431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:10.798068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:10.823454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.824551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.825649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:10.828245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:10.830357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:10.831761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:11.327227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:11.349002 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52962365-7d1a-4258-b436-ece246d24e5c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.744044 Oct 19 00:56:11.368712 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1351/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:10 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:11.384755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:11.387647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:11.403577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:11.404086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:11.405097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:11.405865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:11.406276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:11.406706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:11.477527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:11.487597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95c94ac9-9466-47a9-a9d7-12bd8fa30756 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1474 microversion: 2.1 time: 0.700280 Oct 19 00:56:11.491975 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1273/2624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:10 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1474 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:11.500152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1eaaa0a1-da71-4a4f-88cb-a5b360988d88 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4e33d30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:11.590517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1eaaa0a1-da71-4a4f-88cb-a5b360988d88 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 200 len: 345 microversion: 2.1 time: 0.097163 Oct 19 00:56:11.591117 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1274/2625] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:11 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:11.596076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1868daa3-2c03-4c89-b3e2-f5148215f0e8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:11.597025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1868daa3-2c03-4c89-b3e2-f5148215f0e8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:11.767033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1868daa3-2c03-4c89-b3e2-f5148215f0e8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:11.779153 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1868daa3-2c03-4c89-b3e2-f5148215f0e8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1224 microversion: 2.1 time: 0.186712 Oct 19 00:56:11.792658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1275/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:11 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1224 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:11.792658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3863db-620b-4d51-9a2d-24b90fa88195", "name": "network-vif-plugged", "status": "completed", "tag": "150c50fc-7e19-4384-810b-a7c76d13524f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:11.823721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:11.824328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:11.824818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:11.849244 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] Creating event network-vif-plugged:150c50fc-7e19-4384-810b-a7c76d13524f for instance 3b3863db-620b-4d51-9a2d-24b90fa88195 on n-h2-master-1 Oct 19 00:56:11.863620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-74a17f41-37ed-4d06-9065-34f592cb5e22 req-9f22f1b9-356a-46fc-a054-e38b6bb7c3ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080718 Oct 19 00:56:11.865291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1276/2627] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:11.879362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:11.881189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:11.913224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:11.914835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:11.916387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:11.920588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:11.922460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:11.937745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:12.017355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:12.028074 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87a4553d-a29e-46e8-8d6f-795943342616 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.654575 Oct 19 00:56:12.029030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1352/2628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:11 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:12.037752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1370990854", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:12.114594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:56:12.281508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:12.298031 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98490260-f075-4b19-95e2-32517880ae5c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.430387 Oct 19 00:56:12.337049 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1277/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:11 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:12.372379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:12.373686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:12.382210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:12.382982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:12.383618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:12.384731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:12.385358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:12.385957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:12.966220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:12.978483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1048a686-c45c-478a-a7a1-6316801489b3 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.610737 Oct 19 00:56:12.979114 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1278/2630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:12 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:12.986407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1625075e-2c30-436f-801d-95dd83002cc5 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af9491040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:13.065694 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1625075e-2c30-436f-801d-95dd83002cc5 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] HTTP exception thrown: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1625075e-2c30-436f-801d-95dd83002cc5 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Request method failure captured: Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d HTTP/1.1 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sTJw08xpQQAzUA9PB_dEEFnpcozqfzukC1iarLa5LdDL51dEMpPVMFxKgQPknckx9xtAlj5uXntR1z1_a4Hq2Ev49apZyJgTil4wX5kIAD1-0tqO57DCwu9eBOpwevZM7ZfLAiWpFR1xHZPL7tbj4AH0lvGfjK4ErS-Kzan_ZEzX8 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af067aa2424f4529b0fe9908bdc1e1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}] Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 310cf7ecbd9c40bdbd1bdbcea54e6a95 Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: exception: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '87c7a3b3-c594-434a-9817-0510134f432d'} Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. (HTTP 404) (Request-ID: req-5a4a541c-69fd-41b5-b619-82477bc0af4b) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:13.067759 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1625075e-2c30-436f-801d-95dd83002cc5 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Returning 404 to user: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:13.072222 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1625075e-2c30-436f-801d-95dd83002cc5 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 404 len: 109 microversion: 2.1 time: 0.086878 Oct 19 00:56:13.077632 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1279/2631] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:12 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:13.080856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43266cbd-2735-482a-b9da-f53806435449", "tag": "3370d9d8-c7a9-48b3-bf48-4cdb7acdc995"}, {"name": "network-changed", "server_uuid": "00a4cde8-09b7-410a-b77f-1b523e8299f9", "tag": "33999f42-701a-41ba-80a2-fae426fc40d5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:13.105822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.106317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.106995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.129661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Creating event network-changed:3370d9d8-c7a9-48b3-bf48-4cdb7acdc995 for instance 43266cbd-2735-482a-b9da-f53806435449 on n-h1-master-1 Oct 19 00:56:13.130522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] Creating event network-changed:33999f42-701a-41ba-80a2-fae426fc40d5 for instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 on n-h2-master-1 Oct 19 00:56:13.156878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5a90ac2e-4627-4614-b15e-dd21be61409d req-5c0876ff-f578-4d5f-9c6c-3b35bb9da3f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081051 Oct 19 00:56:13.157505 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1280/2632] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:13.162767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:13.163576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:13.182960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.183463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.183914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.184646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.185119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.185559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.382540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:13.395513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08fa2ad9-a29b-45ef-a255-f0902bda974b tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1276 microversion: 2.1 time: 0.236133 Oct 19 00:56:13.403810 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1281/2633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:13 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:13.416517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:13.417189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:13.425501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.426001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.426723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.427940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.428652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.429561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.499858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:56:13.501179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:56:13.502079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:56:13.503403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:56:13.504266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:56:13.523026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.523532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.523972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.529755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.530408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.531494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.555538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:13.562820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:13.578292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:56:13.580739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:56:13.651656 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf4167d8-641f-4527-8526-0032b78a82f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620881 Oct 19 00:56:13.660923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1353/2634] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:56:13.668028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69e340fa-87eb-4652-8f28-0d41d8ebede7 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af4504700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:13.722983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-69e340fa-87eb-4652-8f28-0d41d8ebede7 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] HTTP exception thrown: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69e340fa-87eb-4652-8f28-0d41d8ebede7 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Request method failure captured: Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d HTTP/1.1 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sTJw08xpQQAzUA9PB_dEEFnpcozqfzukC1iarLa5LdDL51dEMpPVMFxKgQPknckx9xtAlj5uXntR1z1_a4Hq2Ev49apZyJgTil4wX5kIAD1-0tqO57DCwu9eBOpwevZM7ZfLAiWpFR1xHZPL7tbj4AH0lvGfjK4ErS-Kzan_ZEzX8 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af067aa2424f4529b0fe9908bdc1e1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}] Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 310cf7ecbd9c40bdbd1bdbcea54e6a95 Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: exception: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '87c7a3b3-c594-434a-9817-0510134f432d'} Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. (HTTP 404) (Request-ID: req-43b1d858-cc75-415d-a332-62cc5fbd6096) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:13.726125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:13.730223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69e340fa-87eb-4652-8f28-0d41d8ebede7 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Returning 404 to user: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:13.735422 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69e340fa-87eb-4652-8f28-0d41d8ebede7 tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 404 len: 109 microversion: 2.1 time: 0.068582 Oct 19 00:56:13.735422 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1354/2635] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:56:13 2022] DELETE /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:13.740947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:13.741656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:13.750799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.751369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.751882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.752797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:13.753352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:13.754031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:13.755583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:13.766700 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-27796913-8d29-45b7-8647-09b560d0c1f1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.361652 Oct 19 00:56:13.771887 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1282/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:13 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:13.938534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e021f0f5-40e6-483b-99f3-cac3135d7589 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af4d52820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.023140 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e021f0f5-40e6-483b-99f3-cac3135d7589 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549" status: 200 len: 371 microversion: 2.1 time: 0.249841 Oct 19 00:56:14.023885 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1283/2637] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:56:13 2022] GET /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:14.028930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80c1e18c-ecb7-4576-b9c5-54a835b33138 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.029582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80c1e18c-ecb7-4576-b9c5-54a835b33138 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:14.047675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80c1e18c-ecb7-4576-b9c5-54a835b33138 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:14.267795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:14.283382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-903d1979-214f-4f59-9c12-864914ed5f1e tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.545685 Oct 19 00:56:14.298129 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1355/2638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:13 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:14.312209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.scheduler.client.report [None req-80c1e18c-ecb7-4576-b9c5-54a835b33138 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Deleted allocations for instance 9de65650-94b2-4e53-b933-0d63547b4f40 Oct 19 00:56:14.314464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57adc404-e4bc-4bda-a133-96db142ae00c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Calling method '.version_select at 0x7f2af458aa60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.336167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80c1e18c-ecb7-4576-b9c5-54a835b33138 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40" status: 204 len: 0 microversion: 2.1 time: 0.310892 Oct 19 00:56:14.338771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1284/2639] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:14 2022] DELETE /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:14.349634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.350188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:14.356331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.356880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.358055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.359530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.360171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.360318 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-57adc404-e4bc-4bda-a133-96db142ae00c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] HTTP exception thrown: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:14.360938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57adc404-e4bc-4bda-a133-96db142ae00c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Request method failure captured: Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d HTTP/1.1 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sTJw08xpQQAzUA9PB_dEEFnpcozqfzukC1iarLa5LdDL51dEMpPVMFxKgQPknckx9xtAlj5uXntR1z1_a4Hq2Ev49apZyJgTil4wX5kIAD1-0tqO57DCwu9eBOpwevZM7ZfLAiWpFR1xHZPL7tbj4AH0lvGfjK4ErS-Kzan_ZEzX8 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af067aa2424f4529b0fe9908bdc1e1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af067aa2424f4529b0fe9908bdc1e1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af067aa2424f4529b0fe9908bdc1e1c1"}]}] Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: af067aa2424f4529b0fe9908bdc1e1c1 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2106971660 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 310cf7ecbd9c40bdbd1bdbcea54e6a95 Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2106971660-project Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: exception: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '87c7a3b3-c594-434a-9817-0510134f432d'} Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. (HTTP 404) (Request-ID: req-a2e6ed57-4f64-4099-8845-7e3c76b09397) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:14.363227 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57adc404-e4bc-4bda-a133-96db142ae00c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] Returning 404 to user: Volume 87c7a3b3-c594-434a-9817-0510134f432d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57adc404-e4bc-4bda-a133-96db142ae00c tempest-VolumesSnapshotsTestJSON-2106971660 tempest-VolumesSnapshotsTestJSON-2106971660-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d" status: 404 len: 109 microversion: 2.1 time: 0.059247 Oct 19 00:56:14.367824 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1356/2640] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/os-volumes/87c7a3b3-c594-434a-9817-0510134f432d => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:14.378931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Action: 'update', calling method: .version_select at 0x7f2af45284c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:14.473552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.474455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.475330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.476390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.477054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.477806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.555911 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-35feb437-4d2d-4509-924a-d617773bcab1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549" status: 200 len: 328 microversion: 2.1 time: 0.188021 Oct 19 00:56:14.557200 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1357/2641] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:56:14 2022] PUT /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549 => generated 328 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:14.562747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.563707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:14.571315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.571801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.572489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.573436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.574062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.574998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.695050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:14.709476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b8237c1-84c5-4b36-b7fb-801c77a243f2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40" status: 200 len: 1213 microversion: 2.1 time: 0.150944 Oct 19 00:56:14.711033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1358/2642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:14.717423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.718304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:14.726954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.727555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.728100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.729567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.730303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.731786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.751094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:14.763333 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ebaee4ac-e54b-4d03-9e22-99ee837e0588 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1316 microversion: 2.1 time: 0.419186 Oct 19 00:56:14.764209 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1285/2643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:14.772069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b308248-3c4d-4f89-bbac-6f80b345af55 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.793861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b308248-3c4d-4f89-bbac-6f80b345af55 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549" status: 202 len: 0 microversion: 2.1 time: 0.025993 Oct 19 00:56:14.794673 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1286/2644] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:14 2022] DELETE /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:14.803674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:14.804512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:14.811148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.811724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.812003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.812742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:14.816732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:14.817883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:14.884984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:14.898719 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2805a09-5f66-44de-a741-3398e7a28225 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1276 microversion: 2.1 time: 0.186373 Oct 19 00:56:14.900405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1359/2645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:14.908212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-200008b3-e1d3-426c-be9e-4e54ea825ff1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af4528820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:15.339327 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-200008b3-e1d3-426c-be9e-4e54ea825ff1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549" status: 200 len: 371 microversion: 2.1 time: 0.435685 Oct 19 00:56:15.342690 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1360/2646] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/os-quota-sets/973e53b78eb047b0980c820af4d4f549 => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:15.371196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:15.374653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:15.387513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:15.401683 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-84b01eb4-1ea9-4080-9fc5-f0bb5c92e65c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.601843 Oct 19 00:56:15.402793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1287/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:14 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:15.415626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:15.416008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:15.426664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:15.430331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:15.434155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:15.437313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:15.667917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8e4478e7-0777-4147-868c-d35c747bd597 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af9332ee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:16.133677 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8e4478e7-0777-4147-868c-d35c747bd597 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02/defaults" status: 200 len: 371 microversion: 2.1 time: 0.469496 Oct 19 00:56:16.143899 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1288/2648] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:56:15 2022] GET /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02/defaults => generated 371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:56:16.148978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:16.149605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:16.171656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.172239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.186650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.190012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.190504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.190956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.230167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 HTTP/1.1 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9de65650-94b2-4e53-b933-0d63547b4f40'} Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:16.233332 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:16.238408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d50187de-e985-45bf-a2bb-ec9d39fbf164 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40" status: 404 len: 111 microversion: 2.1 time: 0.091051 Oct 19 00:56:16.249766 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1289/2649] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:16 2022] GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:16.276469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:16.278939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:16.302933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.303882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.305595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.306526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.308654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.310155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.641673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:16.650513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b479317-e1c8-465a-ab1a-4148bf2b7a94 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1486 microversion: 2.1 time: 1.306535 Oct 19 00:56:16.651648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1361/2650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:15 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1486 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:16.657132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:16.657985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:16.664203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.664958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.665584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.666478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.667096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.667688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.736987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:16.766929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f3e185c-3923-4299-8888-d27702c476b6 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1505 microversion: 2.1 time: 0.507773 Oct 19 00:56:16.792874 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1290/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:16 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1505 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:16.799078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:16.799606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:16.800645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:16.809542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.810345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.811627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.812333 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-72699891-a71b-4b20-a9b5-d82d28f2ec62 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1282 microversion: 2.1 time: 0.158308 Oct 19 00:56:16.813182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:16.814159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:16.815131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1362/2652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:16 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:16.825195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1940382572", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:16.829169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:16.905031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:56:17.807464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:17.816741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0d55e1c-a958-4f9f-a3a4-d19057a1d60a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 1.022220 Oct 19 00:56:17.817531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1291/2653] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:16 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:17.825304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4e4eca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:18.227741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.228640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.229312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.230388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.231078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.231784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.342877 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-adde3199-c123-4107-ba45-03599cf1327a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a" status: 200 len: 328 microversion: 2.1 time: 0.523941 Oct 19 00:56:18.351364 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1292/2654] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 00:56:17 2022] PUT /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a => generated 328 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:18.358910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:18.359475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:18.367274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.368046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.368763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.369715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.370496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.371130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.407965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:56:18.409073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:56:18.409778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:56:18.410444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:56:18.411080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:56:18.420816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.422155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.422985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.424975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.426079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.427659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.478724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:18.486669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:18.488004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e5665d5-1d9e-4867-a68e-6943ecb7365d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "POST /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9/action" status: 202 len: 0 microversion: 2.1 time: 0.134410 Oct 19 00:56:18.489415 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1293/2655] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:18 2022] POST /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:18.505842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:18.507410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:56:18.509275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:18.512713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:56:18.516871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.517378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.517822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.518540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.518997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.519608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.571514 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-348fe23c-0537-49e5-871f-5bf097f1c098 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.755031 Oct 19 00:56:18.571961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:18.579146 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1363/2656] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:56:18.579358 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1983d811-4d6f-4d45-a363-ef6d2c496e4e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/os-instance-actions/req-763465b2-a859-4862-b671-12e342986a83" status: 200 len: 313 microversion: 2.1 time: 0.082208 Oct 19 00:56:18.583531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1294/2657] 10.222.0.27 () {58 vars in 1419 bytes} [Wed Oct 19 00:56:18 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/os-instance-actions/req-763465b2-a859-4862-b671-12e342986a83 => generated 313 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:18.590040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:18.590671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:18.593238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f1226a-28ac-4f36-b7d5-31f7f6412acb", "tag": "3e26fcc0-3a4b-489c-859e-d480f7657cda"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:18.603212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.603480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.603892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.604017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.604333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.604463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.605088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.605669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.605976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.621310 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] Creating event network-changed:3e26fcc0-3a4b-489c-859e-d480f7657cda for instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb on n-h1-master-1 Oct 19 00:56:18.630188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-214e9926-aaf0-45ff-a6bf-87e868e2429e req-8c974d74-ab71-487d-baeb-1c3c8ffd35c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045055 Oct 19 00:56:18.631484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1295/2658] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:18.639527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af4d9e310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:18.902039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.903399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.904042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.906391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:18.907076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:18.907932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:18.943416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e53f5af-1b8e-4588-b4c7-edea646a5fd3 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a/detail" status: 200 len: 916 microversion: 2.1 time: 0.310491 Oct 19 00:56:18.953234 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1296/2659] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:56:18 2022] GET /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a/detail => generated 916 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:19.031608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df61a962-37cd-40de-92b1-d544e43875b4 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Action: 'create', calling method: .version_select at 0x7f2af493a4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-534943648", "metadata": {"Type": "work"}}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:19.137659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:19.147697 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09bcb23c-6dea-40aa-8d93-537d5212a22d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.573978 Oct 19 00:56:19.148304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1364/2660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:18 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:19.164995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:19.164995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:19.181130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.181634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.182142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.182931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.183473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.183905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.541806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:19.558248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9047b57e-72ef-45d2-888e-0ecaf245870c tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1494 microversion: 2.1 time: 0.405779 Oct 19 00:56:19.574676 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1365/2661] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:19 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1494 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:19.574676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:19.574676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:19.597453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df61a962-37cd-40de-92b1-d544e43875b4 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.651380 Oct 19 00:56:19.598178 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1297/2662] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 00:56:18 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 653 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 19 00:56:19.603750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:19.609222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:19.612749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.615077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.616670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.617467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.618806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.620591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.627206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.630669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.631235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.632504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.635599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.636136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.702678 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:19.747264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:19.758938 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3747f9d4-f1c4-49de-9b93-6515a2b15ea9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1225 microversion: 2.1 time: 0.198593 Oct 19 00:56:19.759666 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1366/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:19 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1225 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:19.766015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:19.767026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:19.771543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b8b65a7-5b01-4095-bb4b-f85add987a4c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "POST /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/action" status: 202 len: 0 microversion: 2.1 time: 0.171936 Oct 19 00:56:19.772865 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1298/2664] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:19 2022] POST /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:19.784443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.786642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4e33ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:19.788226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.790372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.791181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.791658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.794376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.924078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.925218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.925853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.926759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.927390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.927978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.962199 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:19.971359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.972097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.972730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:19.974104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:19.974737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:19.975507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.100562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:20.115236 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bc5bbfe-91b4-46a8-8f8f-87dd0a095ec6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.353226 Oct 19 00:56:20.117508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b1ecccc-d224-469d-a3e3-fe4819ca380f tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a?user_id=f2bf37b718d04131b32324bfa197f746" status: 200 len: 328 microversion: 2.1 time: 0.341425 Oct 19 00:56:20.127764 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1299/2665] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 00:56:19 2022] PUT /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a?user_id=f2bf37b718d04131b32324bfa197f746 => generated 328 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:20.138462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1367/2666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:19 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:20.139778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a4cde8-09b7-410a-b77f-1b523e8299f9", "name": "network-vif-plugged", "status": "completed", "tag": "33999f42-701a-41ba-80a2-fae426fc40d5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:20.151879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6529ad2-3fa5-4b84-91b3-258ef8351b20 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af458a8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:20.168414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.171254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.171925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.200995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] Creating event network-vif-plugged:33999f42-701a-41ba-80a2-fae426fc40d5 for instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 on n-h2-master-1 Oct 19 00:56:20.224592 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ce9eb17a-2e58-444b-8ab2-4b7633d147fa req-aad6145c-d16c-44e5-8393-4788c0b43960 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094785 Oct 19 00:56:20.225245 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1300/2667] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:20.230517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:20.233450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:20.243985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.244487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.257226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.258301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.258959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.259568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.275013 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6529ad2-3fa5-4b84-91b3-258ef8351b20 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 200 len: 352 microversion: 2.1 time: 0.132980 Oct 19 00:56:20.276224 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1368/2668] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:20 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:20.285090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd8ba719-cf00-466b-b556-c5c1e4d9ff9a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af4504280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:20.496053 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd8ba719-cf00-466b-b556-c5c1e4d9ff9a tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a?user_id=f2bf37b718d04131b32324bfa197f746" status: 200 len: 370 microversion: 2.1 time: 0.217676 Oct 19 00:56:20.501501 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1369/2669] 10.222.0.27 () {58 vars in 1323 bytes} [Wed Oct 19 00:56:20 2022] GET /compute/v2.1/os-quota-sets/385469b4d94c4995bb06bd61b8b4a98a?user_id=f2bf37b718d04131b32324bfa197f746 => generated 370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:20.513442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:20.515450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:20.530478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.533736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.536921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.537916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.538563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.539859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.868259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:20.879220 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66f761f4-9985-41a5-8b67-3c2eacab5e5e tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1507 microversion: 2.1 time: 0.652572 Oct 19 00:56:20.879828 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1301/2670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:20 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1507 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:20.890500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:20.890810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:20.911051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.911937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.912583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:20.914180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:20.915681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:20.917625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.114838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:21.131663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1cadfd2-4483-4666-a6f5-84a08d4c43f2 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.628473 Oct 19 00:56:21.132558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1370/2671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:20 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:21.138932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.145311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:21.153579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.154106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.155098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.155837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.156295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.156811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.218145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:21.231140 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1f0c2c4-435f-4114-b390-d047f0f1bc40 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1494 microversion: 2.1 time: 0.346930 Oct 19 00:56:21.245952 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1302/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:20 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1494 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:21.254742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:21.267109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fafc2fa-c967-46a0-bd75-ab7bd83312b1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Calling method '.version_select at 0x7f2af4d849d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.270522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94a65b27-962e-4424-855f-d11b36766efd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1273 microversion: 2.1 time: 0.136730 Oct 19 00:56:21.274564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1371/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:21.281975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.284828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:21.309511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.310125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.310708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.313018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.313752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.314225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.642704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:21.646644 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:21.657728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fafc2fa-c967-46a0-bd75-ab7bd83312b1 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02/defaults" status: 200 len: 371 microversion: 2.1 time: 0.406952 Oct 19 00:56:21.659043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1303/2674] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02/defaults => generated 371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:21.661916 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-679a6c33-4a67-4307-b79a-92d9c54c75f3 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1322 microversion: 2.1 time: 0.386204 Oct 19 00:56:21.672976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24c7c0ca-11e0-4a24-b656-545f68611f18 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af93aad30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.679357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1372/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:21.686990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4528c10>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:21.765282 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24c7c0ca-11e0-4a24-b656-545f68611f18 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 200 len: 353 microversion: 2.1 time: 0.104349 Oct 19 00:56:21.765894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1304/2676] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:21.777059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.777558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.778005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.779825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:21.779944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e81efd3-277c-4a07-80dc-9320d74cb1e5 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af48c2f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.780029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:21.780227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:21.819312 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:21.867342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e81efd3-277c-4a07-80dc-9320d74cb1e5 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 200 len: 353 microversion: 2.1 time: 0.092240 Oct 19 00:56:21.880360 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1305/2677] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:21.886904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a52463b5-97b2-4a06-a8aa-fbc29106312d tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af48c2790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.987799 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a52463b5-97b2-4a06-a8aa-fbc29106312d tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 202 len: 0 microversion: 2.1 time: 0.105874 Oct 19 00:56:21.988789 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1306/2678] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:56:21 2022] DELETE /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:21.995678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:21.996306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:22.003903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.004406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.004869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.005831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.006497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.007086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.099314 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c57af04c-f1df-4ad9-a585-6e7fc5e87828 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02" status: 200 len: 329 microversion: 2.1 time: 0.420838 Oct 19 00:56:22.102299 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1373/2679] 10.222.0.27 () {60 vars in 1263 bytes} [Wed Oct 19 00:56:21 2022] PUT /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02 => generated 329 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:22.108431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34e0539b-709c-4bb3-88af-d67829123df9 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af4504c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:22.225529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:22.231095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34e0539b-709c-4bb3-88af-d67829123df9 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 200 len: 352 microversion: 2.1 time: 0.127779 Oct 19 00:56:22.238952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1374/2680] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:22 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 352 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:22.240014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Action: 'update', calling method: .version_select at 0x7f2af4528280>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:22.247395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dfd8657f-a37d-42e5-8326-369892eb0738 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1507 microversion: 2.1 time: 0.257437 Oct 19 00:56:22.262532 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1307/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:21 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:22.268228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:22.277084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:22.288194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.288772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.289163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.289926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.290376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.290806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.533625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:22.544298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f42ce63c-9162-45fb-9843-522b39163eca tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.279879 Oct 19 00:56:22.545196 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1308/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:22 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:22.566201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:22.566823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:22.577869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.578431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.585552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.588059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.593278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.594532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.678536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.682596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.683061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:22.686864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:22.687617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:22.688407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.007772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:23.020501 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e487b6fb-d584-4b60-bef9-ca0a1142bf83 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1494 microversion: 2.1 time: 0.474240 Oct 19 00:56:23.038200 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1309/2683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:22 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1494 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:23.059405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:23.064651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:23.085990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.086507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.086959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.087695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.088165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.088608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.192564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-912cfb74-ca21-4303-9955-5b4fe2ce4901 tempest-QuotasAdminTestJSON-702300572 tempest-QuotasAdminTestJSON-702300572-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02" status: 200 len: 329 microversion: 2.1 time: 0.958165 Oct 19 00:56:23.201561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:23.203692 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1375/2684] 10.222.0.27 () {60 vars in 1263 bytes} [Wed Oct 19 00:56:22 2022] PUT /compute/v2.1/os-quota-sets/68515a7e0aa74f09ac726f0a27dbdc02 => generated 329 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:23.210014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b2c023-b2ff-4239-92d4-a36a544617d9", "name": "network-vif-plugged", "status": "completed", "tag": "9451413f-0cad-45a2-a6b6-2a90969aa380"}, {"server_uuid": "43266cbd-2735-482a-b9da-f53806435449", "name": "network-vif-plugged", "status": "completed", "tag": "3370d9d8-c7a9-48b3-bf48-4cdb7acdc995"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:23.218103 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-569a2c5a-1d6c-4f4a-8caf-d324805395f0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1279 microversion: 2.1 time: 0.178677 Oct 19 00:56:23.218695 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1310/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:23 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1279 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:23.235517 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:INSERT=28,nova_api:SELECT=58,nova_api:UPDATE=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:23.241521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:23.244089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.244656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.245352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.245612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:23.268555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.269425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.273839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.274778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.275175 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Creating event network-vif-plugged:9451413f-0cad-45a2-a6b6-2a90969aa380 for instance f2b2c023-b2ff-4239-92d4-a36a544617d9 on n-h2-master-1 Oct 19 00:56:23.276172 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] Creating event network-vif-plugged:3370d9d8-c7a9-48b3-bf48-4cdb7acdc995 for instance 43266cbd-2735-482a-b9da-f53806435449 on n-h1-master-1 Oct 19 00:56:23.276944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.277400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.288871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f375c634-6199-4030-9b2a-9d87440ec364 req-07b94a0f-33bb-4afe-a7d3-e3bec542df16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082961 Oct 19 00:56:23.291903 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1376/2686] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:23.304858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d17883f9-a2cc-44c0-8365-c66c5a644d2c tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af4588ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:23.380836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d17883f9-a2cc-44c0-8365-c66c5a644d2c tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 200 len: 352 microversion: 2.1 time: 0.085626 Oct 19 00:56:23.381896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1377/2687] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:23 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:23.387335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:23.388405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:23.398779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.399373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.399912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:23.401063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:23.401652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:23.402181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.224511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:24.232513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37255170-6299-4909-b8ef-00f8c7404cc6 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 200 len: 1515 microversion: 2.1 time: 1.012704 Oct 19 00:56:24.233160 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1311/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:23 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 1515 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:24.251524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:24.253016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:24.269327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.270803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.271488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.272430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.273143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.273948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.383848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:24.401393 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94ef14d8-5532-4db7-825d-38108c60a4f0 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1505 microversion: 2.1 time: 1.010696 Oct 19 00:56:24.403595 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1378/2689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:23 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1505 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:24.408855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:24.411961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:24.432197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.433150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.433764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.434681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.436069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.436736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.772770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:24.798916 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-75ab7b98-cccc-4fff-83d6-25bd1e3f7060 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.559898 Oct 19 00:56:24.837503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1312/2690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:24 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:24.862087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:24.864511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:24.897138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.900256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.903578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:24.909958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:24.913575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:24.914935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.591043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:25.604206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:25.609730 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-56f233a6-89ed-4f28-a8bb-d632736e91cd tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1500 microversion: 2.1 time: 1.202800 Oct 19 00:56:25.611227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1379/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:24 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1500 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:25.612608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb9ff277-579c-469f-8378-ef7daedd0990 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.767598 Oct 19 00:56:25.613228 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1313/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:24 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:25.628859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0454e244-7b29-4586-a504-6db55e2791f8 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Calling method '.version_select at 0x7f2af493a040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:25.634477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:25.652226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:25.666282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.666830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.667273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.667995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.668511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.668967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.681065 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0454e244-7b29-4586-a504-6db55e2791f8 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] HTTP exception thrown: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0454e244-7b29-4586-a504-6db55e2791f8 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Request method failure captured: Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 HTTP/1.1 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sydDR5mhLo_DNFNVf2Qh6-IUzUWszGzuV1bEwil1GFKWbg_hnc4txwONPGEBzmGlO2iXNOTfMm6FOwqnAi_cChUHl9XQIm6rtbtZYfXff8P49sZCkRJYBNbtCQyfxvomurAyilJ3MSM95D11A9zwc7adptjVWR9_KJ1SOI8_NG7cM Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 0614a520da8b41d4870535149cca5e6c Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesGetTestJSON-1216908195 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0614a520da8b41d4870535149cca5e6c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0614a520da8b41d4870535149cca5e6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0614a520da8b41d4870535149cca5e6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0614a520da8b41d4870535149cca5e6c"}]}] Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesGetTestJSON-1216908195 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 0614a520da8b41d4870535149cca5e6c Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesGetTestJSON-1216908195 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesGetTestJSON-1216908195-project Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ac3b9c0afb184415b4dfd1d0a62f7418 Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesGetTestJSON-1216908195-project Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: exception: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e417c918-3dc7-43b5-b914-57f12af91564'} Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. (HTTP 404) (Request-ID: req-1e621d1b-900e-4f1c-947d-3a616c6bd70d) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:25.683191 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0454e244-7b29-4586-a504-6db55e2791f8 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] Returning 404 to user: Volume e417c918-3dc7-43b5-b914-57f12af91564 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0454e244-7b29-4586-a504-6db55e2791f8 tempest-VolumesGetTestJSON-1216908195 tempest-VolumesGetTestJSON-1216908195-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564" status: 404 len: 109 microversion: 2.1 time: 0.070469 Oct 19 00:56:25.689104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1314/2693] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:25 2022] GET /compute/v2.1/os-volumes/e417c918-3dc7-43b5-b914-57f12af91564 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:25.696263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '.version_select at 0x7f2af493ae50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:25.697008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:25.714197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.714701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.715150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.717629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.718319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.718956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.769831 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81ecea5e-9f45-42f3-a797-d4f05865480a tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.082547 Oct 19 00:56:25.770672 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1315/2694] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 00:56:25 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195/os-instance-actions => generated 611 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:25.776110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f1226a-28ac-4f36-b7d5-31f7f6412acb", "name": "network-vif-plugged", "status": "completed", "tag": "3e26fcc0-3a4b-489c-859e-d480f7657cda"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:25.786472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.787288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.787926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.801542 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] Creating event network-vif-plugged:3e26fcc0-3a4b-489c-859e-d480f7657cda for instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb on n-h1-master-1 Oct 19 00:56:25.815341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8bb41687-42ed-45a9-9aef-81efb192706a req-12db641e-312a-454a-8357-e6376b5dfa2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043102 Oct 19 00:56:25.817211 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1316/2695] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:25.827989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:25.829790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:25.844721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.848146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.848861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.849767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:25.850409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:25.850870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:25.916837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:26.062904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:26.073401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44fdca4f-fbf4-48bf-9f1e-6431782c4796 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449" status: 200 len: 1515 microversion: 2.1 time: 0.460540 Oct 19 00:56:26.073997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1380/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:25 2022] GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:26.095311 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe6f34d4-b981-451f-aefd-4fa5f9f3ed80 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 204 len: 0 microversion: 2.1 time: 0.276340 Oct 19 00:56:26.097095 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1317/2697] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:25 2022] DELETE /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:26.112434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:26.115268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:26.115830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:26.117523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:26.141281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.141816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.142277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.142682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.143030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.143497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.143925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.144437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.146194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.151230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.154297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.157511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.242879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:26.444403 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a7c63278-1c46-4c6b-8e96-3335db6a512c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 204 len: 0 microversion: 2.1 time: 0.347203 Oct 19 00:56:26.445223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1381/2698] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:26 2022] DELETE /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:26.464412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:26.465298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:26.478336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.478715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.479164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.479892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.480356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.483299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.593966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:26.601947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58658575-1001-49e7-9410-4bc17fd24477 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.502293 Oct 19 00:56:26.623409 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1318/2699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:26 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:26.628522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:26.631525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:26.646256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.647026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.647762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.653830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.655194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.655820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.711477 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:26.929430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:26.939741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ebc5eb61-fe7b-4fc9-9a62-309894166a9e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 200 len: 1516 microversion: 2.1 time: 0.315006 Oct 19 00:56:26.943457 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1319/2700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:26 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 1516 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:26.965248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:26.966108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:26.976593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.977316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.978039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:26.978916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:26.979553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:26.981780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.025979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:27.039001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e8b3e0-0b26-4a54-a7e1-255d7af9c4ab tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.589538 Oct 19 00:56:27.061389 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1382/2701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:26 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:27.072962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:27.081631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:27.097041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.105605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.106242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.107125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.112851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.113328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.584053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:27.594310 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0598ab4-71fe-448c-82c2-5f9d4cbdfa05 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1511 microversion: 2.1 time: 0.646200 Oct 19 00:56:27.594941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1320/2702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:26 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:27.600935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:27.601711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:27.623038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.623515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.625784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.625784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.629860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.630643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.673913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:27.685793 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3cb1d048-ecc9-4bae-a241-58d800d35ce4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.622184 Oct 19 00:56:27.686406 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1383/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:27 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:27.691035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4dd459-fc61-4ee4-a19d-87b8696bdcca", "tag": "3e00a50c-2046-4526-a3c9-69787badf85c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:27.703603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.705472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.707041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.721839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:27.724138 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] Creating event network-changed:3e00a50c-2046-4526-a3c9-69787badf85c for instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca on n-h1-master-1 Oct 19 00:56:27.729655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-28772211-119c-4aeb-bc61-9bcba51b0405 req-d39547d7-9d77-492a-a55e-48a2bce30380 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042067 Oct 19 00:56:27.730510 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1384/2704] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:27.745178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:27.746177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:27.757703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.758616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.759878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.761051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.762136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.764088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.906227 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c41376dc-681d-4d9a-aafc-a93a014e39b7 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 204 len: 0 microversion: 2.1 time: 0.307404 Oct 19 00:56:27.907913 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1321/2705] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:27 2022] DELETE /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:27.922721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:27.929903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:27.938223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.938955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.939897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.940839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:27.941510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:27.942142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:27.985049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:27.998559 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87696ba0-49d4-4735-bd35-25ea7c96bfc8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.266605 Oct 19 00:56:27.999167 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1385/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:27 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:28.173268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:28.189256 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-394beb0e-97eb-4687-a4d2-e4561435dd71 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 200 len: 1522 microversion: 2.1 time: 0.276502 Oct 19 00:56:28.192636 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1322/2707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:27 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:28.201358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:28.204437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:28.216283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.224655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.225453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:28.226382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.227025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.227790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:28.420955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-660fa93c-1baf-4d37-b3e4-d30c11bd963e tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] Action: 'create', calling method: .version_select at 0x7f2af4573700>, body: {"security_group": {"name": "tempest-securitygroup-145495493", "description": "tempest-description-1829652109"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:28.477419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:28.492759 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3d48f9a-30c9-4c74-a169-47b07b8e91ee tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.297340 Oct 19 00:56:28.493525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1323/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:28 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:28.620509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:28.621460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:28.632468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.633073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.641864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:28.642854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.643451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.644013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:28.895766 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-660fa93c-1baf-4d37-b3e4-d30c11bd963e tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.885946 Oct 19 00:56:28.896933 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1386/2709] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:56:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:28.901743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:28.902557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:28.921539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.922262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.922902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:28.924939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:28.925598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:28.926967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.038978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:29.048273 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b332c3e1-3c1e-49d5-9089-2a6a4bc88d80 tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1511 microversion: 2.1 time: 0.431990 Oct 19 00:56:29.057282 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1324/2710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:28 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:56:29.062382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e41bbf4-60da-4cf1-9792-357f2c4f25c5 tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] Action: 'create', calling method: .version_select at 0x7f2af493af70>, body: {"security_group": {"name": "tempest-securitygroup-678592775", "description": "tempest-description-1110736700"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:29.218487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:29.231229 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae3841a5-cc5d-44e9-a5b9-3dda7115dfa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.329109 Oct 19 00:56:29.235676 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1387/2711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:28 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:29.242902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:29.243894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:29.266725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.267361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.269510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.271637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.273006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.273917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.500550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e41bbf4-60da-4cf1-9792-357f2c4f25c5 tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.442295 Oct 19 00:56:29.501560 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1325/2712] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:56:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:29.506519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:29.507431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:29.528044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.531967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.537532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.540008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.541051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.548261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.586350 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:29.596861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2b8f7e7-2d43-4bb0-a836-886038aee4cf tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1324 microversion: 2.1 time: 0.357856 Oct 19 00:56:29.600147 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1388/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:29 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:29.924146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c67ac942-4e7b-4a31-a068-51732349acd9 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] Action: 'create', calling method: .version_select at 0x7f2af452a8b0>, body: {"security_group": {"name": "tempest-securitygroup-158411317", "description": "tempest-description-1239308228"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:29.939916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:29.949133 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7fd174d6-6eda-409d-9d55-d77cbdf2aa8e tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 200 len: 1522 microversion: 2.1 time: 0.446277 Oct 19 00:56:29.950547 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1326/2714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:29 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:29.957727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:29.958604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:29.977165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.979537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.980178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:29.982437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:29.984534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:29.985316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:30.032518 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=11 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:30.095523 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:30.740332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:30.753056 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bcd56cea-b58d-4d99-87d5-cda3ca24dc0f tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1506 microversion: 2.1 time: 0.799331 Oct 19 00:56:30.769653 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1327/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:29 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1506 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:30.775905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:30.776916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:30.789641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:30.790600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:30.793241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:30.794336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:30.795740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:30.796800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:31.853469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ded977ea8c0b4e18bbef90de6a59a7d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f527fed1e48e443785be3b655deb762b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:31.868311 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3512ce36-29b2-43f7-aaec-84c8f782934c tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 200 len: 1511 microversion: 2.1 time: 1.097260 Oct 19 00:56:31.869311 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1328/2716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:30 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 1511 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:31.876882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:31.877731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:31.887071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:31.887929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:31.889187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:31.890321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:31.891009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:31.891811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.320456 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c67ac942-4e7b-4a31-a068-51732349acd9 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.718473 Oct 19 00:56:32.322298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1389/2717] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:56:29 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:32.328386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:32.332231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:32.360507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.361050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.361498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.365389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.365935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.367404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.475226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:32.492567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ed809f9-75af-45b3-b9a6-88d139d6cf8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.619426 Oct 19 00:56:32.499657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1329/2718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:31 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:32.506173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:32.507246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:32.517763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.518545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.519984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.521440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.522244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.522858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.628737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.629415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.630949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.631443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lazy-loading 'fault' on Instance uuid f2b2c023-b2ff-4239-92d4-a36a544617d9 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:56:32.710888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:32.718090 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=10 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:32.739620 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23ee7c39-991a-4a33-819c-7e17dadb49f8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 200 len: 1518 microversion: 2.1 time: 0.412427 Oct 19 00:56:32.742075 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1390/2719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:32 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 1518 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:32.767881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3863db-620b-4d51-9a2d-24b90fa88195", "name": "network-vif-deleted", "tag": "150c50fc-7e19-4384-810b-a7c76d13524f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:32.796838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.800170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.801033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.803834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:32.812771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d32814d4-399e-410d-be5b-8934cd2f9e9a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 200 len: 1312 microversion: 2.1 time: 0.311259 Oct 19 00:56:32.813811 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1330/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:32 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:32.817834 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] Creating event network-vif-deleted:150c50fc-7e19-4384-810b-a7c76d13524f for instance 3b3863db-620b-4d51-9a2d-24b90fa88195 on n-h2-master-1 Oct 19 00:56:32.824586 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c02022e9-d928-466a-8bd6-bda3bdd4051d req-6d844ae9-c199-4416-950d-3a1ed6e0af72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079461 Oct 19 00:56:32.825516 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1391/2721] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:32.831387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:32.831607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b2c023-b2ff-4239-92d4-a36a544617d9", "name": "network-vif-deleted", "tag": "9451413f-0cad-45a2-a6b6-2a90969aa380"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:32.832087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:32.843069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.843560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.843996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.847187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.849635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.850230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.851223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:32.851896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:32.852530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:32.857261 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] Creating event network-vif-deleted:9451413f-0cad-45a2-a6b6-2a90969aa380 for instance f2b2c023-b2ff-4239-92d4-a36a544617d9 on n-h2-master-1 Oct 19 00:56:32.865178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3e7b6d9f-6f74-482d-b18c-8a34c0f76bab req-6665c5cd-39f5-4f7f-847d-870fb2476f41 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037275 Oct 19 00:56:32.875723 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1392/2722] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:32.883479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7845d11-e55a-4307-8f6c-e44a7d5aae74 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] Action: 'create', calling method: .version_select at 0x7f2af4454b80>, body: {"security_group": {"name": "tempest-securitygroup-1050434953", "description": "tempest-description-979957"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:33.004354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:33.022248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2558158c-2365-4948-817b-b5fa58535355 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 200 len: 1464 microversion: 2.1 time: 0.204747 Oct 19 00:56:33.022911 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1331/2723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:32 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 1464 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:33.050301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.40"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:33.057092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:33.075943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:33.077258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:33.078218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:33.079406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:33.081025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:33.081723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:33.121148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:56:33.123315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquired lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:56:33.128286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7845d11-e55a-4307-8f6c-e44a7d5aae74 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 217 microversion: 2.1 time: 0.249137 Oct 19 00:56:33.128906 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1393/2724] 10.222.0.27 () {60 vars in 1180 bytes} [Wed Oct 19 00:56:32 2022] POST /compute/v2.1/os-security-groups => generated 217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:33.134329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:33.135217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] [instance: 3b3863db-620b-4d51-9a2d-24b90fa88195] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:33.145436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:33.146183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:33.146829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:33.147888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:33.148513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:33.149129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:33.173102 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=94 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:33.178405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] HTTP exception thrown: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Request method failure captured: Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 HTTP/1.1 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sVTbJw4NolbFmcGhayURoEQ_6mCIb2MP1koOIP36z-eB0aCbVVqL1lpWAtgsvCEdTPxxoF_q1GeX-mJfQwek91qN0VFyhG9npLZRRfYGHJtA4Zt8peFtlEauDVIa6R3lrehcYBiB2Y9vO5Nfte57EVM-eZHWuS5THFu6lvpysDtJs Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f527fed1e48e443785be3b655deb762b Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-InstanceActionsTestJSON-1780517696 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f527fed1e48e443785be3b655deb762b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f527fed1e48e443785be3b655deb762b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f527fed1e48e443785be3b655deb762b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f527fed1e48e443785be3b655deb762b"}]}] Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-InstanceActionsTestJSON-1780517696 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f527fed1e48e443785be3b655deb762b Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1780517696 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-InstanceActionsTestJSON-1780517696-project Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ded977ea8c0b4e18bbef90de6a59a7d3 Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-InstanceActionsTestJSON-1780517696-project Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3b3863db-620b-4d51-9a2d-24b90fa88195'} Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:33.180906 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. Oct 19 00:56:33.186172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:33.188282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] Returning 404 to user: Instance 3b3863db-620b-4d51-9a2d-24b90fa88195 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:33.190268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-541c0b42-4c92-436a-9b17-577828b1c2bb tempest-InstanceActionsTestJSON-1780517696 tempest-InstanceActionsTestJSON-1780517696-project] 10.222.0.27 "GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195" status: 404 len: 111 microversion: 2.1 time: 0.059643 Oct 19 00:56:33.191646 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1394/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:33 2022] GET /compute/v2.1/servers/3b3863db-620b-4d51-9a2d-24b90fa88195 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:33.197054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e3bbf74-916c-43ed-a155-5ebc3660aaae tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] Calling method '.version_select at 0x7f2af458aee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:36.581252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:56:38.682609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Updating instance_info_cache with network_info: [{"id": "c1b3ec96-7cce-455f-82c8-70a386d9088b", "address": "fa:16:3e:c2:69:1c", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1b3ec96-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:56:38.697957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Releasing lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:56:38.698845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e5e6b7f8-cdc3-424c-9c1b-30df7a6c0677 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action" status: 202 len: 0 microversion: 2.1 time: 5.674968 Oct 19 00:56:38.699753 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1332/2726] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:33 2022] POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action => generated 0 bytes in 5676 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:56:38.711566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:38.712196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:38.733458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:38.734048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:38.734348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:38.736330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:38.737123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:38.739946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.047853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:39.056696 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8dbf318-2453-4173-bd6f-d086026c9775 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.355871 Oct 19 00:56:39.057666 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1333/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:38 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:39.186309 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e3bbf74-916c-43ed-a155-5ebc3660aaae tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8372 microversion: 2.1 time: 5.993272 Oct 19 00:56:39.187258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1395/2728] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 00:56:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8372 bytes in 5995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:39.192054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:39.193034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:39.200132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.203460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.204228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.205216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.205841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.206445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.225724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] HTTP exception thrown: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 HTTP/1.1 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2b2c023-b2ff-4239-92d4-a36a544617d9'} Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.227553 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:39.232863 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.234614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 404 to user: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:39.235726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f25306d-f043-4451-918e-759742970e95 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 404 len: 111 microversion: 2.1 time: 0.047466 Oct 19 00:56:39.236514 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1396/2729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:39 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:39.241850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:39.242645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:39.250402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.250905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.251349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.252078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.252540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.253088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.277814 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] HTTP exception thrown: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Request method failure captured: Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 HTTP/1.1 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0q386tR3gYNHErZWgCzm0IJtQM8GF-r33UpKj_N-J8GWxDuITyLkvTQjwbbvFTDzV5YBz5nE8yEQKf1rlvHUU-Gfr3X_mizqzc8FlkVJpO8DhF4kadXP4oDO-nfAYvS8iuKAD2mDneSG2sJuJ8eCuCkaYcozyZdTerxF0BEbYbdRRA Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 488f8fabd15e4e7c8837ccd25c842e46 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_488f8fabd15e4e7c8837ccd25c842e46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/488f8fabd15e4e7c8837ccd25c842e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/488f8fabd15e4e7c8837ccd25c842e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/488f8fabd15e4e7c8837ccd25c842e46"}]}] Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 488f8fabd15e4e7c8837ccd25c842e46 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueTestJSON-441144679-project Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ea919891e28b42fd9c7ea98cbf2362a4 Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueTestJSON-441144679-project Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7c116bff-b502-4bf6-a4b4-ab28b6b13aa9'} Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:39.279917 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. Oct 19 00:56:39.284778 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:39.287260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Returning 404 to user: Instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:39.288405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be92c8c1-b846-46b4-a290-d63c5e859760 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9" status: 404 len: 111 microversion: 2.1 time: 0.050788 Oct 19 00:56:39.289788 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1397/2730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:39 2022] GET /compute/v2.1/servers/7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:39.295458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c116bff-b502-4bf6-a4b4-ab28b6b13aa9", "name": "network-vif-deleted", "tag": "78717d72-62a5-4334-87db-f83b1087bbff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:39.309792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.312248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.317510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.330853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] Creating event network-vif-deleted:78717d72-62a5-4334-87db-f83b1087bbff for instance 7c116bff-b502-4bf6-a4b4-ab28b6b13aa9 on n-h1-master-1 Oct 19 00:56:39.337949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7beceff7-5262-4c6b-9ac6-bf031ff3d35d req-88f06254-d904-40d5-8c70-e814e37a151f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046584 Oct 19 00:56:39.339272 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1398/2731] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:39.346191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4dd459-fc61-4ee4-a19d-87b8696bdcca", "name": "network-vif-plugged", "status": "completed", "tag": "3e00a50c-2046-4526-a3c9-69787badf85c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:39.356613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.360106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.360553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.373715 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] Creating event network-vif-plugged:3e00a50c-2046-4526-a3c9-69787badf85c for instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca on n-h1-master-1 Oct 19 00:56:39.379286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f9f8c89f-de2c-44c9-a035-39cbed5c9b30 req-26433b86-e085-476f-97d2-4b426d2e07cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038347 Oct 19 00:56:39.380139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1399/2732] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:39.390487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.40"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:39.393489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:39.401319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.401813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.402403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.403299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:39.404443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:39.405174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:39.439546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:56:39.441932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquired lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:56:39.483320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dc1d746-c4de-4e54-af51-58ac86989de2 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Action: 'create', calling method: .version_select at 0x7f2af4c743a0>, body: {"keypair": {"name": "tempest-keypair-133366858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBLPoVfEhxB+4GArEZo9OPWIe2/w5iWaamvJShoQCiBE5dd6+ljz7Wj3L3Js2/alY7ScGPBMB13ce3W0p7wXYmqC87prvClfnac+cf1JNOKccKtK9WKY/57Jdz3tGhHPg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:39.506526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7dc1d746-c4de-4e54-af51-58ac86989de2 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:39.522005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7dc1d746-c4de-4e54-af51-58ac86989de2 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for user 73c91ca45a0a4b3c9499a85bde9e8bb1 and project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:39.563862 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7dc1d746-c4de-4e54-af51-58ac86989de2 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.504743 Oct 19 00:56:39.565905 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1334/2733] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:56:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:39.579707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-06457664-9eb1-4e82-80b2-7454e44aad55 tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] Calling method '.version_select at 0x7f2af488b9d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:40.221484 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-06457664-9eb1-4e82-80b2-7454e44aad55 tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.653209 Oct 19 00:56:40.222200 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1335/2734] 10.222.0.27 () {58 vars in 1191 bytes} [Wed Oct 19 00:56:39 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:40.236724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:40.244339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:40.245679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:40.252602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.253681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.254330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:40.255300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.255965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.256612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:40.334595 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:40.351026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f8c4ce8-20f3-49ca-bcee-f61fe9748cbc tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.127979 Oct 19 00:56:40.351825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1336/2735] 10.222.0.27 () {58 vars in 1230 bytes} [Wed Oct 19 00:56:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:56:40.357599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:40.358391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:40.362086 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:40.369865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.370873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.371549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:40.374084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.374831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.375560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:40.409699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:40.557089 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fba3acc5-1161-408d-87aa-2eaefccf5ba0 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 204 len: 0 microversion: 2.1 time: 0.200501 Oct 19 00:56:40.564552 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1337/2736] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:40 2022] DELETE /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:40.577156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:40.577875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:40.593879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.594386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.594819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:40.595561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:40.595968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:40.601503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:41.077105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:41.088364 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-89168c4d-9a48-44d9-9888-83d5deba21db tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1321 microversion: 2.1 time: 0.522354 Oct 19 00:56:41.106291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1338/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:40 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:41.112452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f6531ae1-d500-45f1-926f-1ca861544622 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] Calling method '.version_select at 0x7f2af4ad4940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:42.008777 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f6531ae1-d500-45f1-926f-1ca861544622 tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/c9be4982-61a8-4027-add6-1cc0ee5f235a" status: 202 len: 0 microversion: 2.1 time: 0.899868 Oct 19 00:56:42.010891 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1339/2738] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:56:41 2022] DELETE /compute/v2.1/os-security-groups/c9be4982-61a8-4027-add6-1cc0ee5f235a => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:42.019555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7dcdc24-ae15-430d-b98c-8a3f0a4dc103 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7dcdc24-ae15-430d-b98c-8a3f0a4dc103 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 00:56:42.027317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 19 00:56:42.032265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:42.036374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7dcdc24-ae15-430d-b98c-8a3f0a4dc103 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:42.037621 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7dcdc24-ae15-430d-b98c-8a3f0a4dc103 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024255 Oct 19 00:56:42.038389 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1340/2739] 10.222.0.27 () {58 vars in 1182 bytes} [Wed Oct 19 00:56:42 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:42.061569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:42.062231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:42.071814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:42.072303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:42.072844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:42.073674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:42.074147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:42.074844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:42.395861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea919891e28b42fd9c7ea98cbf2362a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488f8fabd15e4e7c8837ccd25c842e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:42.408719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f847acdf-c133-455c-b6bc-e419681820c7 tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 200 len: 1490 microversion: 2.1 time: 0.359993 Oct 19 00:56:42.409555 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1341/2740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:42 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 1490 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:42.416410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:42.426423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:42.426935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:42.427367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:42.459271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] Creating event network-changed:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:56:42.465312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0da606f5-7207-4cbd-9f5f-63c0690e7eff req-0339e6eb-6765-4471-bc32-f34cba7d2bb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054284 Oct 19 00:56:42.466963 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1342/2741] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:42.477728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3864b5cb-fb9f-4664-9565-76b3f99cdd2d tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] Calling method '.version_select at 0x7f2af4e4e5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:43.258558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3864b5cb-fb9f-4664-9565-76b3f99cdd2d tempest-SecurityGroupsTestAdminJSON-1576853481 tempest-SecurityGroupsTestAdminJSON-1576853481-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ece5d7ea-c29f-49b0-bfb1-6a9fde61861e" status: 202 len: 0 microversion: 2.1 time: 0.790580 Oct 19 00:56:43.261833 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1343/2742] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:56:42 2022] DELETE /compute/v2.1/os-security-groups/ece5d7ea-c29f-49b0-bfb1-6a9fde61861e => generated 0 bytes in 795 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:43.271858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:43.281522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:43.284023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:43.293418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:43.295541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:43.296453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:43.297579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:43.298326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:43.299916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:43.368330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:56:43.425191 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ce6b8d1-30fc-47e6-9ec2-3f2fdafc6141 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.161112 Oct 19 00:56:43.428292 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1344/2743] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:56:43 2022] GET /compute/v2.1/servers => generated 681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:43.436673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:43.438963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:43.448592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:43.449745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:43.450958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:43.453706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:43.455475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:43.456398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:44.017171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:44.030726 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ddadeb8b-f54b-4505-9160-ec320ba29d31 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1502 microversion: 2.1 time: 0.600204 Oct 19 00:56:44.032500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1345/2744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:43 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1502 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:44.516063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-147566c6-d765-4f4e-ab49-c21354a029e3 tempest-ExtensionsTest-1858474228 tempest-ExtensionsTest-1858474228-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:44.518807 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-147566c6-d765-4f4e-ab49-c21354a029e3 tempest-ExtensionsTest-1858474228 tempest-ExtensionsTest-1858474228-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.485103 Oct 19 00:56:44.519907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1346/2745] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 00:56:44 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:44.527934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87c29b72-39a6-431b-8b4e-30fc584c8cac tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] Calling method '.version_select at 0x7f2af4853dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:44.791352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.network.neutron [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] re-assign floating IP 172.35.1.40 from instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 Oct 19 00:56:44.849935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Building network info cache for instance {{(pid=131449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:56:44.857639 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:45.154515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87c29b72-39a6-431b-8b4e-30fc584c8cac tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a61890f7-1697-46d3-8db1-eda33a42ff47" status: 202 len: 0 microversion: 2.1 time: 0.625822 Oct 19 00:56:45.164106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1347/2746] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:56:44 2022] DELETE /compute/v2.1/os-security-groups/a61890f7-1697-46d3-8db1-eda33a42ff47 => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:45.177952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:45.179516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] [instance: b1fa75e8-139e-446e-bb8c-9e673fdf4bb7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:45.202052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:45.203628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:45.205861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:45.207771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:45.209062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:45.210113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:45.244441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] HTTP exception thrown: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Request method failure captured: Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 HTTP/1.1 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0q386tR3gYNHErZWgCzm0IJtQM8GF-r33UpKj_N-J8GWxDuITyLkvTQjwbbvFTDzV5YBz5nE8yEQKf1rlvHUU-Gfr3X_mizqzc8FlkVJpO8DhF4kadXP4oDO-nfAYvS8iuKAD2mDneSG2sJuJ8eCuCkaYcozyZdTerxF0BEbYbdRRA Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 488f8fabd15e4e7c8837ccd25c842e46 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_488f8fabd15e4e7c8837ccd25c842e46", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/488f8fabd15e4e7c8837ccd25c842e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/488f8fabd15e4e7c8837ccd25c842e46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/488f8fabd15e4e7c8837ccd25c842e46"}]}] Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 488f8fabd15e4e7c8837ccd25c842e46 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerRescueTestJSON-441144679 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerRescueTestJSON-441144679-project Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ea919891e28b42fd9c7ea98cbf2362a4 Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerRescueTestJSON-441144679-project Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: exception: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b1fa75e8-139e-446e-bb8c-9e673fdf4bb7'} Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:45.249383 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. Oct 19 00:56:45.253728 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:45.255868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] Returning 404 to user: Instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:45.258384 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-79940ac6-d778-4469-93e8-bc65b02e7b1d tempest-ServerRescueTestJSON-441144679 tempest-ServerRescueTestJSON-441144679-project] 10.222.0.27 "GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7" status: 404 len: 111 microversion: 2.1 time: 0.091737 Oct 19 00:56:45.262846 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1348/2747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:45 2022] GET /compute/v2.1/servers/b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:45.270902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:45.289006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:45.292334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Removing options 'limit' from query {{(pid=131450) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 19 00:56:45.295321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:45.307595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:45.309297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:45.311234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:45.313149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:45.314363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:45.315478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:45.389327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:56:45.462996 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9c76bab-a853-41ab-aeb6-478c09eaf2df tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.201325 Oct 19 00:56:45.464650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1349/2748] 10.222.0.27 () {58 vars in 1144 bytes} [Wed Oct 19 00:56:45 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:45.473055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1664862991", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2986c76a-2baa-4aca-88ef-924f1f9ed764"}], "security_groups": [{"name": "tempest-securitygroup--587076630"}], "key_name": "tempest-keypair-133366858", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:45.844001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] validate_networks() for [('2986c76a-2baa-4aca-88ef-924f1f9ed764', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:56:46.256069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Updating instance_info_cache with network_info: [{"id": "c1b3ec96-7cce-455f-82c8-70a386d9088b", "address": "fa:16:3e:c2:69:1c", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1b3ec96-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:56:46.269829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Building network info cache for instance {{(pid=131449) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:56:46.780150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:46.786480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for user 73c91ca45a0a4b3c9499a85bde9e8bb1 and project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:46.802643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:56:46.803389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:56:46.804041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:56:46.804722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:56:46.805307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:56:46.814746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:46.815238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:46.816021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:46.817032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:46.817662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:46.819482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:46.840414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:46.849215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Getting quotas for user 73c91ca45a0a4b3c9499a85bde9e8bb1 and project 01f3f08dd5ca42488a2c22e7f1ebf71f. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:46.874609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:56:46.879774 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:56:46.971990 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-681fca36-2ef3-47fd-9ce5-465a800d0f52 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505910 Oct 19 00:56:46.972682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1350/2749] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:56:46.977259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fa75e8-139e-446e-bb8c-9e673fdf4bb7", "name": "network-vif-deleted", "tag": "2f8cebd8-ca9c-4030-be53-139b8e5b5af8"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:46.990679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:46.990819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:46.991392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.005415 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] Creating event network-vif-deleted:2f8cebd8-ca9c-4030-be53-139b8e5b5af8 for instance b1fa75e8-139e-446e-bb8c-9e673fdf4bb7 on n-h2-master-1 Oct 19 00:56:47.011979 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3b7a784e-1dd8-4d4d-b271-8de90c0d8d39 req-55f885cd-4016-480a-8b42-12860df8e05b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037918 Oct 19 00:56:47.013342 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1351/2750] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:47.036753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.041287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:47.050199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:47.051147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:47.052303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.053377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:47.054012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:47.054767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.281181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:47.292264 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5cc01ae2-1fd9-47dd-b878-b9aa232055eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1502 microversion: 2.1 time: 0.263577 Oct 19 00:56:47.307064 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1352/2751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:47 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:47.309214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Updating instance_info_cache with network_info: [{"id": "3e26fcc0-3a4b-489c-859e-d480f7657cda", "address": "fa:16:3e:45:77:94", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e26fcc0-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:56:47.315663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ffe4a65-60bf-46f6-af73-da1f3175fb3d tempest-ExtensionsTest-1858474228 tempest-ExtensionsTest-1858474228-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.327731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Releasing lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131449) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:56:47.328852 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-46ef1bac-0244-4e2e-9c3a-3576487fcb7f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb/action" status: 202 len: 0 microversion: 2.1 time: 7.942972 Oct 19 00:56:47.329400 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ffe4a65-60bf-46f6-af73-da1f3175fb3d tempest-ExtensionsTest-1858474228 tempest-ExtensionsTest-1858474228-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.020327 Oct 19 00:56:47.329579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1400/2752] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:39 2022] POST /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb/action => generated 0 bytes in 7945 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:56:47.330375 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1353/2753] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 00:56:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 00:56:47.335495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67d1e15e-856c-470d-a895-f719a397168d tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] Calling method '.version_select at 0x7f2af493ab80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.336611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:47.350017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:47.351432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:47.352281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.373086 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] Creating event network-changed:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:56:47.381677 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5d714011-89ff-49d9-9bca-f2e3106f0740 req-4d0b2bff-d4f8-4830-90ea-8eb1b7bb08b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050049 Oct 19 00:56:47.383384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1401/2754] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:47.391745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe26c742-a81c-486e-adbe-8c7f3bace683 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe26c742-a81c-486e-adbe-8c7f3bace683 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: action_args: {} Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '-1' Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 00:56:47.399832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 19 00:56:47.404854 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:47.408316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe26c742-a81c-486e-adbe-8c7f3bace683 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:47.409738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe26c742-a81c-486e-adbe-8c7f3bace683 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.023936 Oct 19 00:56:47.410323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1402/2755] 10.222.0.27 () {58 vars in 1142 bytes} [Wed Oct 19 00:56:47 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:47.462196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f58ee2c-431a-44b8-91a6-5eb20776a196 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.463213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f58ee2c-431a-44b8-91a6-5eb20776a196 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:47.621902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f58ee2c-431a-44b8-91a6-5eb20776a196 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:47.645041 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f58ee2c-431a-44b8-91a6-5eb20776a196 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1269 microversion: 2.1 time: 0.218620 Oct 19 00:56:47.645041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1403/2756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:47 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:47.645041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:47.645041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:47.654529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:47.763100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:47.964972 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af5aec40-30b4-4f53-a0f7-c8784d2291f9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 204 len: 0 microversion: 2.1 time: 0.329282 Oct 19 00:56:47.966310 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1404/2757] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:47 2022] DELETE /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:47.976076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.40"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:48.240657 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67d1e15e-856c-470d-a895-f719a397168d tempest-SecurityGroupsTestAdminJSON-254541276 tempest-SecurityGroupsTestAdminJSON-254541276-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/7d26c6c8-ad51-43b4-bb38-43cea5396317" status: 202 len: 0 microversion: 2.1 time: 0.904393 Oct 19 00:56:48.241568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1354/2758] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 00:56:47 2022] DELETE /compute/v2.1/os-security-groups/7d26c6c8-ad51-43b4-bb38-43cea5396317 => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:56:48.253931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0acafe01-9ee5-477b-be96-d832b9b99bc5 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0acafe01-9ee5-477b-be96-d832b9b99bc5 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: action_args: {} Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'testing' Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 19 00:56:48.289527 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 19 00:56:48.296643 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:48.315638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0acafe01-9ee5-477b-be96-d832b9b99bc5 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:48.332645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0acafe01-9ee5-477b-be96-d832b9b99bc5 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.080454 Oct 19 00:56:48.346144 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1355/2759] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:56:48 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:48.362659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:48.363509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:48.387268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:48.388231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:48.388878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:48.389993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:48.390616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:48.391418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:48.879644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:48.886984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:48.887484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:48.888456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:48.892996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:48.895980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:48.896582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.070476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:49.092935 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de9a2166-494f-4c8f-b5dc-8c0e811ffb98 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1508 microversion: 2.1 time: 0.743396 Oct 19 00:56:49.105561 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1356/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:48 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1508 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:49.135091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1610cf52-2232-4ab3-9d71-77d229995441 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:49.149291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1610cf52-2232-4ab3-9d71-77d229995441 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:49.151653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1610cf52-2232-4ab3-9d71-77d229995441 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:49.171114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-1610cf52-2232-4ab3-9d71-77d229995441 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Flavor 'non_existing_flavor' could not be found {{(pid=131450) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 19 00:56:49.174387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1610cf52-2232-4ab3-9d71-77d229995441 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.059902 Oct 19 00:56:49.191671 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1357/2761] 10.222.0.27 () {58 vars in 1178 bytes} [Wed Oct 19 00:56:49 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:56:49.204412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:49.206149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:49.216977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.217791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.218398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.219954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.221219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.222117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.419648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:49.442385 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5defb159-a1fa-421f-a5a7-3f8f0f704ae9 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1321 microversion: 2.1 time: 0.234899 Oct 19 00:56:49.443502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1358/2762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:49 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:49.462013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:49.481736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:49.485168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:49.498445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.501418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.506359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.507481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.508188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.508889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.714897 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9440d866-7577-4f44-8e16-67730bc6c34f tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.265480 Oct 19 00:56:49.716462 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1359/2763] 10.222.0.27 () {58 vars in 1174 bytes} [Wed Oct 19 00:56:49 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:56:49.736874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:49.760232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:49.765115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:49.782951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.783915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.784748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:49.785757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:49.788033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:49.789836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.053194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-706f4346-4ff1-4b57-b0b3-8c201bfb75d0 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.324953 Oct 19 00:56:50.057249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1360/2764] 10.222.0.27 () {58 vars in 1184 bytes} [Wed Oct 19 00:56:49 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:56:50.076265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:50.092038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:50.099715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:50.112346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.113025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.113636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.114421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.119831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.120378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.206734 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:56:50.331146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:50.345517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.346268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.347064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.816391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] HTTP exception thrown: Floating IP 172.35.1.40 is not associated with instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2. Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Request method failure captured: Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action HTTP/1.1 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 48 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sJO9VpBRWqFROO3XQCFPz9lTtC2NO3Sr3gc0r9m-otJkyzZ4d1vrfhx-73wbTJIqoBNFRFpx8CaKI_qRU7555Yiv0CwE0cnvQ0uTKHkAZpN6oXnG79pho7KQpeIlBOlvH6ZvIjocrQEYBSVgqeYDCJ0CY4q4dFQtgrjo9c0IxNQ68 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072952a76c8f483d9d8b5912b2e0ecb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}] Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d76c8fd5fe0a49da9bad854cbe8c74e0 Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: {"removeFloatingIp": {"address": "172.35.1.40"}} Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: exception: Floating IP 172.35.1.40 is not associated with instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2. Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ba4cba7b-265e-47d3-b8c5-50a44288c3f2', 'body': {'removeFloatingIp': {'address': '172.35.1.40'}}} Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.1.40 is not associated with instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2. Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.1.40 is not associated with instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2. Oct 19 00:56:50.818051 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:50.821792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Returning 409 to user: Floating IP 172.35.1.40 is not associated with instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:50.821792 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e26d19a-24cb-44a8-a35b-325e6615162f tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action" status: 409 len: 145 microversion: 2.1 time: 2.851304 Oct 19 00:56:50.821792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1405/2765] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:47 2022] POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action => generated 145 bytes in 2854 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:56:50.841887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f1226a-28ac-4f36-b7d5-31f7f6412acb", "tag": "3e26fcc0-3a4b-489c-859e-d480f7657cda"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:50.873865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.874370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.874819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.916824 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] Creating event network-changed:3e26fcc0-3a4b-489c-859e-d480f7657cda for instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb on n-h1-master-1 Oct 19 00:56:50.946912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e440c1a4-b459-478c-beff-da4139aecf2a req-763a8013-4e53-47c8-9bef-10096c10efdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118737 Oct 19 00:56:50.949526 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1406/2766] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:50.981156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:50.981951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:50.996190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.996708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.997280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:50.998147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:50.998601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:50.999027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:51.063513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-700c75a4-fe15-4dac-95ae-3df001af60b1 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3023 microversion: 2.1 time: 0.997780 Oct 19 00:56:51.064447 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1361/2767] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:56:50 2022] GET /compute/v2.1/servers/detail => generated 3023 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:56:51.069606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:51.070234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:51.083680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:51.090286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:51.090755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:51.092337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:51.093021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:51.093760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:51.291935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:51.301522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bacaad1e-ee5b-4024-978b-cbb79c26737d tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1327 microversion: 2.1 time: 0.235723 Oct 19 00:56:51.307533 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1362/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:51 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1327 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:51.319726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.40"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:51.448075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:51.462271 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-791c9c16-4db1-4d8b-b802-3122a602c7c1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1508 microversion: 2.1 time: 0.495840 Oct 19 00:56:51.462922 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1407/2769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:50 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:51.470136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8bf7e26-8eb7-4bf8-937e-5aa921a9cc8c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:51.487121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e8bf7e26-8eb7-4bf8-937e-5aa921a9cc8c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:51.489568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8bf7e26-8eb7-4bf8-937e-5aa921a9cc8c tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.024650 Oct 19 00:56:51.490866 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1408/2770] 10.222.0.27 () {58 vars in 1178 bytes} [Wed Oct 19 00:56:51 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:56:51.606901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:51.614005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:51.614501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:51.615213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:51.620448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:51.622108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:51.625080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:51.652805 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:52.068772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf2c6a61-8594-4134-b8fd-4d08b7e003a3 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Action: 'create', calling method: .version_select at 0x7f2af45ab430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-471061940", "metadata": {"Type": "work"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf2c6a61-8594-4134-b8fd-4d08b7e003a3 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 121 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-471061940", "metadata": {"Type": "work"}}} Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-471061940', 'metadata': {'Type': 'work'}}}} Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '#$%' Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:52.097639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 19 00:56:52.102751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.104095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf2c6a61-8594-4134-b8fd-4d08b7e003a3 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:52.105371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf2c6a61-8594-4134-b8fd-4d08b7e003a3 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.600751 Oct 19 00:56:52.106231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1409/2771] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 00:56:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:52.125471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:52.138024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:52.139315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Searching by: {'deleted': False, 'project_id': '5017de8e297545248369595fa5db2f7d'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:56:52.155137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.155947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.157863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.158898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.160653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.162042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.222598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:56:52.267779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5eb34e2-a253-4ec7-a308-28fbe2a91a59 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.154478 Oct 19 00:56:52.282824 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1410/2772] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:56:52 2022] GET /compute/v2.1/servers => generated 681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:52.288462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee2e5f9b-1903-4b7c-b777-c152be0e12d2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Action: 'create', calling method: .version_select at 0x7f2af4454b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-433713994", "metadata": {"Type": "work"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee2e5f9b-1903-4b7c-b777-c152be0e12d2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 119 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-433713994", "metadata": {"Type": "work"}}} Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-433713994', 'metadata': {'Type': 'work'}}}} Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '0' Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:52.292559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.305152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee2e5f9b-1903-4b7c-b777-c152be0e12d2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:52.315672 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee2e5f9b-1903-4b7c-b777-c152be0e12d2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011966 Oct 19 00:56:52.322319 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1411/2773] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 00:56:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:52.324609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:52.331087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:52.345805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.352543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.353432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.354255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.354811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.355401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.383970 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] HTTP exception thrown: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 HTTP/1.1 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2b2c023-b2ff-4239-92d4-a36a544617d9'} Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:52.385668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 404 to user: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:52.391491 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62360a91-5a02-4fb2-beca-a09e33aacd53 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 404 len: 111 microversion: 2.1 time: 0.068861 Oct 19 00:56:52.401227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1412/2774] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:52 2022] DELETE /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:52.412521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9691a9d-3d54-4088-803d-20434a80c6bd tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Action: 'create', calling method: .version_select at 0x7f2af4588ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1291386995", "metadata": {"Type": "work"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9691a9d-3d54-4088-803d-20434a80c6bd tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 119 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1291386995", "metadata": {"Type": "work"}}} Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1291386995', 'metadata': {'Type': 'work'}}}} Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '' Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:56:52.416460 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9691a9d-3d54-4088-803d-20434a80c6bd tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:52.421425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9691a9d-3d54-4088-803d-20434a80c6bd tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015429 Oct 19 00:56:52.433177 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1413/2775] 10.222.0.27 () {60 vars in 1156 bytes} [Wed Oct 19 00:56:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:56:52.440319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:52.440994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:52.448562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:56:52.449077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquired lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:56:52.459248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.459710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.460154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.460889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.461352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.461805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.733893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:52.744600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38cdf3a8-0deb-4629-b227-9b12b0103883 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1327 microversion: 2.1 time: 0.310166 Oct 19 00:56:52.745902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1414/2776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:52 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1327 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:52.757165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:52.758604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:52.780364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.783391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.784097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.786230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:52.786909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:52.789084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:52.854962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:53.053722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a90911f3-aecc-428a-832e-3bbb55e57556 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449" status: 204 len: 0 microversion: 2.1 time: 0.304883 Oct 19 00:56:53.054737 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1415/2777] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:52 2022] DELETE /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:53.065551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3473a-95bf-4b2c-b746-4a4bb8456ff2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Calling method '.version_select at 0x7f2af4504940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:53.115544 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-39d3473a-95bf-4b2c-b746-4a4bb8456ff2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] HTTP exception thrown: Volume tempest-invalid-1698953670 could not be found. Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3473a-95bf-4b2c-b746-4a4bb8456ff2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1698953670 HTTP/1.1 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: exception: Volume tempest-invalid-1698953670 could not be found. Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'tempest-invalid-1698953670'} Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1698953670 could not be found. (HTTP 404) (Request-ID: req-325c240a-c6f4-4337-aef0-b3464ea0dd1f) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:53.117781 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1698953670 could not be found. Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1698953670 could not be found. Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1698953670 could not be found. Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3473a-95bf-4b2c-b746-4a4bb8456ff2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 404 to user: Volume tempest-invalid-1698953670 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39d3473a-95bf-4b2c-b746-4a4bb8456ff2 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1698953670" status: 404 len: 99 microversion: 2.1 time: 0.063228 Oct 19 00:56:53.126634 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1416/2778] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:56:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1698953670 => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:56:53.129186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:53.129186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:53.157582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.158218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.159244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.160206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.160910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.161973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.206799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.207292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.211587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.212864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid dc4dd459-fc61-4ee4-a19d-87b8696bdcca {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:56:53.423072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:53.431442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b4363c7-4dc3-476f-a386-fc594e2663a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1311 microversion: 2.1 time: 0.310540 Oct 19 00:56:53.432016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1417/2779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:53 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1311 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:53.462893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:53.463414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:53.465636 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:53.473505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.474347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.475145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.476379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.477216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.478181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.523806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:53.641904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7bb0f58e-c8fd-4968-8641-d81102902a5a tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "DELETE /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 204 len: 0 microversion: 2.1 time: 0.189079 Oct 19 00:56:53.643263 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1418/2780] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:53 2022] DELETE /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:53.650913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4dd459-fc61-4ee4-a19d-87b8696bdcca", "name": "network-vif-deleted", "tag": "3e00a50c-2046-4526-a3c9-69787badf85c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:53.663542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.664378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.665086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.679531 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:56:53.682745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] Creating event network-vif-deleted:3e00a50c-2046-4526-a3c9-69787badf85c for instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca on n-h1-master-1 Oct 19 00:56:53.689611 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-631e14d8-c868-43e3-8c8c-b6535eb49873 req-b4772ed8-e232-48a8-8f3f-c171676c9f70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044474 Oct 19 00:56:53.690987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1419/2781] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:53.703711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85dd69d4-c5c7-4b26-b8e2-56a8c03bca1b tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010803 Oct 19 00:56:53.705089 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1420/2782] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 00:56:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 00:56:53.711961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:53.713146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: f2b2c023-b2ff-4239-92d4-a36a544617d9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:53.722638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.723554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.728099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.729205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.729975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.730617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.758116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] HTTP exception thrown: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 HTTP/1.1 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2b2c023-b2ff-4239-92d4-a36a544617d9'} Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.761355 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. Oct 19 00:56:53.766832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:53.768999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 404 to user: Instance f2b2c023-b2ff-4239-92d4-a36a544617d9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:53.770328 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d4863d9-e523-4eea-8429-f8e77ed821dd tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9" status: 404 len: 111 microversion: 2.1 time: 0.064030 Oct 19 00:56:53.772182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1421/2783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:53 2022] GET /compute/v2.1/servers/f2b2c023-b2ff-4239-92d4-a36a544617d9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:53.782055 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92258a0c-7081-424d-afb7-45f236a14a23 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007596 Oct 19 00:56:53.783362 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1422/2784] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:56:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 00:56:53.789435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:53.790669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:53.799527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.801011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.801996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:53.803993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:53.805462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:53.806959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.146844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:54.156886 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e8a1ac0-bcb1-4824-930b-ed88cc2e55a0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1394 microversion: 2.1 time: 0.372023 Oct 19 00:56:54.157472 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1423/2785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:53 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1394 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:54.168911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:54.168911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:54.170121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:54.170982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:54.171996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.172940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:54.174033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:54.175222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.605094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:54.613950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f5e58e7-7b4b-46e9-a178-5044ae09d882 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449" status: 200 len: 1521 microversion: 2.1 time: 0.455446 Oct 19 00:56:54.641222 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1424/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:54 2022] GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:54.649128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19cf4342-5f5b-4483-a9bb-5dfdcb9f5688 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Calling method '.version_select at 0x7f2af4504940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:54.681636 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-19cf4342-5f5b-4483-a9bb-5dfdcb9f5688 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] HTTP exception thrown: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19cf4342-5f5b-4483-a9bb-5dfdcb9f5688 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-volumes/0fd1430a-eb34-48bb-9291-b2d6f228bf3e HTTP/1.1 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: exception: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0fd1430a-eb34-48bb-9291-b2d6f228bf3e'} Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. (HTTP 404) (Request-ID: req-ab0c9a79-1c01-4ab7-a9ab-9c0d44552981) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:54.684488 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. Oct 19 00:56:54.689091 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:54.696891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19cf4342-5f5b-4483-a9bb-5dfdcb9f5688 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 404 to user: Volume 0fd1430a-eb34-48bb-9291-b2d6f228bf3e could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:54.698108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-19cf4342-5f5b-4483-a9bb-5dfdcb9f5688 tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0fd1430a-eb34-48bb-9291-b2d6f228bf3e" status: 404 len: 109 microversion: 2.1 time: 0.055630 Oct 19 00:56:54.698689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1425/2787] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:56:54 2022] DELETE /compute/v2.1/os-volumes/0fd1430a-eb34-48bb-9291-b2d6f228bf3e => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:54.710296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:54.711465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:54.721211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:54.722082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:54.722862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.723907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:54.724520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:54.725140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.769487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:54.770440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:54.771091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:54.771794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid dc4dd459-fc61-4ee4-a19d-87b8696bdcca {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:56:55.003717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:55.017155 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64c9d05b-f6ce-449a-9bb3-d0e957cc63aa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 200 len: 1311 microversion: 2.1 time: 0.312470 Oct 19 00:56:55.017762 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1426/2788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:54 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 1311 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:55.061594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06876f9e-ce5e-442c-b38f-78a5be90e18f tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Calling method '.version_select at 0x7f2af450b790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:55.094541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:56:55.141589 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-06876f9e-ce5e-442c-b38f-78a5be90e18f tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] HTTP exception thrown: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06876f9e-ce5e-442c-b38f-78a5be90e18f tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Request method failure captured: Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-volumes/7de35de4-d3c7-4174-ab60-eded3c3ecfdd HTTP/1.1 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tTYiB4VIOvj-mpLv6BG1If-esn8FmWg3vBT1m_TDCSEtGswWu486Y3PRkBxPbXuG0lpwkOCC3Hrpe2PZ9I4t7DcsU9lGfg2kGQ7qfopX5O4PkLYwXa6wv8N6zPazUzy-TutTFg9_tF9rJIKmhuLBLJkcFC8SjPBlptvwaovElCgU4 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e870ca3f228e4c6894cf88d40e107fdd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e870ca3f228e4c6894cf88d40e107fdd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e870ca3f228e4c6894cf88d40e107fdd"}]}] Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e870ca3f228e4c6894cf88d40e107fdd Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-284456791 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4d6594653148482885eb4434812e8929 Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-284456791-project Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: exception: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7de35de4-d3c7-4174-ab60-eded3c3ecfdd'} Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. (HTTP 404) (Request-ID: req-3c2c4c87-93cc-4e32-8200-eb8a72157e6a) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 19 00:56:55.145358 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. Oct 19 00:56:55.149702 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:56:55.157223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06876f9e-ce5e-442c-b38f-78a5be90e18f tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] Returning 404 to user: Volume 7de35de4-d3c7-4174-ab60-eded3c3ecfdd could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:55.165155 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06876f9e-ce5e-442c-b38f-78a5be90e18f tempest-VolumesNegativeTest-284456791 tempest-VolumesNegativeTest-284456791-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/7de35de4-d3c7-4174-ab60-eded3c3ecfdd" status: 404 len: 109 microversion: 2.1 time: 0.136616 Oct 19 00:56:55.170799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1427/2789] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 00:56:55 2022] GET /compute/v2.1/os-volumes/7de35de4-d3c7-4174-ab60-eded3c3ecfdd => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:55.187368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b", "tag": "d6a29617-b83c-484d-bceb-1dfbbf4367da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:55.220184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:55.220751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:55.221392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:55.252724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] Creating event network-changed:d6a29617-b83c-484d-bceb-1dfbbf4367da for instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b on n-h2-master-1 Oct 19 00:56:55.267941 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-107ad373-40d8-4113-82f9-92f63329628b req-52549e68-339a-4939-901f-f79beb842f31 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093316 Oct 19 00:56:55.276456 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1428/2790] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:55.700871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1525136602", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:55.789435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:56:55.790029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:56:55.790674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:56:55.791200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:56:55.791900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:56:55.802827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:55.803503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:55.804124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:55.805730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:55.806311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:55.806855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:55.831246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Getting quotas for project fe7daea1c94340fcb98a3831cd74655f. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:55.838500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Getting quotas for user 5decad27fffe49b99ef87c8e388b6df1 and project fe7daea1c94340fcb98a3831cd74655f. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:55.855560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:56:55.858693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:56:55.936607 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00fec206-2393-4401-b70b-18bd99bdc1a0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.658752 Oct 19 00:56:55.945658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1429/2791] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:56:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:56:55.951782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:55.952590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:55.982143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:55.983051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:55.983611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:55.984443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:55.986157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:55.986991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:56.703775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:56.747031 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68f4c3e6-3752-40fe-9735-ae269c6b30b1 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1394 microversion: 2.1 time: 0.799708 Oct 19 00:56:56.748293 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1430/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:55 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1394 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:56.777685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:56.779777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:56.798383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:56.801222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:56.804387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:56.806049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:56.807761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:56.809351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:56.995776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Updating instance_info_cache with network_info: [{"id": "3e26fcc0-3a4b-489c-859e-d480f7657cda", "address": "fa:16:3e:45:77:94", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3e26fcc0-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:56:57.025184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Releasing lock "refresh_cache-26f1226a-28ac-4f36-b7d5-31f7f6412acb" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:56:57.026662 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25ab2fa3-8dbd-44b4-8d8a-62a74c25f389 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb/action" status: 202 len: 0 microversion: 2.1 time: 5.717592 Oct 19 00:56:57.032411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1363/2793] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:51 2022] POST /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb/action => generated 0 bytes in 5721 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:56:57.039327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26f1226a-28ac-4f36-b7d5-31f7f6412acb", "tag": "3e26fcc0-3a4b-489c-859e-d480f7657cda"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.039787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8c5c0d3f9394736829782c7ac69ff05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5017de8e297545248369595fa5db2f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.054542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-709717aa-c493-4aa5-b17b-bc43de0557ec tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449" status: 200 len: 1479 microversion: 2.1 time: 0.304888 Oct 19 00:56:57.055273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1431/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:56 2022] GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 => generated 1479 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:56:57.058273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.058828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.059277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.061407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.071938 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] Creating event network-changed:3e26fcc0-3a4b-489c-859e-d480f7657cda for instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb on n-h1-master-1 Oct 19 00:56:57.073741 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:57.079674 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9893233c-0cfd-4035-84cc-e9877db7971e req-0777993b-0ff6-4b56-a9b8-5968c4939544 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045381 Oct 19 00:56:57.080514 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1364/2795] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:57.087094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.087678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.087953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:57.088893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:57.089037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.089778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.090467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.091643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.099764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.100587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.101267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.102186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.102655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.103265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.121842 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca HTTP/1.1 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dc4dd459-fc61-4ee4-a19d-87b8696bdcca'} Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:57.123673 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:56:57.128021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:56:57.130183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-00ebfa50-822d-4cc9-bd5e-235229ae706e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 404 len: 111 microversion: 2.1 time: 0.044535 Oct 19 00:56:57.131371 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1365/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:56:57 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:56:57.142337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:57.143324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:57.152354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.153004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.154323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.155055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.155515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.155944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.197682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:56:57.208208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.221374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.227120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.233612 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d68188c5-0e7a-491b-9ec6-cb885ec8ecaa tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "PUT /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1363 microversion: 2.75 time: 0.176945 Oct 19 00:56:57.259000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1432/2797] 10.222.0.27 () {62 vars in 1297 bytes} [Wed Oct 19 00:56:57 2022] PUT /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:56:57.266174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80118f7a-3ba2-4e7e-abe3-34b644ff23a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: .version_select at 0x7f2af4d9b5e0>, body: {"keypair": {"name": "tempest-key-2139012885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcOu4UckmFZwShyUWH5UXSUybiAtaJO1J4uXxJ3W8/7aOu6OLfIGUI+KBKy3xLqoij1EKMro3GSQYW4jSxbqxYT55L2Pb1aIZ95lqxLLIUKa+er2T99dqB9RJHSMFBkSw=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.286242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-80118f7a-3ba2-4e7e-abe3-34b644ff23a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:56:57.294729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-80118f7a-3ba2-4e7e-abe3-34b644ff23a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:56:57.332889 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80118f7a-3ba2-4e7e-abe3-34b644ff23a3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.071894 Oct 19 00:56:57.334013 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1433/2798] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:56:57 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:57.344363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:57.345511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:57.359580 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6aac0cd7-d462-4770-ad55-8557e5d4fc02 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 204 len: 0 microversion: 2.1 time: 0.226918 Oct 19 00:56:57.360450 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1366/2799] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:56:57 2022] DELETE /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:56:57.376145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5572b28-fdf3-4741-9dc3-d6150c0fd149 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '.version_select at 0x7f2af46d8820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:56:57.377263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.378111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.380135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.381620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.382302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.383231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.405277 n-d-master-1 devstack@n-api.service[131450]: WARNING oslo_db.sqlalchemy.utils [None req-a5572b28-fdf3-4741-9dc3-d6150c0fd149 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 19 00:56:57.430808 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5572b28-fdf3-4741-9dc3-d6150c0fd149 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.068941 Oct 19 00:56:57.431401 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1367/2800] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:56:57 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:57.441981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.40"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.467145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:56:57.487821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.488940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.489581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.490858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.491489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.492604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.549753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:56:57.550404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquired lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:56:57.615141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.626454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.639620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:56:57.665226 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5215df04-ede1-4c48-9e72-7c584a4e918c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1363 microversion: 2.75 time: 0.326487 Oct 19 00:56:57.666982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1434/2801] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:56:57 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:56:57.700575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43266cbd-2735-482a-b9da-f53806435449", "name": "network-vif-deleted", "tag": "3370d9d8-c7a9-48b3-bf48-4cdb7acdc995"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.719705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:56:57.720398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:56:57.720741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:56:57.735582 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] Creating event network-vif-deleted:3370d9d8-c7a9-48b3-bf48-4cdb7acdc995 for instance 43266cbd-2735-482a-b9da-f53806435449 on n-h1-master-1 Oct 19 00:56:57.742183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7e3d8901-f72f-4fdb-8fc3-a0d4087024cd req-3f394681-bd78-41b2-a53d-dc0b5865fee5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059655 Oct 19 00:56:57.743318 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1435/2802] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:56:57.750370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-805603990", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-key-2139012885", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:56:57.853942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:57:00.012134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:00.013335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:00.013856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:00.014278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:00.014696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:00.033581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:00.035192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:00.037502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:00.038550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:00.040319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:00.046368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:00.088749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:57:00.095766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:57:00.124992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:57:00.127457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:00.142762 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=14 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:00.260859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b807cb61-10dd-4e4d-a47d-670ceb7ce237 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.515429 Oct 19 00:57:00.262314 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1436/2803] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:56:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:57:00.268120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:00.272784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:00.290027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:00.290744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:00.291349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:00.292252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:00.293565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:00.295260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:00.326545 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:01.051211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:01.069624 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41e4f2a0-f35d-4373-896c-81e489d468d0 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1394 microversion: 2.1 time: 0.805204 Oct 19 00:57:01.080946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1437/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:00 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1394 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:01.095470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:01.097103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 43266cbd-2735-482a-b9da-f53806435449] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:01.112069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:01.113345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:01.114423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:01.115665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:01.120011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:01.121332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:01.140641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] HTTP exception thrown: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 HTTP/1.1 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '43266cbd-2735-482a-b9da-f53806435449'} Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:01.142503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. Oct 19 00:57:01.147233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:01.148853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 404 to user: Instance 43266cbd-2735-482a-b9da-f53806435449 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:01.149837 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d030b436-5c23-4ebf-9666-83cfbc49a843 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449" status: 404 len: 111 microversion: 2.1 time: 0.067455 Oct 19 00:57:01.152250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1438/2805] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:01 2022] GET /compute/v2.1/servers/43266cbd-2735-482a-b9da-f53806435449 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:01.170890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:01.172856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:01.197222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:01.198493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:01.199813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:01.201435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:01.202995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:01.210791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:01.898966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:01.908111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:01.909642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:01.923940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-600bc1e2-bbfe-4d0a-b5f7-445b7638cc22 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1417 microversion: 2.75 time: 0.769463 Oct 19 00:57:01.948460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1439/2806] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:01 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1417 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:01.963212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a4cde8-09b7-410a-b77f-1b523e8299f9", "name": "network-vif-deleted", "tag": "33999f42-701a-41ba-80a2-fae426fc40d5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:01.979219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:01.988353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:01.989038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.004940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] Creating event network-vif-deleted:33999f42-701a-41ba-80a2-fae426fc40d5 for instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 on n-h2-master-1 Oct 19 00:57:02.022497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ce6c3394-5a80-4177-8b13-fcb2fff9a071 req-867c1dcf-4289-400e-8f7d-c2522847d93d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072631 Oct 19 00:57:02.023382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1440/2807] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:02.029451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:02.035879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:02.046846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.047337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.047777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.048490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.053676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.054234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.260408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:02.271216 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-134126d2-0567-4ccd-acbf-03f45380fdf8 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1280 microversion: 2.1 time: 0.246414 Oct 19 00:57:02.271817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1441/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:02 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1280 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:02.283234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:02.283864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] [instance: 00a4cde8-09b7-410a-b77f-1b523e8299f9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:02.310271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.310894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.311343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.312072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.312537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.313005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.369520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] HTTP exception thrown: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Request method failure captured: Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 HTTP/1.1 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0safQ5YGg48ypPk1P-lYlnTqw5WtimqGB5GJgp2zY27tdObdy7gFBlH5if0_cdRRSlKi6p3ehRqfKvB9yFrZrP-e2YZYRU-Rf4ruQ9Q2ft-6KYVPafEx0hs1LYNNWF-f9yVxreb-gssrqy7rm7d19UVs_-FZpcEE1Q7ckUiNczo_U4 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5017de8e297545248369595fa5db2f7d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5017de8e297545248369595fa5db2f7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5017de8e297545248369595fa5db2f7d"}]}] Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5017de8e297545248369595fa5db2f7d Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1288155888 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: b8c5c0d3f9394736829782c7ac69ff05 Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServersNegativeTestJSON-1288155888-project Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '00a4cde8-09b7-410a-b77f-1b523e8299f9'} Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:02.375713 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] Returning 404 to user: Instance 00a4cde8-09b7-410a-b77f-1b523e8299f9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:02.379885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c51a16e-f9c7-43be-ab1a-b7514f387413 tempest-ListServersNegativeTestJSON-1288155888 tempest-ListServersNegativeTestJSON-1288155888-project] 10.222.0.27 "GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9" status: 404 len: 111 microversion: 2.1 time: 0.104549 Oct 19 00:57:02.390979 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1442/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:02 2022] GET /compute/v2.1/servers/00a4cde8-09b7-410a-b77f-1b523e8299f9 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:02.396071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b", "name": "network-vif-plugged", "status": "completed", "tag": "d6a29617-b83c-484d-bceb-1dfbbf4367da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:02.431079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.434113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.437143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.470005 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] Creating event network-vif-plugged:d6a29617-b83c-484d-bceb-1dfbbf4367da for instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b on n-h2-master-1 Oct 19 00:57:02.491220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ff053b91-152a-48ec-bffe-8f5c936f7355 req-63db8383-5355-4838-a259-d1a860071189 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098857 Oct 19 00:57:02.492564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1443/2810] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:02.507343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:02.517822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:02.545568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.553821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.557921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:02.560265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:02.561066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:02.562878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:03.667456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:03.689199 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-76df0058-a7ee-4df9-bc44-680d3cabaa65 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1394 microversion: 2.1 time: 1.189971 Oct 19 00:57:03.693373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1444/2811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:02 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1394 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:03.702669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:03.706069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:03.712931 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:03.735636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:03.737319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:03.738818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:03.741759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:03.743065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:03.744798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:03.959350 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:03.979243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:57:03.980518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:03.987079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:04.004157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4a2300e-24d0-4118-9ded-960a55caaefd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1438 microversion: 2.75 time: 0.306267 Oct 19 00:57:04.005712 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1445/2812] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:03 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1438 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:04.019964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:04.022080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:04.041359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.042305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.046957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:04.048210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.049807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.053651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:04.265191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:04.281009 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e2a3ff2-e525-4e5c-8ad6-70f83965b9e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1286 microversion: 2.1 time: 0.272182 Oct 19 00:57:04.282215 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1446/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:04 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1286 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:04.292137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:04.305979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:04.314292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.316325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.317117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:04.318220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.318981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.319741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:04.326819 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:04.439872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:04.442445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:04.444924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:04.447326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:04.448662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:04.640396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:04.693519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.694281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.694711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:04.701728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:04.707396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:04.707893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:05.288206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:05.299021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:05.300497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:05.319225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40725ab6-d548-4d2f-b076-17228f3d10e6 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "POST /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95/action" status: 202 len: 1495 microversion: 2.75 time: 1.035645 Oct 19 00:57:05.319899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1447/2814] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:57:04 2022] POST /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95/action => generated 1495 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 00:57:05.358948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26f1226a-28ac-4f36-b7d5-31f7f6412acb", "name": "network-vif-deleted", "tag": "3e26fcc0-3a4b-489c-859e-d480f7657cda"}, {"name": "network-changed", "server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:05.386463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:05.393079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:05.393847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:05.427370 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Creating event network-vif-deleted:3e26fcc0-3a4b-489c-859e-d480f7657cda for instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb on n-h1-master-1 Oct 19 00:57:05.439617 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] Creating event network-changed:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:57:05.470719 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bdd14c3d-c608-4c5e-8949-fe5dc181ca09 req-7cb13009-9133-4af4-ba38-ab18596fcf4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122584 Oct 19 00:57:05.471347 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1448/2815] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:05.476446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:05.477170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:05.495266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:05.495987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:05.497570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:05.498477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:05.499142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:05.499912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:06.655026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:06.668392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ed477f4-8e8b-499b-b9ed-452bfef9368f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1575 microversion: 2.1 time: 1.195142 Oct 19 00:57:06.670504 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1449/2816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:05 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1575 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:06.676423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:06.677486 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:06.696577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:06.697717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:06.698438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:06.701279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:06.710305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:06.711572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:07.402086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Updating instance_info_cache with network_info: [{"id": "c1b3ec96-7cce-455f-82c8-70a386d9088b", "address": "fa:16:3e:c2:69:1c", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1b3ec96-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:57:07.421125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Releasing lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:57:07.422802 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1eccfd6d-174d-4a90-b8d1-6696776f1385 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action" status: 202 len: 0 microversion: 2.1 time: 9.984322 Oct 19 00:57:07.423885 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1368/2817] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:56:57 2022] POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action => generated 0 bytes in 9986 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:57:07.446967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:07.448151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:07.459894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:07.461061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:07.462031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:07.470002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:07.470785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:07.471456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:07.580445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:07.589699 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5639f02-6cf2-4a36-9ada-c58d3d38e9e4 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1328 microversion: 2.1 time: 0.917678 Oct 19 00:57:07.593411 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1450/2818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:06 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1328 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:07.615771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:07.616772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:07.631410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:07.631685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:07.632288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:07.633243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:07.641408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:07.642139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:07.900721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:07.913092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:07.919977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:07.938507 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5a4adb7-e9a6-46ac-ac5d-af6d4ac67e46 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.505317 Oct 19 00:57:07.941941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1369/2819] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:07 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:07.954726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da29447a-729b-457a-8800-f95611cab962 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '.version_select at 0x7f2af486a700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:08.109383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-856f87b8-9d3f-4291-9f17-fd1d4b2ae188 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.514644 Oct 19 00:57:08.110835 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1451/2820] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:57:07 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b/os-interface => generated 285 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:08.116492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf12d9e-0820-459a-8ee5-ece31d9c538c", "tag": "ae84f7d8-f953-4d94-8830-14214800f92d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:08.143056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:08.143871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:08.144511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:08.164080 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] Creating event network-changed:ae84f7d8-f953-4d94-8830-14214800f92d for instance caf12d9e-0820-459a-8ee5-ece31d9c538c on n-h1-master-1 Oct 19 00:57:08.169775 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2b7da29c-1302-4168-9e8d-3f3ea365f1c1 req-8b2ecd43-b179-451f-8f46-76ded4e62c05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057178 Oct 19 00:57:08.170796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1452/2821] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:08.389125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-248746369", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "33a93b70-673e-4898-a216-fac564da5b5c"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:08.471034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] validate_networks() for [('33a93b70-673e-4898-a216-fac564da5b5c', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:57:08.625975 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da29447a-729b-457a-8800-f95611cab962 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/a444506a-8567-44c3-aeb3-24a79515b8bb" status: 200 len: 183 microversion: 2.1 time: 0.681997 Oct 19 00:57:08.627329 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1370/2822] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:57:07 2022] GET /compute/v2.1/os-floating-ips/a444506a-8567-44c3-aeb3-24a79515b8bb => generated 183 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:08.634429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:08.637160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:08.663119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:08.664422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:08.665376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:08.667192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:08.667875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:08.668609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:09.327417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:09.337993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b87de95-c0ce-42e6-9368-d1a91cfc4c7a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1328 microversion: 2.1 time: 0.709316 Oct 19 00:57:09.341483 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1371/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:08 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1328 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:09.346537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.40"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:09.763998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:09.773339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:09.774754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:09.776029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:09.777838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:09.780243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:09.781069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:10.055082 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:10.118596 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=18 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:10.389076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 19 00:57:10.390261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquired lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 19 00:57:10.885319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:10.888300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:10.889074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:10.889746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:10.891980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:10.921724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:10.924775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:10.925451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:10.930065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:10.930773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:10.931565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:10.999524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Getting quotas for project 7da1bd05d0434eb09dc23bf327d9f1c1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:57:11.015227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Getting quotas for user 37c7f5d1bc3a431eacef3cf113e958d7 and project 7da1bd05d0434eb09dc23bf327d9f1c1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:57:11.082838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:57:11.100742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:11.230140 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bfb089aa-2fbd-4e58-b425-b5d8e86aaa6a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.001462 Oct 19 00:57:11.232136 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1453/2824] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:57:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3004 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:57:11.245451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:11.247462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:11.259530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:11.265280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:11.265842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:11.267375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:11.268020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:11.268743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:11.514462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:11.528255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:11.533905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:11.550644 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be3c830e-db27-46b5-96c3-d6ab11a7777b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.316877 Oct 19 00:57:11.551261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1454/2825] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:11 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:11.566395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:11.567192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:11.591987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:11.592779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:11.593295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:11.594034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:11.595095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:11.595714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.255531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Building network info cache for instance {{(pid=131450) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 19 00:57:12.287231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.316163 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8aed09c-c9bf-4406-8b7b-20985562f80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1328 microversion: 2.1 time: 0.763809 Oct 19 00:57:12.321809 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1455/2826] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:11 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1328 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:12.340076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:12.341511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:12.362077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:12.362660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:12.363112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.363836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:12.364297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:12.364776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.484227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.495099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.510818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.512453 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a67b1643-ff03-4ca0-9efa-8aead3a9bd41 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1265 microversion: 2.26 time: 0.189282 Oct 19 00:57:12.516446 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1456/2827] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:12 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:12.522731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:12.552878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:12.553375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:12.553798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.585657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] Creating event network-changed:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:57:12.608079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-54d16fe9-c3d9-4ca4-8338-c2e74aab54ae req-4dbde4d0-c404-4d65-b14a-08ec2585f0d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088910 Oct 19 00:57:12.608826 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1457/2828] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:12.633408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:12.634482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:12.642274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:12.643116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:12.643785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.644756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:12.645457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:12.646279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:12.864113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.873116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.878691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:12.894615 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a798b136-4a1b-45c3-9da9-8042f2e7f9eb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.282218 Oct 19 00:57:12.909717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1458/2829] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:12 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:13.347446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:13.348068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:13.356670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:13.357183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:13.357621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:13.361546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:13.369364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:13.370093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:13.793514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Updating instance_info_cache with network_info: [{"id": "c1b3ec96-7cce-455f-82c8-70a386d9088b", "address": "fa:16:3e:c2:69:1c", "network": {"id": "21eb6968-4e21-4c3c-9e27-1e05098f2503", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-6470110-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "072952a76c8f483d9d8b5912b2e0ecb3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc1b3ec96-7c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 00:57:13.810626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Releasing lock "refresh_cache-ba4cba7b-265e-47d3-b8c5-50a44288c3f2" {{(pid=131450) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 19 00:57:13.811535 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8c81078-9740-4fa3-b185-6001911caacd tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action" status: 202 len: 0 microversion: 2.1 time: 4.468746 Oct 19 00:57:13.812167 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1372/2830] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:57:09 2022] POST /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2/action => generated 0 bytes in 4470 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 19 00:57:13.830173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:13.831684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:13.845672 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:13.855005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:13.855542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:13.856755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:13.869292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:13.870034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:13.871303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.086850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.116972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.118644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.121273 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-859419ce-c7fd-4895-bbbb-b6b5a07e39ca tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1319 microversion: 2.26 time: 0.308028 Oct 19 00:57:14.123180 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1373/2831] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:13 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:14.150930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:14.158989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:14.171992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.174391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.177505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.178506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.179352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.180017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.211874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] HTTP exception thrown: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Request method failure captured: Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb HTTP/1.1 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sJO9VpBRWqFROO3XQCFPz9lTtC2NO3Sr3gc0r9m-otJkyzZ4d1vrfhx-73wbTJIqoBNFRFpx8CaKI_qRU7555Yiv0CwE0cnvQ0uTKHkAZpN6oXnG79pho7KQpeIlBOlvH6ZvIjocrQEYBSVgqeYDCJ0CY4q4dFQtgrjo9c0IxNQ68 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072952a76c8f483d9d8b5912b2e0ecb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}] Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d76c8fd5fe0a49da9bad854cbe8c74e0 Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '26f1226a-28ac-4f36-b7d5-31f7f6412acb'} Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:14.213629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Returning 404 to user: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:14.219008 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-258ba3e3-ba25-4173-b4f5-e45087dfd63d tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "DELETE /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 404 len: 111 microversion: 2.1 time: 0.080748 Oct 19 00:57:14.223181 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1374/2832] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:57:14 2022] DELETE /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:14.225877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:14.231311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:14.249144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.249547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.252784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.254215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.254703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.257514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.466189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.490717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.499438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.509728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:14.520223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28b14df4-a802-4ffb-b5d3-c44a96911a7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1328 microversion: 2.1 time: 1.176445 Oct 19 00:57:14.525648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1459/2833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:13 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1328 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:14.539665 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2fd0998f-cde6-4abb-993e-a9207f157b84 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.317536 Oct 19 00:57:14.545249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1375/2834] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:14 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:14.545560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:14.545560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: 26f1226a-28ac-4f36-b7d5-31f7f6412acb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:14.565240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.565751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.566206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.571615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.572174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.572657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.623995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] HTTP exception thrown: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Request method failure captured: Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb HTTP/1.1 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sJO9VpBRWqFROO3XQCFPz9lTtC2NO3Sr3gc0r9m-otJkyzZ4d1vrfhx-73wbTJIqoBNFRFpx8CaKI_qRU7555Yiv0CwE0cnvQ0uTKHkAZpN6oXnG79pho7KQpeIlBOlvH6ZvIjocrQEYBSVgqeYDCJ0CY4q4dFQtgrjo9c0IxNQ68 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072952a76c8f483d9d8b5912b2e0ecb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}] Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d76c8fd5fe0a49da9bad854cbe8c74e0 Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '26f1226a-28ac-4f36-b7d5-31f7f6412acb'} Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.625753 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Returning 404 to user: Instance 26f1226a-28ac-4f36-b7d5-31f7f6412acb could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c5a09d7-9d1d-41c5-a6a6-78b792c14448 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb" status: 404 len: 111 microversion: 2.1 time: 0.098514 Oct 19 00:57:14.630872 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1460/2835] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:14 2022] GET /compute/v2.1/servers/26f1226a-28ac-4f36-b7d5-31f7f6412acb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:14.638592 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbf84103-c541-4684-a0e0-34804b882c59 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '.version_select at 0x7f2af493a820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:14.680591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf12d9e-0820-459a-8ee5-ece31d9c538c", "name": "network-vif-plugged", "status": "completed", "tag": "ae84f7d8-f953-4d94-8830-14214800f92d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:14.707430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:14.707951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:14.710860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:14.753696 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] Creating event network-vif-plugged:ae84f7d8-f953-4d94-8830-14214800f92d for instance caf12d9e-0820-459a-8ee5-ece31d9c538c on n-h1-master-1 Oct 19 00:57:14.767582 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8b5725ec-0849-48a7-aa13-f42940190408 req-ca19c9a8-aaad-48d6-a98e-63de33cac71a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091112 Oct 19 00:57:14.771616 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1461/2836] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:15.127704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:15.128491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:15.141628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:15.149097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:15.149844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:15.150778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:15.151576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:15.152192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:15.804815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:15.816370 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-337c6f52-50a1-4253-be55-60e5f8c2bad3 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1575 microversion: 2.1 time: 0.694734 Oct 19 00:57:15.829075 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1462/2837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:15 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1575 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:15.841962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:15.842854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:15.851811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:15.852600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:15.853246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:15.854161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:15.854788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:15.855387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:16.259558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:16.281110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:16.282907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:16.284244 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7bff0d9a-6195-43e4-9609-a54d4ddd6669 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1319 microversion: 2.26 time: 0.453871 Oct 19 00:57:16.285361 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1463/2838] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:15 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:16.290335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b", "tag": "d6a29617-b83c-484d-bceb-1dfbbf4367da"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:16.327682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:16.329077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:16.329666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:16.348356 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] Creating event network-changed:d6a29617-b83c-484d-bceb-1dfbbf4367da for instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b on n-h2-master-1 Oct 19 00:57:16.368797 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-95119dec-a890-4a80-9ee1-2fc60d1f141d req-514bfc87-da58-409b-bc3f-5d2449381599 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081921 Oct 19 00:57:16.371500 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1464/2839] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:16.377108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:16.385361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:16.399079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:16.400046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:16.404861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:16.405865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:16.411533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:16.412326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:17.399119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:17.411193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8bd40c4-2b0f-437e-94a2-79c5e4fcf1a2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1328 microversion: 2.1 time: 1.036748 Oct 19 00:57:17.415700 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1465/2840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:16 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1328 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:17.429072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:17.435195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:17.447238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:17.451642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:17.452195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:17.453237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:17.458506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:17.459198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:17.499162 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:17.777661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:17.797784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:17.800065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:17.817007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc9d4ad5-18c6-46f3-a103-fc8cf0ecffaf tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.398415 Oct 19 00:57:17.817628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1466/2841] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:17 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:17.829326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:17.830323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:17.838040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:17.848244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:17.850622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:17.854557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:17.857987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:17.860047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.333401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:18.345484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:18.347363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:18.348875 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f779f1f-04c4-4850-a15d-a3eb62a7fab5 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.527237 Oct 19 00:57:18.349448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1467/2842] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:17 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:18.434803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:18.435387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:18.443171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.443663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.445913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.448205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.448949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.450994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.456541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbf84103-c541-4684-a0e0-34804b882c59 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/a444506a-8567-44c3-aeb3-24a79515b8bb" status: 202 len: 0 microversion: 2.1 time: 3.823046 Oct 19 00:57:18.457174 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1376/2843] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:57:14 2022] DELETE /compute/v2.1/os-floating-ips/a444506a-8567-44c3-aeb3-24a79515b8bb => generated 0 bytes in 3824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:57:18.464903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:18.466041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:18.475654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.476200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.476660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.477904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.482123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.482774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.525060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:57:18.699508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9959d7e-80c0-4152-b0af-28b76d527cd8 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 204 len: 0 microversion: 2.1 time: 0.237746 Oct 19 00:57:18.711008 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1377/2844] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:57:18 2022] DELETE /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:57:18.729313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:18.732270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:18.752176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.752968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.753652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:18.754839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:18.755524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:18.756197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.352786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.376672 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-024d9376-8908-4c29-b0ac-796c876a6247 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1523 microversion: 2.1 time: 0.657718 Oct 19 00:57:19.377881 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1378/2845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:18 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1523 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:19.385872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:19.386674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.386887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:19.394753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.395444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.396087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.397349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.398291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.398881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.405900 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=5,nova_cell1:RELEASE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:19.407167 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6b7cc38-525e-4d50-9ce0-de16ff11025f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1510 microversion: 2.1 time: 0.976535 Oct 19 00:57:19.408442 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1468/2846] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:18 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1510 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:19.413673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:19.419475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:19.430558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.431136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.431627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.432350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.432846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.433273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.521359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.531632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.533235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.538946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28dbd1e9-e6d3-41d9-8654-2b79b430a27c tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.159820 Oct 19 00:57:19.539805 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1379/2847] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:19 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:19.544911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:19.545706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:19.552354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.553099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.553796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.554747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.555393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.555974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.727733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.748861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.751759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.754233 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0aec3743-a22c-4c8b-9e00-b3a9f1ff179b tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.344131 Oct 19 00:57:19.781239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1469/2848] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:19 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:19.918407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:19.930069 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d54e534-bd98-4857-a20b-d7422afb6bfe tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1510 microversion: 2.1 time: 0.388973 Oct 19 00:57:19.930456 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1380/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:19 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:19.958513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:19.959040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:19.970124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.970641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.971375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:19.972329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:19.973752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:19.975368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.033846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:57:20.178622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4aeae1e3-e269-4048-b3d2-af8ffd965169 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 204 len: 0 microversion: 2.1 time: 0.224451 Oct 19 00:57:20.182793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1470/2850] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:57:19 2022] DELETE /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:57:20.189432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:20.190063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:20.198286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.199197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.201164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.201961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.202616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.203216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.408569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:20.409313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:20.415652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.416409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.417831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.418631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.419094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.419524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.761151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:20.773871 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe1a1f65-7bb6-44e9-87f9-922352fbae1c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1516 microversion: 2.1 time: 0.588645 Oct 19 00:57:20.775285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1381/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:20 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1516 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:20.781359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f63016-2991-42ac-ab59-6bd7d23f72c1", "tag": "344c96ef-efa2-4bc9-9001-6b1b8d0730c9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:20.792273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.792930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.794680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.806922 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] Creating event network-changed:344c96ef-efa2-4bc9-9001-6b1b8d0730c9 for instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 on n-h1-master-1 Oct 19 00:57:20.813996 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c63fe1dd-c1d4-48e1-b085-38e9e538f770 req-1dba9f51-2551-4b29-933e-4ee2da35c04b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037223 Oct 19 00:57:20.815259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1382/2852] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:20.822241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:20.823588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:20.832161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.832980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.833605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.835492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:20.836385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:20.837342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:20.944488 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:20.973479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:20.981920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.002136 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20d8e733-b3a8-4742-a8f1-157ad7ef992a tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1523 microversion: 2.1 time: 0.597671 Oct 19 00:57:21.006659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.007579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1471/2853] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:20 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1523 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:21.012491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.026782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:21.027472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:21.037797 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-59b3d5f9-b3e7-4bd8-ab43-88b7de8ee861 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.220947 Oct 19 00:57:21.039574 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:21.044099 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1383/2854] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:20 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:21.051304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:21.052208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:21.054436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:21.056049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:21.063199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:21.063724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:21.360183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.376115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.379062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:21.380839 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f352e443-49bb-4095-93d7-3ee037eb13d2 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.370744 Oct 19 00:57:21.397585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1472/2855] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:21 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:21.797939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:21.798540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:21.815241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:21.815837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:21.816403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:21.817158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:21.817617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:21.818184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.039978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:22.040585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:22.084360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.086432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.086886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.091182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.091679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.092127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.203446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.206357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.207092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.207746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lazy-loading 'fault' on Instance uuid ba4cba7b-265e-47d3-b8c5-50a44288c3f2 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:22.376497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76c8fd5fe0a49da9bad854cbe8c74e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '072952a76c8f483d9d8b5912b2e0ecb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:22.385228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68225e0f-459f-4c1c-bc36-91af757a215c tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 200 len: 1314 microversion: 2.1 time: 0.355502 Oct 19 00:57:22.393015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1473/2856] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:22 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:22.408088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:22.409251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:22.431381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.438356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.439221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.441126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.442438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.454499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.529727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:22.539843 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67a496b8-4ce5-4337-8670-a081b80996ff tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1516 microversion: 2.1 time: 0.746711 Oct 19 00:57:22.543441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1384/2857] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:21 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1516 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:22.558631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:22.559487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:22.571805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.573755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.575553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.576930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.577757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.579776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.588411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:22.597853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:22.617278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:22.628494 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-485a07a4-6f7b-4e83-8bea-0132ef1957fb tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.234235 Oct 19 00:57:22.629149 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1474/2858] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:22 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:22.859722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba4cba7b-265e-47d3-b8c5-50a44288c3f2", "name": "network-vif-deleted", "tag": "c1b3ec96-7cce-455f-82c8-70a386d9088b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:22.886257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:22.886805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:22.887394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:22.920915 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] Creating event network-vif-deleted:c1b3ec96-7cce-455f-82c8-70a386d9088b for instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 on n-h2-master-1 Oct 19 00:57:22.930596 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cf021078-57ea-462b-9ef3-6d1fa5f82071 req-1a78ddc8-2c36-4255-b7c6-286dda468e47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074908 Oct 19 00:57:22.932117 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1475/2859] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:23.083200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:23.102056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:23.103631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:23.109594 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a1e63bb-c949-4670-a4e6-5fe59c6c5c53 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.564611 Oct 19 00:57:23.112473 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1385/2860] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:22 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:23.415948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:23.417248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] [instance: ba4cba7b-265e-47d3-b8c5-50a44288c3f2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:23.420484 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:23.426743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.427241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.429620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.430592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.431429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.433141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.479911 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] HTTP exception thrown: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Request method failure captured: Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 HTTP/1.1 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sJO9VpBRWqFROO3XQCFPz9lTtC2NO3Sr3gc0r9m-otJkyzZ4d1vrfhx-73wbTJIqoBNFRFpx8CaKI_qRU7555Yiv0CwE0cnvQ0uTKHkAZpN6oXnG79pho7KQpeIlBOlvH6ZvIjocrQEYBSVgqeYDCJ0CY4q4dFQtgrjo9c0IxNQ68 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_072952a76c8f483d9d8b5912b2e0ecb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/072952a76c8f483d9d8b5912b2e0ecb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/072952a76c8f483d9d8b5912b2e0ecb3"}]}] Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 072952a76c8f483d9d8b5912b2e0ecb3 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1736558010 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d76c8fd5fe0a49da9bad854cbe8c74e0 Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1736558010-project Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ba4cba7b-265e-47d3-b8c5-50a44288c3f2'} Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:23.493446 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] Returning 404 to user: Instance ba4cba7b-265e-47d3-b8c5-50a44288c3f2 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:23.498351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ac01f30-bba3-46eb-ae92-3ec2070efc24 tempest-FloatingIPsAssociationTestJSON-1736558010 tempest-FloatingIPsAssociationTestJSON-1736558010-project] 10.222.0.27 "GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2" status: 404 len: 111 microversion: 2.1 time: 0.083388 Oct 19 00:57:23.500858 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1476/2861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:23 2022] GET /compute/v2.1/servers/ba4cba7b-265e-47d3-b8c5-50a44288c3f2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:23.568230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:23.568893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:23.575645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf12d9e-0820-459a-8ee5-ece31d9c538c", "name": "network-vif-deleted", "tag": "ae84f7d8-f953-4d94-8830-14214800f92d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:23.581485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.582054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.584402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.585215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.586851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.587303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.601019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.601859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.602492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.631221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] Creating event network-vif-deleted:ae84f7d8-f953-4d94-8830-14214800f92d for instance caf12d9e-0820-459a-8ee5-ece31d9c538c on n-h1-master-1 Oct 19 00:57:23.666913 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e24c5733-b81a-4536-bea5-af2335d8f1c0 req-6d59c5d1-507a-45a0-83db-174a7b420cb9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097396 Oct 19 00:57:23.667525 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1477/2862] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:23.685466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:23.702541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:23.726024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.726780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.729107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:23.730063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:23.733515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:23.735748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:24.197965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.207139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.209557 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8ee4af0-b148-4519-93d9-e7d57c8c2466 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1313 microversion: 2.1 time: 0.648295 Oct 19 00:57:24.210156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1386/2863] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:23 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:24.230104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:24.231409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:24.241815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.243611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:24.244430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.245712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:24.247563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:24.250536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:24.252129 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8822cc1e-9187-47d0-a734-e8f9a2a144d9 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.575387 Oct 19 00:57:24.252580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:24.253219 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1478/2864] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:23 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:24.272003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:24.781643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.799322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.801410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:24.802636 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-133a1daf-862e-47ed-8654-a6bdf28090af tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.589258 Oct 19 00:57:24.812957 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1387/2865] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:24 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:25.238416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:25.239288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:25.247427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.248076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.248795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.249790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.250447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.251038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.287790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.288220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.288881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.289511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid caf12d9e-0820-459a-8ee5-ece31d9c538c {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:25.290956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:25.292150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:25.299434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.300290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.301272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.302508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.303174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.304277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.442917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:25.453138 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d063fc69-4352-4249-a2a1-fc0a30c24ed0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 200 len: 1318 microversion: 2.1 time: 0.218622 Oct 19 00:57:25.453654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1479/2866] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:25 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:25.489828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:25.500986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:25.504089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:25.519669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6530ba60-3e1d-467c-a623-6330b69d491b tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.234884 Oct 19 00:57:25.533196 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1388/2867] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:25 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:25.861858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:25.867396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:25.882089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.889119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.889912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:25.890867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:25.891531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:25.892178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:26.281526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.294544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.298732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.304511 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a45c23b0-2148-4f76-b60f-cac228e2a3bf tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.472587 Oct 19 00:57:26.306704 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1480/2868] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:25 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:26.478766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:26.479468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:26.502927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:26.506906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:26.507769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:26.513585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:26.514600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:26.515220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:26.543549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c HTTP/1.1 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: exception: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'caf12d9e-0820-459a-8ee5-ece31d9c538c'} Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:26.545582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 00:57:26.552261 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:26.554364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:26.554653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:26.555453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:26.556601 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4462f29a-2ad2-4530-8a84-04e60a586668 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 404 len: 111 microversion: 2.1 time: 0.082366 Oct 19 00:57:26.560694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1389/2869] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:26 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:26.569267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9de1ca0b-be85-4e47-bdea-f725c3500add tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '.version_select at 0x7f2af46c8dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:26.573748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:26.577124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:26.578880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:26.581384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:26.584670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:26.585288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:26.619587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9de1ca0b-be85-4e47-bdea-f725c3500add tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-2139012885" status: 202 len: 0 microversion: 2.1 time: 0.054289 Oct 19 00:57:26.623725 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1390/2870] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 00:57:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2139012885 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 00:57:26.789487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-998072785", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:26.870919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:57:26.931278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.943935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.952007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:26.957833 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60c24fd2-7d95-49bd-9e4e-26b4e0e95e66 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.407213 Oct 19 00:57:26.964660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1481/2871] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:26 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:27.334848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:27.335540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:27.352472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:27.352824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:27.353449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:27.355153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:27.356559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:27.357247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.141528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.153957 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:28.164292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.168835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.182819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b7b929f-ba44-48f7-b763-4d4a6dc1de06 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.851758 Oct 19 00:57:28.208387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1482/2872] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:27 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:28.216977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:28.217864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:28.225366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:28.226155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:28.228487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.231361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:28.232747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:28.233927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.597911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.599231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:28.599668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:28.600130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:28.602114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:28.604409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:28.636104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.644316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:28.644769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:28.645224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.646166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:28.655626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:28.658005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:28.660182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.665015 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e42c0115-b66f-45f2-9c9e-0c4cd364e585 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.455162 Oct 19 00:57:28.670413 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1483/2873] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:28 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:28.689325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f63016-2991-42ac-ab59-6bd7d23f72c1", "name": "network-vif-plugged", "status": "completed", "tag": "344c96ef-efa2-4bc9-9001-6b1b8d0730c9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:28.722091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:28.722598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:28.723077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:28.730230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:57:28.740738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:57:28.756044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] Creating event network-vif-plugged:344c96ef-efa2-4bc9-9001-6b1b8d0730c9 for instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 on n-h1-master-1 Oct 19 00:57:28.762627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:57:28.765884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2870b288-1d66-4adb-9b9f-131f71d43f2b req-875d3bca-588b-4ff1-9cff-f7ff4e5aff0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093626 Oct 19 00:57:28.767792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:28.770214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1484/2874] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:28.915231 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7b59298a-8d2b-4533-801d-010c3c508120 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.130124 Oct 19 00:57:28.925790 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1391/2875] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:57:28.939106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14048887-a81b-413e-9768-83be02a26daf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:28.940149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14048887-a81b-413e-9768-83be02a26daf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:29.131692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-14048887-a81b-413e-9768-83be02a26daf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.141461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14048887-a81b-413e-9768-83be02a26daf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1208 microversion: 2.1 time: 0.207381 Oct 19 00:57:29.163479 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1485/2876] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:28 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1208 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:29.216020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:29.216800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:29.228542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:29.229135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:29.229582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:29.230815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:29.231899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:29.244701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:29.703338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:29.704590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:29.719069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.726748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:29.726748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:29.726748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:29.726748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:29.726748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:29.727974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:29.728752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.735346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.742213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12e0569a-95ac-49a0-a92d-cb80d0451674 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.530181 Oct 19 00:57:29.744405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1392/2877] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:29 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:29.899717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.922593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.932395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:29.953543 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8280b959-48cc-4b9b-8408-7478c3b62b49 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.256461 Oct 19 00:57:29.955216 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1486/2878] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:29 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:30.171092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:30.171705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:30.184428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:30.185065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:30.185511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:30.186228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:30.186685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:30.189058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:30.762944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:30.770996 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ca9dc2c-86a5-4fe4-80d2-e0841aaa9b5f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1212 microversion: 2.1 time: 0.604192 Oct 19 00:57:30.774634 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1393/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:30 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1212 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:30.776669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:30.777983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:30.794218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:30.795146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:30.795807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:30.797612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:30.799242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:30.801128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:30.987680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:30.988316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:31.003331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:31.003842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:31.004293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:31.005038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:31.005684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:31.006294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:31.177302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.188223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.192806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.205167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8083d8c-cec7-4c61-86b2-920ad5390cfd tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1447 microversion: 2.75 time: 0.221328 Oct 19 00:57:31.208372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1394/2880] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:30 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:31.239916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.249960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.257064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:31.258306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf008961-14ab-4536-a0d6-54fa6c50053f tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1361 microversion: 2.26 time: 0.487533 Oct 19 00:57:31.258895 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1487/2881] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:30 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:31.795986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:31.797499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:31.813522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:31.815155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:31.816867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:31.819197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:31.820189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:31.822168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:32.067342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1768869174", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "1df3a97b-dee3-43e3-875a-885f3179739c"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:32.092326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:32.107414 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4dc832e2-9f09-4985-97c2-5e47df0d0955 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1278 microversion: 2.1 time: 0.315794 Oct 19 00:57:32.108679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1488/2882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:31 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1278 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:32.190424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] validate_networks() for [('1df3a97b-dee3-43e3-875a-885f3179739c', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:57:32.237803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:32.238446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:32.250510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:32.251890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:32.252605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:32.255059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:32.255782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:32.256486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:32.464047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:32.491249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:32.499987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:32.523592 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ac48d71-4609-4978-a8bd-e3dfc9c1d768 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1453 microversion: 2.75 time: 0.288883 Oct 19 00:57:32.525733 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1489/2883] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:32 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:32.545940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:32.547598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:32.565178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:32.565982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:32.566771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:32.567725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:32.568430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:32.569753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.478333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:33.498022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:33.499701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:33.500955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c07f5f99-91eb-4348-b313-eb55681e548a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1545 microversion: 2.26 time: 0.973523 Oct 19 00:57:33.501531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1490/2884] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:32 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1545 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:33.506237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:33.517528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:33.523991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.524780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.525384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.526270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.526902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.528113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.726639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:33.742380 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5537404-b9e8-4599-bf28-7b75788c0718 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1266 microversion: 2.1 time: 0.239602 Oct 19 00:57:33.744160 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1491/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:33 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:33.749510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af93305e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:33.778865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.779377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.779829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.780327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:33.790013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.790623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.791255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.793701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.794083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.794531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.897878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.898482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.898997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.939203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:33.939704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:33.940152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:33.995137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:34.023900 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a585ffd-abf4-436f-97f9-b43932c157fd tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-228636493" status: 201 len: 0 microversion: 2.26 time: 0.278318 Oct 19 00:57:34.037322 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1492/2886] 10.222.0.27 () {62 vars in 1377 bytes} [Wed Oct 19 00:57:33 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-228636493 => generated 0 bytes in 287 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 19 00:57:34.041555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.042302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:34.067070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.067070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.068740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.071559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.072237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.072810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.221835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:34.237565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:34.239952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:34.254245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-30b491a6-fc6f-40f9-89f9-3ef9fc519c04 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1453 microversion: 2.75 time: 0.220750 Oct 19 00:57:34.254851 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1493/2887] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:34.266458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8589250b-f14d-4863-b6cd-924972763042 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4d9b310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.295059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8589250b-f14d-4863-b6cd-924972763042 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.310043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8589250b-f14d-4863-b6cd-924972763042 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.310878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8589250b-f14d-4863-b6cd-924972763042 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.318589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:34.319109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:34.320082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:34.320803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:34.321636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:34.342356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.343365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.344014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.344978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.346073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8589250b-f14d-4863-b6cd-924972763042 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-228636493" status: 204 len: 0 microversion: 2.26 time: 0.087420 Oct 19 00:57:34.346996 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1494/2888] 10.222.0.27 () {60 vars in 1358 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-228636493 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:57:34.347712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.348324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.358005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4596af0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.376707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Getting quotas for project f1c3d8147eb24a4ab1aa72a7b973dd51. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:57:34.384906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Getting quotas for user 2951a7c54a114bc5a778e0b3ff2e8f1e and project f1c3d8147eb24a4ab1aa72a7b973dd51. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:57:34.393050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.393866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.395577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.396902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:34.404969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Going to run 2 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:57:34.416997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.419531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.420098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.423864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.424405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.424882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.427924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:34.483577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=e40e5c8b-c715-4703-bfe5-53e78653e9c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:34.494409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.495037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.495896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.557203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:34.594458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6207eb2-fd10-4dad-b6a5-285f967c6c0c tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.241412 Oct 19 00:57:34.598616 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5763cef-31df-459f-a90a-119e323e3b8f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.953863 Oct 19 00:57:34.599985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1395/2889] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:57:34.607737 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1495/2890] 10.222.0.27 () {60 vars in 1295 bytes} [Wed Oct 19 00:57:34 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 00:57:34.627320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e780ca4-784d-4b91-993f-a5aa1653b575 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4596700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.631454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.648109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e780ca4-784d-4b91-993f-a5aa1653b575 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.648848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e780ca4-784d-4b91-993f-a5aa1653b575 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.649470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4e780ca4-784d-4b91-993f-a5aa1653b575 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.667396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:34.669091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Searching by: {'deleted': False, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:57:34.681713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e780ca4-784d-4b91-993f-a5aa1653b575 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.065645 Oct 19 00:57:34.694032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1496/2891] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 12 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:34.720324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4d9bc10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.748909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.749875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.750494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.751948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:34.773768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.774941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.775541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.777805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.778956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.781009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.781574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.782204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.782603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.782965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.783430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.783866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.854826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f30d046b-be1d-49ab-80f2-eb6155a92997 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.240498 Oct 19 00:57:34.862244 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1396/2892] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers => generated 677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:34.872990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:34.873658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:34.895794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.896383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.898308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.899030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.899809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.900294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.900766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.905478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.907302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.923439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:34.924256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:34.925305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:34.967289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:34.996711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-774d1e22-0005-406c-a171-76180137d049 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1412756603" status: 201 len: 0 microversion: 2.26 time: 0.291338 Oct 19 00:57:34.997853 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1497/2893] 10.222.0.27 () {62 vars in 1380 bytes} [Wed Oct 19 00:57:34 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1412756603 => generated 0 bytes in 293 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 00:57:35.012186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ba8efaf-f2ef-4989-89a6-8b126bf0d36d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.017465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ba8efaf-f2ef-4989-89a6-8b126bf0d36d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:35.179573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ba8efaf-f2ef-4989-89a6-8b126bf0d36d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:35.194980 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ba8efaf-f2ef-4989-89a6-8b126bf0d36d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1220 microversion: 2.1 time: 0.192163 Oct 19 00:57:35.215850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1498/2894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1220 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:35.227468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57f0ed72-b1be-419d-a697-d7694f19cc75 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4efe8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.239508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57f0ed72-b1be-419d-a697-d7694f19cc75 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.240591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57f0ed72-b1be-419d-a697-d7694f19cc75 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.241264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57f0ed72-b1be-419d-a697-d7694f19cc75 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.255607 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:35.258692 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57f0ed72-b1be-419d-a697-d7694f19cc75 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 36 microversion: 2.26 time: 0.038787 Oct 19 00:57:35.259925 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1499/2895] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:57:35 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 36 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:35.273059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4efe700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.302840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.305883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.306676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.309384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:35.322870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.323708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.324911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.326012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.326658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.327814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.372254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.372780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.373434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.436211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:35.479177 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-831b2a50-8158-4e33-a3cc-2a6dda0a9831 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1412756603" status: 204 len: 0 microversion: 2.26 time: 0.206737 Oct 19 00:57:35.480791 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1500/2896] 10.222.0.27 () {60 vars in 1364 bytes} [Wed Oct 19 00:57:35 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1412756603 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 00:57:35.485451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.486077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:35.526091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.528415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.532956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.537015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.540780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.541567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.700842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:35.721030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a184fdd-3717-4e56-85d4-a64282b01ea1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.855989 Oct 19 00:57:35.721838 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1397/2897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:34 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:35.764668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0be52f8-0e68-45ca-b69f-52f937c43931 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af46d89d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.775458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0be52f8-0e68-45ca-b69f-52f937c43931 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.775972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0be52f8-0e68-45ca-b69f-52f937c43931 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.776410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0be52f8-0e68-45ca-b69f-52f937c43931 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.801841 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0be52f8-0e68-45ca-b69f-52f937c43931 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.044516 Oct 19 00:57:35.802783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1398/2898] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:57:35 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 12 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:35.815828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:35.817710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af46d8280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:35.819883 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:35.839214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.840289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.840774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.841270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:35.841456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:35.847720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:35.859874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.860386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.871804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.874629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.875547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.876770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.881138 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e2228731-a3ec-47f0-983b-e480b1dc397f tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1438 microversion: 2.75 time: 0.396159 Oct 19 00:57:35.893996 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1501/2899] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:35 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1438 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:35.955987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:35.960748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:35.965920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:35.992643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:36.037414 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3dbc0259-6c54-4803-b06b-b322cc228aea tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.227678 Oct 19 00:57:36.043406 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1399/2900] 10.222.0.27 () {60 vars in 1295 bytes} [Wed Oct 19 00:57:35 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:57:36.068507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af486ae50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:36.116585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.117114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.117555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.120971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:36.131654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.132493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.133493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.134380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.135151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.135969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.141850 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:36.184267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.185169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.185940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.202517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.203739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.204390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.291818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:36.349943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01f73eaf-ab63-4ad1-90d3-950740661440 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1003721541" status: 201 len: 0 microversion: 2.26 time: 0.297161 Oct 19 00:57:36.353068 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1400/2901] 10.222.0.27 () {62 vars in 1380 bytes} [Wed Oct 19 00:57:36 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-1003721541 => generated 0 bytes in 305 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 00:57:36.364762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:36.366597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:36.393544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.395356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.396500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.399157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.401664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.403110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.431450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:36.435542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:36.459314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.459832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.467764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.468655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.469158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.469598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.652404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:36.653397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:36.654524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:36.655173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:36.655857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:36.750858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:36.770194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d57eeb7f-d8e5-4f14-82d7-502332b3c18e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1224 microversion: 2.1 time: 0.414230 Oct 19 00:57:36.770806 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1401/2902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:36 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1224 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:36.775909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af46d8790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:36.828083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.828601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.829077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.829582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:36.842154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:36.847304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.847752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.848055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.848810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.849277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.849710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.857004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.857510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.857952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.866083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.866779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.867302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.919367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.919876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.920325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:36.965008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:36.967787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:36.970158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.018053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:37.067326 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b36b93e-2a16-4b59-bd8c-c60792b56151 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-450575014" status: 201 len: 0 microversion: 2.26 time: 0.292376 Oct 19 00:57:37.073458 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1402/2903] 10.222.0.27 () {62 vars in 1377 bytes} [Wed Oct 19 00:57:36 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-450575014 => generated 0 bytes in 301 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 19 00:57:37.091337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:37.093531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:37.106626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.107429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.108106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.109248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.110011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.111052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.469202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:37.547540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63d098cb-894e-452c-9bc1-e0b70cb10822 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95/action" status: 202 len: 1942 microversion: 2.75 time: 1.623731 Oct 19 00:57:37.548772 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1502/2904] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:57:35 2022] POST /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95/action => generated 1942 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 19 00:57:37.563217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af59d25e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:37.592520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.593926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.599074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.599689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:37.612587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.613551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.614448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.624921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.627322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.630888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.665787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:37.677290 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9bff20be-bb10-4bf6-95d6-8ee22855a80e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.600358 Oct 19 00:57:37.678748 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1403/2905] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:37 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:37.685499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:37.686633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:37.696263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.697140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.697365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.697516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.697920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.698367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.700286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.700417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.701109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.718314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:37.741382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1c527d9d-8c87-46d5-86bd-f0988e511b95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.191225 Oct 19 00:57:37.742540 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1503/2906] 10.222.0.27 () {60 vars in 1295 bytes} [Wed Oct 19 00:57:37 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:57:37.754980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a1c77bf-9932-4c93-a73f-9312858dbba1 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4d91550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:37.765591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a1c77bf-9932-4c93-a73f-9312858dbba1 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.766348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a1c77bf-9932-4c93-a73f-9312858dbba1 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.766963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a1c77bf-9932-4c93-a73f-9312858dbba1 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.781683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a1c77bf-9932-4c93-a73f-9312858dbba1 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 12 microversion: 2.26 time: 0.031996 Oct 19 00:57:37.798385 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1504/2907] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:57:37 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:37.811798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:37.812985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:37.822364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.823055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.823772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:37.825554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:37.826160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:37.826653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.173711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:38.194215 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3e11cd3-07c9-4b1d-945b-4186cbf5d424 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.513548 Oct 19 00:57:38.205246 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1404/2908] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:37 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:38.219795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6f1035-007d-47b4-97a6-b29083848983", "tag": "66bad360-9353-4648-89f7-7efd88344cf7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:38.238550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.238987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.239431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.245363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:38.253466 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] Creating event network-changed:66bad360-9353-4648-89f7-7efd88344cf7 for instance 2e6f1035-007d-47b4-97a6-b29083848983 on n-h1-master-1 Oct 19 00:57:38.254547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42df93a4-31a5-4c9d-a7fd-618e53df6363 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1280 microversion: 2.1 time: 0.452591 Oct 19 00:57:38.260398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1505/2909] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:37 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1280 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:38.273132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4d9b1f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:38.278697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-33ca9b50-1e85-4404-ba74-458e816a9ecf req-0bf5ff38-ed36-4600-8dbd-587017401135 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069049 Oct 19 00:57:38.281597 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1405/2910] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:38.294651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.295372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.295978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.296878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:38.305415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.306371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.306978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.308181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.308986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.309593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.344069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.344852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.345453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.360962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:38.383953 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b1ffb34-0d27-4a42-b992-e44ca241a91a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.121337 Oct 19 00:57:38.384883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1506/2911] 10.222.0.27 () {60 vars in 1295 bytes} [Wed Oct 19 00:57:38 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:57:38.396344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af465b430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:38.408262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.409065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.409657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.410686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:38.417036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.418397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.419370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.420249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.421095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.421686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.458064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.458759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.459364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.471991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.472922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.473521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.506061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:38.525380 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5a9d94c6-9f1e-4cb5-ab19-769e288f0945 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-652108874" status: 201 len: 0 microversion: 2.26 time: 0.133452 Oct 19 00:57:38.528796 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1406/2912] 10.222.0.27 () {62 vars in 1377 bytes} [Wed Oct 19 00:57:38 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-652108874 => generated 0 bytes in 138 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 19 00:57:38.539128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af50ca5e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:38.545623 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:38.554782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.556184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.556940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.560207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:38.571719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.572585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.573568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.576264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.577519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.578373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.634492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.636928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.638241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.665076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.667852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.668966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.703895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:38.704398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:38.720587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.721573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.723305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.725034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.726100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.727228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.753244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:38.801934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37738c5e-6162-4570-95e7-5cc045c90127 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-2074282924" status: 201 len: 0 microversion: 2.26 time: 0.265609 Oct 19 00:57:38.804379 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1507/2913] 10.222.0.27 () {62 vars in 1380 bytes} [Wed Oct 19 00:57:38 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags/tempest-tag-2074282924 => generated 0 bytes in 270 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 19 00:57:38.833724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Action: 'update_all', calling method: .version_select at 0x7f2af50fa1f0>, body: {"tags": ["tempest-tag-659401453", "tempest-tag-674493631"]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:38.859138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.860489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.862432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.864222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:38.878120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.879533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.883781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.885578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.887193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.888456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.941890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:38.943231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:38.944100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:38.972994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:38.994610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3249ce33-cc33-4154-9826-87a699a3a917 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 60 microversion: 2.26 time: 0.181569 Oct 19 00:57:39.014642 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1508/2914] 10.222.0.27 () {62 vars in 1312 bytes} [Wed Oct 19 00:57:38 2022] PUT /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 60 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:39.036021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b4d3927-9e1e-432a-8d8b-2af66ce28680 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af4efea60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.058713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b4d3927-9e1e-432a-8d8b-2af66ce28680 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.059220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b4d3927-9e1e-432a-8d8b-2af66ce28680 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.059668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b4d3927-9e1e-432a-8d8b-2af66ce28680 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.062871 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=4,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:39.082631 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b4d3927-9e1e-432a-8d8b-2af66ce28680 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 200 len: 60 microversion: 2.26 time: 0.064292 Oct 19 00:57:39.088605 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1509/2915] 10.222.0.27 () {60 vars in 1292 bytes} [Wed Oct 19 00:57:39 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 60 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:39.099546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '.version_select at 0x7f2af50cae50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.121582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.122217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.122594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.123085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:39.135283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.135832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.136762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.140546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.143383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.143901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.194599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.195255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.195616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.198429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:39.216064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66343fa1-b563-4a53-8fd1-aee12e67fd1d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.515115 Oct 19 00:57:39.218352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1407/2916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:38 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:39.222584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'flavor' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:39.239534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.240390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:39.253233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.254041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.254666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.254929 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-99c6908d-2d0c-4fa6-af01-2463f6875f02 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags" status: 204 len: 0 microversion: 2.26 time: 0.159780 Oct 19 00:57:39.255772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.256407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.262513 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1510/2917] 10.222.0.27 () {60 vars in 1295 bytes} [Wed Oct 19 00:57:39 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:57:39.264802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.270946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.270946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:39.284870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.285474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.285809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.286533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.286997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.287431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.349416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:57:39.374872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:39.401175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3fe2ed4a-74f9-42bf-9a85-75d585c8384f tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.166195 Oct 19 00:57:39.402630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1408/2918] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:39 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:39.407663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.408587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:39.414848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.415642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.416427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.417475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.418862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.430321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.499230 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-392f9263-3913-4756-a3ff-9c9d1a9230a9 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 204 len: 0 microversion: 2.26 time: 0.235013 Oct 19 00:57:39.499959 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1511/2919] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:57:39 2022] DELETE /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 00:57:39.508704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:39.509434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:39.519982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.520553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.524465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.525284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:39.525780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:39.526233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:39.531279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:39.540693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c89ddbf6-c51d-4640-95ca-dff0830e60e3 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1278 microversion: 2.1 time: 0.135667 Oct 19 00:57:39.541324 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1409/2920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:39 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:39.715922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:39.726212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:39.727758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:39.729060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-445d889b-a1bd-420e-b43e-ecba3d54fa32 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1551 microversion: 2.26 time: 0.224744 Oct 19 00:57:39.729702 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1512/2921] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:39 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1551 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:40.242581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:40.243380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:40.259366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.262938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.263910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.266827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.267566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.268848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.437435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:40.439426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:40.448434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.451439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.452221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.453294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.453962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.454586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.630214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:40.674171 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07af4252-07e0-4f20-8a8b-8e6ce0fb4797 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.242291 Oct 19 00:57:40.676044 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1513/2922] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:40 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:40.690582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:40.696199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:40.712433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.713467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.714217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.715516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.716297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.716985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.871568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:40.885508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-979431cf-5a21-4003-9fe4-4c72ba1217df tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.648269 Oct 19 00:57:40.887018 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1410/2923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:40 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:40.896764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:40.906726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:40.922432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.923172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.923840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.925047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:40.925826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:40.926738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:40.997383 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:41.213128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.222520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-920f8327-c9ea-420d-b679-f56264294554 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 0.545359 Oct 19 00:57:41.226994 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1514/2924] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:40 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:41.305584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:41.317384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.319019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Searching by: {'deleted': False, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:57:41.332110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.333033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.333737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.335613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.336312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.337262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.376110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:57:41.410368 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-89246bf6-fe31-4a71-93ea-c10c56d0ae9f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.109262 Oct 19 00:57:41.419398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1515/2925] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:57:41 2022] GET /compute/v2.1/servers => generated 334 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:41.424637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:41.431425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.432209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Searching by: {'deleted': False, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:57:41.437774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.438424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.438666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.439396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.440036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.440464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.477431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:57:41.518222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.528689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.529756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.530633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.635081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.656124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.658211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:41.660165 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5a8c65b-7bfb-47af-a804-d7142f95e9d0 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1551 microversion: 2.26 time: 0.771955 Oct 19 00:57:41.661093 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1411/2926] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:40 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1551 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:41.711091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:41.711936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:41.721445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.722793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.724384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.725726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:41.726407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:41.727035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:41.938754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:41.998504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6708b106-be35-4f6e-af4e-9c7bb7ecc508 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.291945 Oct 19 00:57:41.999117 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1412/2927] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:41 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:57:42.015942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:42.017085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:42.027623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:42.028651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:42.029268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:42.030366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:42.031850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:42.033755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:42.213303 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17f13758-fd71-442c-adee-732da71db96e tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.792456 Oct 19 00:57:42.213917 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1516/2928] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:57:41 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:42.242975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c21b51b8-5a8e-4f47-a632-f0fa856c2fee tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:42.256658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c21b51b8-5a8e-4f47-a632-f0fa856c2fee tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017970 Oct 19 00:57:42.257860 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1517/2929] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:57:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:57:42.267038 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:42.268356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:42.280110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:42.280911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:42.281617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:42.282628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:42.283328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:42.284815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.416162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:43.426536 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-09d00c41-5a9b-4d50-8adf-05d82227c88b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 1.423640 Oct 19 00:57:43.429539 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1413/2930] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:42 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:43.436017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6f1035-007d-47b4-97a6-b29083848983", "name": "network-vif-plugged", "status": "completed", "tag": "66bad360-9353-4648-89f7-7efd88344cf7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:43.439381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:43.447351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d89d433-b4a0-4c81-8210-694b610dd5bf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 1.188101 Oct 19 00:57:43.447947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1518/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:42 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:43.449624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.450399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.451245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.460948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:43.467439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:43.479209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.480969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.482059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.483444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.486058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.486750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.490309 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] Creating event network-vif-plugged:66bad360-9353-4648-89f7-7efd88344cf7 for instance 2e6f1035-007d-47b4-97a6-b29083848983 on n-h1-master-1 Oct 19 00:57:43.501641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-353c7605-174b-4c55-8d5c-c315bd34200d req-1102d8f3-566f-4ad5-8b5b-f7b2b592d383 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069956 Oct 19 00:57:43.507793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1414/2932] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:43.522940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:57:43.526973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:43.538416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:43.550421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.580659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.585561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.615847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.617133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.617820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.683688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.684190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.684646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.685100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'fault' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:43.693657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e63e8d54-7783-4f59-af2f-858cdecf5aef tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 204 len: 0 microversion: 2.1 time: 0.244299 Oct 19 00:57:43.694514 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1519/2933] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:57:43 2022] DELETE /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:57:43.701181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de954e0-5c13-4382-b09a-be3cfff62400", "tag": "a10f4717-2a20-44b3-8293-8e5361dcee72"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:43.713052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.713538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.713975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.731050 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] Creating event network-changed:a10f4717-2a20-44b3-8293-8e5361dcee72 for instance 2de954e0-5c13-4382-b09a-be3cfff62400 on n-h1-master-1 Oct 19 00:57:43.739187 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-304e9abc-fa11-4332-b62b-e668739f5b5c req-83495c77-b194-4912-8b85-6b12410d845b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042986 Oct 19 00:57:43.740105 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1520/2934] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:43.748280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:43.749252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:43.756219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.756776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.757401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.758625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.759247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.759959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.864996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:43.875709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:43.878297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:43.879615 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb037893-9740-4ae2-95be-4ea3e8a1f85a tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1351 microversion: 2.26 time: 0.357720 Oct 19 00:57:43.880252 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1415/2935] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:43 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1351 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:43.885846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:43.886722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:43.892771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.894443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.895233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.896183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:43.896884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:43.897534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:43.963829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:43.982438 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28c57879-60ca-46d0-881c-92739cc91103 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.240260 Oct 19 00:57:43.983514 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1521/2936] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:43 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:44.398675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:44.403453 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:44.411905 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-645c949a-5bbb-472b-bec8-15521bb33574 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1700 microversion: 2.1 time: 0.530379 Oct 19 00:57:44.413061 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1416/2937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:43 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1700 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:44.451887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:44.452448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:44.460856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.461552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.462179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.462899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.463655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.464088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.488098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:44.488832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:44.495461 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:44.503623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.504167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.504660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.506600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.508317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.508835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.806972 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:44.897744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:44.907697 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b419bbe1-0ba9-4836-b198-1771af9b0e6e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.460145 Oct 19 00:57:44.911897 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1522/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:44 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:44.920164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:44.920832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:44.945383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.947369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.949132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.951481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:44.953005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:44.955318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:44.964663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:44.994768 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6183e4fd-f7f6-4b0b-b6bb-da1ac0b1e82d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 0.518104 Oct 19 00:57:44.998917 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1417/2939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:44 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:45.019676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:45.024877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:45.047412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.053268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.053891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.056074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.056630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.057085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.057228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.057599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lazy-loading 'fault' on Instance uuid f7f63016-2991-42ac-ab59-6bd7d23f72c1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:45.061581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.066177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.145650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:45.163768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:45.165185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '37c7f5d1bc3a431eacef3cf113e958d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7da1bd05d0434eb09dc23bf327d9f1c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:45.171117 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9d0e5dc-1d8e-42e9-8af9-b1d7f411b817 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 200 len: 1351 microversion: 2.26 time: 0.253503 Oct 19 00:57:45.172182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1523/2940] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:44 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 1351 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:45.312022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:45.361347 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e33e2b2-620e-469d-a5c1-24148f4fbcde tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.353908 Oct 19 00:57:45.362291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1418/2941] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:45 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:45.437780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:45.438417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:45.453776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.454491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.454840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.455610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.456114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.456726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.499213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e40e5c8b-c715-4703-bfe5-53e78653e9c1", "tag": "d7836c2a-6728-491d-aafa-1098ed635cb1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:45.533640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.534168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.537412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.581170 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] Creating event network-changed:d7836c2a-6728-491d-aafa-1098ed635cb1 for instance e40e5c8b-c715-4703-bfe5-53e78653e9c1 on n-h2-master-1 Oct 19 00:57:45.597223 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a489d9df-573e-4a15-a72b-c5d9225db948 req-85a2f53a-3edc-4b96-b925-13f7c21655e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102823 Oct 19 00:57:45.599047 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1419/2942] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:45.787688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f63016-2991-42ac-ab59-6bd7d23f72c1", "name": "network-vif-deleted", "tag": "344c96ef-efa2-4bc9-9001-6b1b8d0730c9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:45.819798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.820553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.821847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.857376 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] Creating event network-vif-deleted:344c96ef-efa2-4bc9-9001-6b1b8d0730c9 for instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 on n-h1-master-1 Oct 19 00:57:45.878917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-65b829f9-c9a5-4cc3-8872-dc38a54d7c43 req-090c2933-3d5d-4407-bfc6-d786c9f0ee3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095184 Oct 19 00:57:45.880166 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1420/2943] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:45.937161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:45.940403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:45.956298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.956834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.957287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.958590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:45.959579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:45.960936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:45.978552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:45.997838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-334240e7-2be2-4aef-9737-4a878392b373 tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1700 microversion: 2.1 time: 0.564465 Oct 19 00:57:45.999156 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1524/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:45 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1700 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:46.035315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:46.038479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:46.054648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.061669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.062958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.066139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.077224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.077813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.476863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:46.485614 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ed23616-3feb-4aa0-93f1-c3bd84761555 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1308 microversion: 2.1 time: 0.554063 Oct 19 00:57:46.486678 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1421/2945] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:45 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:46.503020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:46.504767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] [instance: f7f63016-2991-42ac-ab59-6bd7d23f72c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:46.519962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.521479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.523997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.527572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.528001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:46.530935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.533583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.542181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8f96439c-ef7c-477c-9451-4d97f91ecaaf tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 0.519514 Oct 19 00:57:46.543093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1525/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:46 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:46.555865 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] HTTP exception thrown: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Request method failure captured: Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 HTTP/1.1 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0tjh9P-Va-AYa1SFUEdW_AozmiwKneq6ZUzrteBSzYQaRRt9gLz9qtG_GZ5VH_x2Xtxk2EmfnNDS9YHr7h_O3HSwCEtu0P_1MT3tfEgPNDOrSOvH_Z7XyjaA8OkXQ8CDJu-Pzp384RhfwS4VIL7Lb8usUNWqq9nXoy6XyBGauQeQbU Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.26 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7da1bd05d0434eb09dc23bf327d9f1c1 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerTagsTestJSON-429799972 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7da1bd05d0434eb09dc23bf327d9f1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7da1bd05d0434eb09dc23bf327d9f1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7da1bd05d0434eb09dc23bf327d9f1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7da1bd05d0434eb09dc23bf327d9f1c1"}]}] Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerTagsTestJSON-429799972 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7da1bd05d0434eb09dc23bf327d9f1c1 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerTagsTestJSON-429799972 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerTagsTestJSON-429799972-project Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 37c7f5d1bc3a431eacef3cf113e958d7 Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerTagsTestJSON-429799972-project Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: exception: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f7f63016-2991-42ac-ab59-6bd7d23f72c1'} Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:46.561038 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. Oct 19 00:57:46.568662 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:57:46.574868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:46.575690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:46.579819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] Returning 404 to user: Instance f7f63016-2991-42ac-ab59-6bd7d23f72c1 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:46.581689 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd0f7464-910a-415f-8a91-4e8bd12f9a95 tempest-ServerTagsTestJSON-429799972 tempest-ServerTagsTestJSON-429799972-project] 10.222.0.27 "GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1" status: 404 len: 111 microversion: 2.26 time: 0.088029 Oct 19 00:57:46.582765 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1422/2947] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:46 2022] GET /compute/v2.1/servers/f7f63016-2991-42ac-ab59-6bd7d23f72c1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:57:46.594850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.595434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.595912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.596781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:46.600246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:46.601136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:46.824221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:46.863635 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04bf8ba9-c7fb-484d-b476-99627289723c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.303020 Oct 19 00:57:46.864403 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1526/2948] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:46 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:47.025507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:47.027827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:47.043953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.048227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.049036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:47.062779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.063975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.068674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:47.349766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:47.366649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d80697d-8c14-4565-94e1-01d5adbfb78c tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1633 microversion: 2.1 time: 0.346046 Oct 19 00:57:47.369084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1423/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:47 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1633 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:47.516402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:47.517484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:47.536833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.538386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.539052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:47.540406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.541383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.542131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:47.572109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:47.572989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:47.598732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.599675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.600810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:47.602312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:47.606433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:47.607419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.066141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:49.081359 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7611d08a-2dba-4a38-b129-e60f4d887574 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 1.514042 Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1424/2950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:47 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.098424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.168579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:49.181631 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a4bb59a-7a4a-4f5e-a51b-e2bb80c13b3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1489 microversion: 2.1 time: 1.671293 Oct 19 00:57:49.190721 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1527/2951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:47 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1489 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:49.240539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:49.252515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:49.282119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.282968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.286062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.286961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.290497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.292932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.315914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:49.359873 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76dd773f-634a-4b07-9240-24e734c46bc1 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.276824 Oct 19 00:57:49.360797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1425/2952] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:49 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:49.374533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b", "name": "network-vif-deleted", "tag": "d6a29617-b83c-484d-bceb-1dfbbf4367da"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:49.385229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.386101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.387077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.387751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lazy-loading 'fault' on Instance uuid eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:49.410945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.415011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.415769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.434539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] Creating event network-vif-deleted:d6a29617-b83c-484d-bceb-1dfbbf4367da for instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b on n-h2-master-1 Oct 19 00:57:49.453174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0213a3fb-125f-4ab0-814f-fb4b4e8a0e36 req-616195d0-24d0-4c94-96cd-2ab87a538591 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090867 Oct 19 00:57:49.455836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1426/2953] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:49.463781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de954e0-5c13-4382-b09a-be3cfff62400", "name": "network-vif-plugged", "status": "completed", "tag": "a10f4717-2a20-44b3-8293-8e5361dcee72"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:49.486722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:49.490918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:49.491630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:49.515266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] Creating event network-vif-plugged:a10f4717-2a20-44b3-8293-8e5361dcee72 for instance 2de954e0-5c13-4382-b09a-be3cfff62400 on n-h1-master-1 Oct 19 00:57:49.526045 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ccffb394-c05b-46c8-b321-00e7c0da9b67 req-6c99c1f8-7106-4b18-a55b-32d080606d73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068434 Oct 19 00:57:49.531342 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1427/2954] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:57:49.544217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-998072785", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:49.642602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:57:49.778944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c91ca45a0a4b3c9499a85bde9e8bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01f3f08dd5ca42488a2c22e7f1ebf71f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:49.794484 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e136f49-55d9-401f-ae87-4d8dbd98597f tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 200 len: 1359 microversion: 2.1 time: 0.602257 Oct 19 00:57:49.801693 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1528/2955] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:49 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 1359 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:50.106045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:50.106910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:50.122539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:50.123324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:50.124008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:50.125020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:50.125713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:50.127163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:50.828536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:50.839027 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b972acec-f2d6-4e22-b2d1-3a5e7b19fc82 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 0.737485 Oct 19 00:57:50.841046 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1529/2956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:50 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:50.851582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:50.852898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:50.867400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:50.870758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:50.871630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:50.872791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:50.873501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:50.874318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.125909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:51.182696 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ff87a66-d198-4c6f-b95f-9e0b1ac875b3 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.321835 Oct 19 00:57:51.201896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1530/2957] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:50 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:51.211936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:51.213297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] [instance: eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:51.224675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.226017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.226844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.228588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.231695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.233757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.258896 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] HTTP exception thrown: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Request method failure captured: Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b HTTP/1.1 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tBCBDo3eIYv7rctkyFog6_zfEutKmlmQSyKh0IiuSUATgUdnabW8hPSXj-QaJCZ_CmuVjDcfIY52Wxa2GY9IgT43GaztN11cB6NrE4gmOxka9pJ8uhl-b6L45v3yMLpRLbAhGafCVH-_2FxT6XULMZKzeYwzgrblcfkkzEi54mXtQ Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 01f3f08dd5ca42488a2c22e7f1ebf71f Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-890947441 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_01f3f08dd5ca42488a2c22e7f1ebf71f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01f3f08dd5ca42488a2c22e7f1ebf71f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/01f3f08dd5ca42488a2c22e7f1ebf71f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/01f3f08dd5ca42488a2c22e7f1ebf71f"}]}] Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-890947441 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 01f3f08dd5ca42488a2c22e7f1ebf71f Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-890947441 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-890947441-project Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 73c91ca45a0a4b3c9499a85bde9e8bb1 Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-890947441-project Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: exception: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b'} Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:51.263744 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Returning 404 to user: Instance eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:57:51.269114 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cdecfe11-adc5-42d4-9277-3b021064f32b tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b" status: 404 len: 111 microversion: 2.1 time: 0.064148 Oct 19 00:57:51.271293 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1531/2958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:51 2022] GET /compute/v2.1/servers/eca9b4cd-08c0-484c-bc27-e4bb6d39ba2b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:57:51.282304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65c5cb85-c25e-443e-8218-31b41354c7ff tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] Calling method '.version_select at 0x7f2af50fa040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:51.337654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65c5cb85-c25e-443e-8218-31b41354c7ff tempest-ServersTestJSON-890947441 tempest-ServersTestJSON-890947441-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-133366858" status: 202 len: 0 microversion: 2.1 time: 0.058275 Oct 19 00:57:51.340144 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1532/2959] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 00:57:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-133366858 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:57:51.810798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:57:51.811398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:57:51.811733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:57:51.812386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:57:51.813062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:57:51.834889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.837533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.838236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.841258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.842009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.844675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.881742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:51.883747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:51.902662 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:51.904579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:57:51.907393 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:51.916888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:57:51.925833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.928398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.929274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.938124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:51.940236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:51.941078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:51.950004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:57:51.957338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:57:52.123769 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50a02834-b36a-4eb2-9ebf-063b2b88b362 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.590862 Oct 19 00:57:52.138417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1428/2960] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:57:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:57:52.154985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbc6bb7b-6385-4539-bdf4-4b7300379534 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:52.155624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbc6bb7b-6385-4539-bdf4-4b7300379534 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:52.276406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbc6bb7b-6385-4539-bdf4-4b7300379534 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:52.284508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbc6bb7b-6385-4539-bdf4-4b7300379534 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1208 microversion: 2.1 time: 0.144828 Oct 19 00:57:52.286154 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1429/2961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:52 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1208 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:52.317384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:52.318874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:52.343508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:52.344551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:52.345384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:52.346379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:52.348851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:52.349523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:52.568951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:52.578619 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9cebd15-ae41-47fd-94d8-df4041b086e1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1320 microversion: 2.1 time: 0.712525 Oct 19 00:57:52.592742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:52.594016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1533/2962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:51 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1320 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:52.614096 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:52.620070 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ad56ca1-af84-4465-88e6-6e3bea4b8936 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.323527 Oct 19 00:57:52.621960 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1430/2963] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:52 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:53.324848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:53.325879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:53.337870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.339905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.344545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:53.345852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.346672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.348225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:53.573236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:53.593706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7875cacb-e2e5-45c9-b4c2-ec4af654bf04 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1204 microversion: 2.1 time: 0.273900 Oct 19 00:57:53.597043 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1534/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:53 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1204 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:53.619338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:53.619967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:53.663342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:53.673828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.675769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:53.679402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.681086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:53.681928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.684257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.687991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:53.694470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.700080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.702665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:53.709804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:53.713395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:53.713855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:54.052951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:54.098847 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-351fbf3e-f859-4de8-b99a-34b0a455c79b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.438894 Oct 19 00:57:54.099472 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1535/2965] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:53 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:54.186884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40e5c8b-c715-4703-bfe5-53e78653e9c1", "name": "network-vif-plugged", "status": "completed", "tag": "d7836c2a-6728-491d-aafa-1098ed635cb1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:54.202921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:54.208688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:54.210872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:54.249117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:54.258159 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11161ceb-c950-499c-9ba8-5d4261bdd740 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 200 len: 1508 microversion: 2.1 time: 0.651339 Oct 19 00:57:54.266393 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1431/2966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:53 2022] GET /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 1508 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:54.273528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] Creating event network-vif-plugged:d7836c2a-6728-491d-aafa-1098ed635cb1 for instance e40e5c8b-c715-4703-bfe5-53e78653e9c1 on n-h2-master-1 Oct 19 00:57:54.287739 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f828eee6-f2c9-41c3-9de6-ba0d0802c2ba req-a6c8b477-a288-40df-af3a-1b4a46d5528f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104794 Oct 19 00:57:54.290963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1536/2967] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:57:54.294136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:54.294882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:54.309065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:54.312502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:54.318913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:54.321647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:54.322349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:54.324739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:54.351787 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:54.639961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:54.640973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:54.679726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:54.685806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:54.686272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:54.687046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:54.693342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:54.694130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:55.209239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:55.224505 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37f26a4f-3465-40b6-b6c0-7273e759dd43 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1" status: 200 len: 1320 microversion: 2.1 time: 0.935783 Oct 19 00:57:55.229906 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1432/2968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:54 2022] GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1 => generated 1320 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:55.277244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:55.291572 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-35254ac1-bee8-42b4-94d2-e85a3e643866 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1278 microversion: 2.1 time: 0.663414 Oct 19 00:57:55.305644 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1537/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:54 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1278 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:55.340584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:55.341702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:55.348645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:55.350569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:55.352652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:55.353610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:55.355585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:55.356201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:55.629222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12c3b459-97ba-4ec9-b7c4-3a7d6ffae193 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Action: 'create', calling method: .version_select at 0x7f2af46218b0>, body: {"pool": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:57:55.690847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:55.731392 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:55.737359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cfd3e6e4-3838-4663-951b-4cc02b3b1cd0 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.419892 Oct 19 00:57:55.738616 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1538/2970] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:55 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:56.254183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:56.254815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:56.268389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:56.275857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:56.276796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:56.277753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:56.278406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:56.279001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:56.322155 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:57:57.573979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:57.589625 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c5f9bda-d6c0-4b3a-9d50-c03e30307551 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1" status: 200 len: 1320 microversion: 2.1 time: 1.340836 Oct 19 00:57:57.590209 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1539/2971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:56 2022] GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1 => generated 1320 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:57:57.595020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:57.600972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:57.615618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:57.616535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:57.617213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:57.618138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:57.618767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:57.619379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:57.833325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:57.845252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4875e20f-759a-4052-9c05-0de2b284ec3d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1266 microversion: 2.1 time: 0.253741 Oct 19 00:57:57.845854 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1540/2972] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:57 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:57.850500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:57.851128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:57.862950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:57.863357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:57.863800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:57.864526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:57.865013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:57.865447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:58.596208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:57:58.638975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a94fed4d-c3e8-44a8-bf7a-86931a0f6f00 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.792025 Oct 19 00:57:58.643584 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1541/2973] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:57:57 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:57:58.662117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:58.662716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:58.674380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:58.674880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:58.675465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:58.676608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:58.677113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:58.677553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:59.706034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:57:59.723281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f102d41-3ed6-41a2-be3e-8ea6431202c1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1" status: 200 len: 1508 microversion: 2.1 time: 1.077731 Oct 19 00:57:59.724203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1542/2974] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:58 2022] GET /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1 => generated 1508 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:57:59.746020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:57:59.747047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:57:59.754587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:59.755391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:59.756059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:57:59.758150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:57:59.758887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:57:59.759551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:00.907998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:00.924660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b90d2119-069d-4dab-adcd-4076e9796fba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 1.198864 Oct 19 00:58:00.944291 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1543/2975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:57:59 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:00.957914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:00.963535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:00.972382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:00.973445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:00.974286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:00.975643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:00.976365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:00.977232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.200774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:01.226720 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b174dad6-8b37-45c9-85d9-0b84c383cecb tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.278761 Oct 19 00:58:01.227794 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1544/2976] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:00 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:01.235645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:01.236437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:01.253029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.254362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.255003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.257622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.258385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.259527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.329761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: e40e5c8b-c715-4703-bfe5-53e78653e9c1] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:01.520357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31543b11-7094-4036-9791-6aba1b703c57 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1" status: 204 len: 0 microversion: 2.1 time: 0.290556 Oct 19 00:58:01.524477 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1545/2977] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:01 2022] DELETE /compute/v2.1/servers/e40e5c8b-c715-4703-bfe5-53e78653e9c1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:01.532056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:01.535031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:01.559138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.559700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.560265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.562913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.563535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.564781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.625547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: 2de954e0-5c13-4382-b09a-be3cfff62400] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:01.836104 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58be1362-9b83-4633-92fe-9645b1d33580 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400" status: 204 len: 0 microversion: 2.1 time: 0.308887 Oct 19 00:58:01.837046 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1546/2978] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:01 2022] DELETE /compute/v2.1/servers/2de954e0-5c13-4382-b09a-be3cfff62400 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:01.877563 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:01.972298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:01.973997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:01.988408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.989129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.989822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:01.991619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:01.994240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:01.996816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:02.284570 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:02.855165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:02.863933 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1278bfab-3333-4e70-aa15-62589fdba200 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 0.896069 Oct 19 00:58:02.866672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1547/2979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:01 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:58:02.881643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-998354031", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "1df3a97b-dee3-43e3-875a-885f3179739c"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:03.003031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] validate_networks() for [('1df3a97b-dee3-43e3-875a-885f3179739c', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:03.908022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12c3b459-97ba-4ec9-b7c4-3a7d6ffae193 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.675684 Oct 19 00:58:03.920757 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1433/2980] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:57:55 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:03.926126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:03.926892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:03.939730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:03.941715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:03.943197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:03.945944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:03.946600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:03.947287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:04.398450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:04.448951 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-049a296a-40ac-4012-a17a-b3ce9666959b tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.525191 Oct 19 00:58:04.450202 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1434/2981] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:03 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:04.466260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:04.467247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:04.484484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:04.485963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:04.486520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:04.495316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:04.500454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:04.501268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:05.924688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:05.926023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:05.926523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:05.926946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:05.927368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:05.947274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:05.948417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:05.948949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:05.950968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:05.951457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:05.951900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:06.024491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Getting quotas for project f1c3d8147eb24a4ab1aa72a7b973dd51. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:06.032726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Getting quotas for user 2951a7c54a114bc5a778e0b3ff2e8f1e and project f1c3d8147eb24a4ab1aa72a7b973dd51. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:06.053677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Going to run 2 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:06.057075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:06.064437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:06.075065 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30932f09-f1ec-4d4f-8cd8-1e229d9dbb45 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 1.613576 Oct 19 00:58:06.077203 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1435/2982] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:04 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:06.103457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f5d69df-795c-4139-9918-8aa49392154d tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Action: 'create', calling method: .version_select at 0x7f2af45c0f70>, body: {"pool": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:06.181105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=f8a97666-b09b-47f3-be63-ea549fc514ce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:06.304042 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-794099b2-25b8-4081-8061-dbe50b99e8f1 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.426510 Oct 19 00:58:06.305695 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1548/2983] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 3429 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 19 00:58:06.313614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de954e0-5c13-4382-b09a-be3cfff62400", "name": "network-vif-deleted", "tag": "a10f4717-2a20-44b3-8293-8e5361dcee72"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:06.333113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:06.333948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:06.334590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:06.396599 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] Creating event network-vif-deleted:a10f4717-2a20-44b3-8293-8e5361dcee72 for instance 2de954e0-5c13-4382-b09a-be3cfff62400 on n-h1-master-1 Oct 19 00:58:06.406937 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-52fa9937-3f55-42de-879d-2a334a77f6ec req-f51c5dfa-f267-47ce-9c75-8b33fa42ba24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099479 Oct 19 00:58:06.408289 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1549/2984] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:06.423587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:06.424648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:06.439925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:06.440975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:06.441613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:06.442724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:06.443363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:06.444926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:06.974222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:06.994745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b9061e4-2ad5-4b78-9f8d-4eafda11c4bd tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.584889 Oct 19 00:58:06.995632 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1550/2985] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:06 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:07.280113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b27abca5-99b8-4892-9acb-14900c1bf950 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Calling method '.version_select at 0x7f2af58691f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:07.395019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b27abca5-99b8-4892-9acb-14900c1bf950 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796/defaults" status: 200 len: 371 microversion: 2.1 time: 0.397872 Oct 19 00:58:07.403997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1551/2986] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:58:06 2022] GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796/defaults => generated 371 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:07.409137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7bec6a-e56c-4f86-aea8-b3cac8a54f63", "tag": "a4f90c67-9b0f-4c7d-9ada-37d79fff344b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:07.419999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:07.420578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:07.421093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:07.435222 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] Creating event network-changed:a4f90c67-9b0f-4c7d-9ada-37d79fff344b for instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 on n-h1-master-1 Oct 19 00:58:07.439746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7cb116b9-b06a-4017-b763-241dd79be97b req-64a7d26a-f762-4d60-9983-2a79df787ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Oct 19 00:58:07.441307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1552/2987] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:07.450587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:07.455736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:07.456576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Searching by: {'deleted': False, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 00:58:07.470157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:07.470654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:07.471238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:07.471987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:07.472449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:07.472902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:07.541867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Listed batch of 3 results from cell out of 999 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 00:58:07.601710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80f7bf83-d7f6-4607-a6bd-1ba2b6abba26 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.158821 Oct 19 00:58:07.602860 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1553/2988] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:58:07 2022] GET /compute/v2.1/servers => generated 1003 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:07.616660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:07.619232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:07.630322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:07.631187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:07.631836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:07.636086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:07.636888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:07.638389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:07.685862 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:08.326648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:08.339541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cade69c6-9de0-4ca0-be2e-b628817cb9b0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 0.734737 Oct 19 00:58:08.357587 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1554/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:07 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:08.363938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5c7ecece-1a5a-4a0a-ba03-9e307fd1232e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Calling method '.version_select at 0x7f2af584d9d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:08.459998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5c7ecece-1a5a-4a0a-ba03-9e307fd1232e tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796" status: 200 len: 371 microversion: 2.1 time: 0.100919 Oct 19 00:58:08.472002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1555/2990] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:58:08 2022] GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796 => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:08.480673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:08.481859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:08.488165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:08.488960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:08.489577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:08.490298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:08.490763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:08.491201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:08.666309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:08.684468 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9c38a15-0d12-4a68-9858-aaec5486c2c8 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1269 microversion: 2.1 time: 0.210890 Oct 19 00:58:08.689363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1556/2991] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:08 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1269 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:08.713917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:08.714354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:08.722321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:08.723911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:08.726200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:08.727646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:08.734871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:08.737117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:08.908102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:08.948545 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-636465ff-32bd-4e0e-9dcd-9baa6eb0a99c tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1929 microversion: 2.75 time: 0.256623 Oct 19 00:58:08.949848 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1557/2992] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:08 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1929 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:08.955998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9caa0e8c-852a-441f-821b-07796d4ec489 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Calling method '.version_select at 0x7f2af5674c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:09.113872 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9caa0e8c-852a-441f-821b-07796d4ec489 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796/defaults" status: 200 len: 371 microversion: 2.1 time: 0.162501 Oct 19 00:58:09.115229 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1558/2993] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 00:58:08 2022] GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796/defaults => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:09.134137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f31d79b2-fb0c-4632-9b36-b37beb63d0e1 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Calling method '.version_select at 0x7f2af4fc3dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:09.689109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f31d79b2-fb0c-4632-9b36-b37beb63d0e1 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796" status: 200 len: 371 microversion: 2.1 time: 0.557355 Oct 19 00:58:09.690124 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1559/2994] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 00:58:09 2022] GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796 => generated 371 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:09.704940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:09.706892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:09.727679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:09.728532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:09.729221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:09.730144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:09.730778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:09.731430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:10.416195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:10.432035 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-05c01f8b-f6b8-4034-8b75-b595a2c51b8c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 0.734809 Oct 19 00:58:10.434235 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1560/2995] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:09 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:10.443174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e40e5c8b-c715-4703-bfe5-53e78653e9c1", "name": "network-vif-deleted", "tag": "d7836c2a-6728-491d-aafa-1098ed635cb1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:10.470205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:10.473469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:10.474278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:10.503042 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] Creating event network-vif-deleted:d7836c2a-6728-491d-aafa-1098ed635cb1 for instance e40e5c8b-c715-4703-bfe5-53e78653e9c1 on n-h2-master-1 Oct 19 00:58:10.513610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f20b824a-469f-4b91-aec9-e04a2d80e97c req-f287cded-42b7-4fa5-8fe9-33319a6e4de4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077569 Oct 19 00:58:10.514405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1561/2996] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:10.528250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-48874881-4239-4276-a785-ae294b8998d6 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] Calling method '.version_select at 0x7f2af4fc3dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:11.034914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-48874881-4239-4276-a785-ae294b8998d6 tempest-QuotasTestJSON-477342625 tempest-QuotasTestJSON-477342625-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796?user_id=17e7c6fe22384d59910f169840de1af7" status: 200 len: 371 microversion: 2.1 time: 0.511232 Oct 19 00:58:11.065880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1562/2997] 10.222.0.27 () {58 vars in 1323 bytes} [Wed Oct 19 00:58:10 2022] GET /compute/v2.1/os-quota-sets/a75dc7f202174a28b30b6c6746b34796?user_id=17e7c6fe22384d59910f169840de1af7 => generated 371 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:11.082400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:11.083625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:11.112974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.114518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.114941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:11.123208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.123930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.124705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:11.387970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:11.404377 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-822b3679-0e40-4d70-ae61-1520622266b6 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1275 microversion: 2.1 time: 0.332974 Oct 19 00:58:11.406408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1563/2998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:11 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:11.411498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:11.416928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:11.427853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.435187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.436438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:11.441245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.442061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.442734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:11.724010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:11.797306 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:11.805125 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-78c4c922-a643-458f-a4d5-8e207d8749d8 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1935 microversion: 2.75 time: 0.396755 Oct 19 00:58:11.806564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1564/2999] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:11 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1935 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:11.822393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:11.823994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:11.858198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.860306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.862910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:11.867449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:11.868369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:11.871972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:12.795889 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f5d69df-795c-4139-9918-8aa49392154d tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.696296 Oct 19 00:58:12.803825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1436/3000] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:58:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:12.809758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8a97666-b09b-47f3-be63-ea549fc514ce", "tag": "8e4e5b0d-fa90-4f37-b94d-e4719ef7d801"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:12.813071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:12.825045 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b654f2dd-90ce-4fd1-a62d-e1b7953cb1a0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 1.013943 Oct 19 00:58:12.825883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1565/3001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:11 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:12.836682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:12.837212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:12.837659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:12.839432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:12.840233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:12.855345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:12.860751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:12.861419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:12.862372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:12.863002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:12.863591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:12.866041 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] Creating event network-changed:8e4e5b0d-fa90-4f37-b94d-e4719ef7d801 for instance f8a97666-b09b-47f3-be63-ea549fc514ce on n-h1-master-1 Oct 19 00:58:12.875261 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-67b151b7-3a0f-40c0-b4be-a531fd595b60 req-ac10a7f7-ab7c-4b1a-8585-847490a9c090 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070089 Oct 19 00:58:12.882278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1437/3002] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:12.888285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0f5e051-8090-476a-9fd5-411050d59fa8 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Action: 'create', calling method: .version_select at 0x7f2af4621b80>, body: {"pool": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:13.125720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:13.134812 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe117eea-60d4-4b99-bbb9-881ca54d8e50 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1275 microversion: 2.1 time: 0.304799 Oct 19 00:58:13.137564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1566/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:12 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1275 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:13.153657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:13.154892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:13.164910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.165404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.167110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:13.172570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.173456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.174177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:13.438480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] Lazy-loading 'services' on Instance uuid 4a6ed1af-a875-4070-bef6-816ef1fc3e95 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:58:13.485933 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7598eb11-8002-45b6-9828-b75451880105 tempest-ServersAdmin275Test-1359026623 tempest-ServersAdmin275Test-1359026623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1920 microversion: 2.75 time: 0.345322 Oct 19 00:58:13.487148 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1567/3004] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:13 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1920 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:13.545602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:13.549132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:13.565888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.567878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.569532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:13.570521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.571847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.575436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:13.662560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:13.803147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15a4d1a6-5ae5-4be7-b185-c37a78e75532 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 204 len: 0 microversion: 2.75 time: 0.270572 Oct 19 00:58:13.805420 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1568/3005] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:58:13 2022] DELETE /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:58:13.827443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:13.828152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:13.837362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.838189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.839222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:13.841071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:13.841772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:13.842812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:14.438761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:14.448938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:14.450838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:14.456932 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad0f9a08-b2d9-438a-9604-9cacc0cd5527 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1444 microversion: 2.75 time: 0.644707 Oct 19 00:58:14.473581 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1569/3006] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:13 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1444 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:14.487927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:14.489133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:14.496674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:14.497490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:14.498386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:14.499302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:14.499998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:14.500797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:14.907161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:14.917925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f973f38-7a58-4941-8b69-bfc88c2e90d9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 0.442472 Oct 19 00:58:14.919355 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1570/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:14 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:14.924536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:14.925365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:14.932529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:14.934242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:14.934985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:14.936019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:14.936757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:14.937450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:15.567963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:15.583658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce557589-b137-4a80-af98-fefe40a2969e tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.662930 Oct 19 00:58:15.584549 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1571/3008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:14 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:15.605815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7bec6a-e56c-4f86-aea8-b3cac8a54f63", "name": "network-vif-plugged", "status": "completed", "tag": "a4f90c67-9b0f-4c7d-9ada-37d79fff344b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:15.633301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:15.634181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:15.634879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:15.659053 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] Creating event network-vif-plugged:a4f90c67-9b0f-4c7d-9ada-37d79fff344b for instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 on n-h1-master-1 Oct 19 00:58:15.677647 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8c4605c5-e417-4347-a06f-70a90b96d0ca req-f74789ac-9ba9-4f7e-a92d-70daaaa45734 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074882 Oct 19 00:58:15.677793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1572/3009] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:15.691339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:15.694561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:15.714477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:15.714975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:15.715419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:15.716134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:15.716593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:15.720992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:15.935693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:15.940150 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:15.956505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:15.958009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5decad27fffe49b99ef87c8e388b6df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe7daea1c94340fcb98a3831cd74655f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:15.971122 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6737371f-cc38-4dec-8589-5f314abe027d tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 200 len: 1444 microversion: 2.75 time: 0.283589 Oct 19 00:58:15.993391 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1573/3010] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:15 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 1444 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:58:16.007841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:16.008720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:16.020018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:16.020520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:16.021028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:16.022072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:16.022767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:16.023204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:16.912857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:16.926670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fbe48d9b-c06f-4cf6-8720-e68e73f157dd tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1308 microversion: 2.1 time: 0.929615 Oct 19 00:58:16.929184 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1574/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:15 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1308 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:16.938899 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:16.941988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:16.952606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:16.953491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:16.954159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:16.955156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:16.955854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:16.957448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:17.488193 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:17.707184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:17.718390 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae74f93b-9902-499c-9142-afd2bc24a1ba tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.787486 Oct 19 00:58:17.725371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1575/3012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:16 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:17.733707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:17.734334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] [instance: 4a6ed1af-a875-4070-bef6-816ef1fc3e95] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:17.741046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:17.741709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:17.742290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:17.743003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:17.743463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:17.743921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:17.763857 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] HTTP exception thrown: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Request method failure captured: Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 HTTP/1.1 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0tVyWVNnW1kHe5l_O4QfbUo3N1h-yDPVf2zigCqgqMsJhKW8R0Ej2kycVfIn9cOXVPag70wUkdFuWIG-xQwxkD9rUi4leY9v_AC8x6z9MUd6m2lPPk2p0yi9rFWUGZf2UlzekgEjjdTQ8Uh0KFyhfdT21cZCq3DkH4Wa0fPfDgAuhE Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.75 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: fe7daea1c94340fcb98a3831cd74655f Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdmin275Test-338021279 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe7daea1c94340fcb98a3831cd74655f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe7daea1c94340fcb98a3831cd74655f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe7daea1c94340fcb98a3831cd74655f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe7daea1c94340fcb98a3831cd74655f"}]}] Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdmin275Test-338021279 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: fe7daea1c94340fcb98a3831cd74655f Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdmin275Test-338021279 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdmin275Test-338021279-project Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 5decad27fffe49b99ef87c8e388b6df1 Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdmin275Test-338021279-project Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '4a6ed1af-a875-4070-bef6-816ef1fc3e95'} Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:17.765708 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] Returning 404 to user: Instance 4a6ed1af-a875-4070-bef6-816ef1fc3e95 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:17.770317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a65ae2e0-5750-42e0-8f3d-2df4c1848ed0 tempest-ServersAdmin275Test-338021279 tempest-ServersAdmin275Test-338021279-project] 10.222.0.27 "GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95" status: 404 len: 111 microversion: 2.75 time: 0.043859 Oct 19 00:58:17.773734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1576/3013] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:58:17 2022] GET /compute/v2.1/servers/4a6ed1af-a875-4070-bef6-816ef1fc3e95 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:58:17.952235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:17.954027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:17.965232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:17.966112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:17.966808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:17.968422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:17.969174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:17.969816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:18.636985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:18.649636 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0db4521d-f127-4e9f-9755-c1be2a49843a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1489 microversion: 2.1 time: 0.700441 Oct 19 00:58:18.652502 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1577/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:17 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1489 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:58:18.658252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a97666-b09b-47f3-be63-ea549fc514ce", "name": "network-vif-plugged", "status": "completed", "tag": "8e4e5b0d-fa90-4f37-b94d-e4719ef7d801"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:18.700194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:18.700796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:18.701336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:18.728122 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] Creating event network-vif-plugged:8e4e5b0d-fa90-4f37-b94d-e4719ef7d801 for instance f8a97666-b09b-47f3-be63-ea549fc514ce on n-h1-master-1 Oct 19 00:58:18.736410 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-827e8fc0-862d-4b77-88d6-d60deecdb661 req-0113568f-1197-4ebe-91db-0abb414a119c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082066 Oct 19 00:58:18.737630 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1578/3015] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:18.746688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:18.748009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:18.755600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:18.756607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:18.759097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:18.760612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:18.761308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:18.761932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:18.926407 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0f5e051-8090-476a-9fd5-411050d59fa8 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.041198 Oct 19 00:58:18.934774 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1438/3016] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:58:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:18.940702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:18.941451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:18.963255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:18.965392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:18.966184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:18.968578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:18.971749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:18.974407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:19.517193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:19.536028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84b628e9-f07a-452d-9613-266d62739601 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1489 microversion: 2.1 time: 0.792353 Oct 19 00:58:19.541931 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1579/3017] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:18 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1489 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:19.552465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5118b12a-e410-43ac-8d13-90d014be4d18 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Action: 'create', calling method: .version_select at 0x7f2af5572dc0>, body: {"pool": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:19.716332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:19.726113 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0e420b6-ffe0-44c5-b08d-14faf8e7bb52 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.789943 Oct 19 00:58:19.742786 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1439/3018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:18 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:19.756793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0b9b48-5fed-43c0-b354-f255878786b8", "tag": "d20c010f-a937-4072-8223-f7923b59902b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:19.771078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:19.771997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:19.772998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:19.788435 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] Creating event network-changed:d20c010f-a937-4072-8223-f7923b59902b for instance bb0b9b48-5fed-43c0-b354-f255878786b8 on n-h2-master-1 Oct 19 00:58:19.796698 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-441ec49c-86ab-4e83-befa-5719f791cb7e req-b314cee8-eacb-43c2-86d5-a00b345d90bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052263 Oct 19 00:58:19.802139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1440/3019] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:19.814560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:19.819807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:19.832587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:19.833554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:19.834534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:19.835537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:19.836249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:19.836952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:20.638979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:20.655711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbc27479-214e-488b-8b44-491583b10451 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1489 microversion: 2.1 time: 0.851464 Oct 19 00:58:20.656415 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1441/3020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:19 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1489 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:20.684111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:20.686960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:20.705745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:20.708534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:20.710863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:20.714244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:20.718725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:20.719512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:20.762599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:20.953689 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3af3e74f-c57e-4034-9098-e51deaaeebcf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 204 len: 0 microversion: 2.1 time: 0.273366 Oct 19 00:58:20.957016 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1442/3021] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:20 2022] DELETE /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:58:20.970663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:20.979961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:21.001565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:21.002343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:21.002961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:21.015307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:21.026871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:21.026871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:21.029525 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:21.761623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:21.770540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c5f95b4-f093-46d5-8069-8930231b89be tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.811714 Oct 19 00:58:21.771141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1443/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:20 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:21.791006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:21.792362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:21.823915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:21.832326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:21.832775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:21.833546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:21.834023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:21.834481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:22.283391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:22.294549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1cd9ea0-de79-4bc5-b025-b742ec915040 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1495 microversion: 2.1 time: 0.516968 Oct 19 00:58:22.296156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1444/3023] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:21 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1495 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:22.797460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:22.799541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:22.808595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:22.809544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:22.810211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:22.811249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:22.812352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:22.813519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:23.427416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:23.436288 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f197ab49-9985-4c52-a6a2-1acafd33db03 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.643365 Oct 19 00:58:23.437258 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1445/3024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:22 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:58:23.445947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:23.452788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:23.466864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:23.470404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:23.471212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:23.472247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:23.472895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:23.473649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:24.415848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:24.421641 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:24.433943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-370f20e5-0f20-4f8b-9788-f4ccd44d5021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 200 len: 1495 microversion: 2.1 time: 0.994780 Oct 19 00:58:24.434911 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1446/3025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:23 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 1495 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:24.464189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:24.465425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:24.474298 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:24.481209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:24.481990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:24.483006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:24.483940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:24.485382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:24.486029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:25.895205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:25.906143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-656c2359-fc09-4fec-a787-836f661909ca tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 1.446900 Oct 19 00:58:25.908101 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1447/3026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:24 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:25.939611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7bec6a-e56c-4f86-aea8-b3cac8a54f63", "name": "network-vif-deleted", "tag": "a4f90c67-9b0f-4c7d-9ada-37d79fff344b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:25.966378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:25.967164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:25.967790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:26.002401 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] Creating event network-vif-deleted:a4f90c67-9b0f-4c7d-9ada-37d79fff344b for instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 on n-h1-master-1 Oct 19 00:58:26.012533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-990cbc9b-b82b-49b1-ba02-7234b20bf0c1 req-99dde97d-a446-4d7c-8491-bf3673e27b61 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088020 Oct 19 00:58:26.015361 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1448/3027] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:26.032072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:26.033549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:26.049363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:26.050534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:26.052162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:26.061515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:26.064109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:26.064772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:26.112758 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 HTTP/1.1 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0e7bec6a-e56c-4f86-aea8-b3cac8a54f63'} Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:26.114563 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76cde024-ec62-4722-84e5-2a8199cda89c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 404 len: 111 microversion: 2.1 time: 0.098876 Oct 19 00:58:26.120495 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1449/3028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:26 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:26.428501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5118b12a-e410-43ac-8d13-90d014be4d18 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.883277 Oct 19 00:58:26.429177 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1580/3029] 10.222.0.27 () {60 vars in 1170 bytes} [Wed Oct 19 00:58:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:26.444032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:26.444546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:26.447805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1082793716", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:26.466237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:26.466802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:26.467205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:26.467898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:26.468336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:26.468804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:26.498603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:26.562767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:26.704873 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-993ab2f0-3c5e-4003-9c18-0a4b6203fde0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 204 len: 0 microversion: 2.1 time: 0.274735 Oct 19 00:58:26.706637 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1581/3030] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:26 2022] DELETE /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:26.730168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41571703-e9e4-49f3-b807-1501f3bab06c tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af5572040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:27.285917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41571703-e9e4-49f3-b807-1501f3bab06c tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/5a58f524-48f9-4b04-b473-6d42503ab1dc" status: 200 len: 142 microversion: 2.1 time: 0.577855 Oct 19 00:58:27.286598 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1582/3031] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:58:26 2022] GET /compute/v2.1/os-floating-ips/5a58f524-48f9-4b04-b473-6d42503ab1dc => generated 142 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:27.485309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:27.487015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:27.490309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:27.491155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:27.491813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:27.526681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:27.531636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:27.532386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:27.533624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:27.534319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:27.534970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:27.597567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-338143508", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:27.615150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:27.646526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:27.678971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:27.682617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:27.720568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:27.776572 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0e1af30-f503-4e9f-90f1-c405f1cc3544 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.656249 Oct 19 00:58:27.780850 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1450/3032] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:58:27.798903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:27.813011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:27.823558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:27.824292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:27.825167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:27.826067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:27.826741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:27.827356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:28.573829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:28.584911 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ec033d9-d77f-4098-9311-c73d489cb63a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1495 microversion: 2.1 time: 0.797205 Oct 19 00:58:28.594832 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1451/3033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:27 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1495 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:28.599845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:28.609515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:28.631463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:28.631977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:28.632418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:28.633164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:28.642109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:28.642571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:28.797103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:28.797686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:28.798005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:28.798997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:28.799605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:28.825528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:28.826037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:28.826490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:28.827251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:28.832398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:28.836522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:28.894912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Getting quotas for project 413a1c08324d4c1d8829fe25c1f15c09. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:28.907481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Getting quotas for user d1f94c167c854cffb1ef9c36a278620d and project 413a1c08324d4c1d8829fe25c1f15c09. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:28.940651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:28.954601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:29.065143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0c31024-471f-4144-845c-9863d119b53c tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768978 Oct 19 00:58:29.077412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1583/3034] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:58:29.095446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62a6e278-8cde-45c8-8b56-00d3995cb153 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af5512f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:29.179479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:29.188491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba83be72-476b-440b-b52a-f779478adc37 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.592512 Oct 19 00:58:29.191702 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1452/3035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:28 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:29.225666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:29.226321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:29.253352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:29.259849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:29.261610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:29.263876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:29.265436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:29.266014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:29.679658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:29.720839 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9213737-6328-4074-8132-63799e319290 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1267 microversion: 2.1 time: 0.505917 Oct 19 00:58:29.727494 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1453/3036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:29 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1267 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:29.758068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0b9b48-5fed-43c0-b354-f255878786b8", "name": "network-vif-plugged", "status": "completed", "tag": "d20c010f-a937-4072-8223-f7923b59902b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:29.792416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:29.796790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:29.797458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:29.846031 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] Creating event network-vif-plugged:d20c010f-a937-4072-8223-f7923b59902b for instance bb0b9b48-5fed-43c0-b354-f255878786b8 on n-h2-master-1 Oct 19 00:58:29.861834 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e5e84973-e9a3-4733-bbaf-99f6657f71af req-4988df99-19be-4a51-92b6-20ec0f779550 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130568 Oct 19 00:58:29.864682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1454/3037] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:30.435608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f670f04e-62ae-49a6-8c72-e3214231c28b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: .version_select at 0x7f2af45c0dc0>, body: {"keypair": {"name": "tempest-keypair-822258600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDoUnyBB58DTaJcY0EkdpZ2/kBb6klSubm4AnsXZtf568yaALAkGSNWnUpTSqAvBfhpKutyRx5VrMgY4V1+H8L6hvmXS9G6E717DaqwVWs67RhPC2BrcPaxI2NqMxgGFpw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:30.526131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f670f04e-62ae-49a6-8c72-e3214231c28b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for project daa2d47392564feabc36c67f7382cddf. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:30.561749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f670f04e-62ae-49a6-8c72-e3214231c28b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for user 098f448796ff4635ac6b4b7262bf6ff1 and project daa2d47392564feabc36c67f7382cddf. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:30.618425 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f670f04e-62ae-49a6-8c72-e3214231c28b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.752649 Oct 19 00:58:30.619976 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1455/3038] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 00:58:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:30.633828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:30.635398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:30.649829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:30.650577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:30.652023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:30.652969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:30.653667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:30.654320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:31.003972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:31.021697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-657c2295-48ab-4439-b2a3-fd6ba7cbb6dd tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1273 microversion: 2.1 time: 0.400526 Oct 19 00:58:31.025779 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1456/3039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:30 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:31.041064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:31.041064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:31.061932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:31.062726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:31.063467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:31.064270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:31.065586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:31.067658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:31.284161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:31.313226 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a74311e8-4fa2-49a6-8554-3f10f3530e0d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 200 len: 1453 microversion: 2.1 time: 0.283463 Oct 19 00:58:31.315399 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1457/3040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:31 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 1453 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:31.333327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:31.334419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:31.359578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:31.360380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:31.361973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:31.364002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:31.365726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:31.366297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.172442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:32.183378 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d18205e-2bf1-4666-ba64-1967aa3ba8e4 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1317 microversion: 2.1 time: 0.866669 Oct 19 00:58:32.188952 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1458/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:31 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1317 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:32.200572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:32.206620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:32.218214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.219132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.219589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.221471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.221944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.222406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.417518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:32.426800 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96121e8c-7fca-451a-89c9-c9f03b31ed44 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1273 microversion: 2.1 time: 0.235693 Oct 19 00:58:32.446788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1459/3042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:32 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:32.469624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6f1035-007d-47b4-97a6-b29083848983", "name": "network-vif-deleted", "tag": "66bad360-9353-4648-89f7-7efd88344cf7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:32.483344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.484942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.485892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.513896 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] Creating event network-vif-deleted:66bad360-9353-4648-89f7-7efd88344cf7 for instance 2e6f1035-007d-47b4-97a6-b29083848983 on n-h1-master-1 Oct 19 00:58:32.535980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b81e6f34-0019-4622-b3ef-0e6fdd8be347 req-a597f32e-7506-4b23-a36f-a7d7acfb2882 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078707 Oct 19 00:58:32.537841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1460/3043] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:32.546764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:32.549130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:32.560742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.562604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.564358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.566567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.567891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.568566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.949810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:32.960038 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1979cf82-bea3-46a7-b771-d7a4dbd0f1a5 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1279 microversion: 2.1 time: 0.420388 Oct 19 00:58:32.977837 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1461/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:32 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:32.984690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:32.985327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:32.991778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.992495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.993140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:32.994733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:32.995527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:32.996137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:33.012012 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 HTTP/1.1 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2e6f1035-007d-47b4-97a6-b29083848983'} Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:33.014645 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 00:58:33.019757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:33.021007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:33.022285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff193482-6be2-410b-a382-8fd2fefed2da tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 404 len: 111 microversion: 2.1 time: 0.041756 Oct 19 00:58:33.023368 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1462/3045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:32 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:33.185662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-945243683", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:33.251826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:33.308782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62a6e278-8cde-45c8-8b56-00d3995cb153 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/5a58f524-48f9-4b04-b473-6d42503ab1dc" status: 202 len: 0 microversion: 2.1 time: 4.229292 Oct 19 00:58:33.310649 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1584/3046] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:58:29 2022] DELETE /compute/v2.1/os-floating-ips/5a58f524-48f9-4b04-b473-6d42503ab1dc => generated 0 bytes in 4232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:58:33.317809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:33.318465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:33.330669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:33.332281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:33.332640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:33.334327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:33.335179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:33.335306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:33.789845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:33.804584 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d776187-4794-444f-9a74-2d63a7d76f7d tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1506 microversion: 2.1 time: 0.490396 Oct 19 00:58:33.805351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1585/3047] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:33 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1506 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:33.834633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-317e50c3-b9bf-4a19-ae22-f2b7e7af54ea tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af546e550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:34.692698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-317e50c3-b9bf-4a19-ae22-f2b7e7af54ea tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.863100 Oct 19 00:58:34.706921 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1586/3048] 10.222.0.27 () {58 vars in 1164 bytes} [Wed Oct 19 00:58:33 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:58:34.719081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:34.730197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:34.747396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:34.748386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:34.749437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:34.750649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:34.751316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:34.752032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:34.830666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:34.831162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:34.831572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:34.831993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:34.832419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:34.849190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:34.849190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:34.849661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:34.850410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:34.850878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:34.851325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:34.895614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:34.901961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:34.917408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:34.920393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:34.984886 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6412bf38-092a-4865-9dec-9144f0150c8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803807 Oct 19 00:58:34.986288 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1463/3049] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:58:34.996361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:34.997019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:35.005851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:35.006650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:35.008185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:35.009415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:35.010277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:35.018133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:35.254554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:35.281622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f88f8cb0-7673-4d8a-a3b3-b4e86f40eb17 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.566290 Oct 19 00:58:35.297829 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1587/3050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:34 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:35.304544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:35.305356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:35.313693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:35.314560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:35.315187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:35.316200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:35.316970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:35.317771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:35.425897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:35.437611 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a0886ea-e76c-400c-826b-46a452229311 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1279 microversion: 2.1 time: 0.137906 Oct 19 00:58:35.438354 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1588/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:35 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1279 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:35.464434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e846b4b-cf3c-4d47-8ac0-9433ddc6dbc8 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af4e58f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:35.485406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:35.503762 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-777fe191-6877-4236-85bf-a818ad282308 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce" status: 200 len: 1505 microversion: 2.1 time: 0.516068 Oct 19 00:58:35.521554 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1464/3052] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:34 2022] GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:35.542212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-541903275", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acc26b34-be56-4bde-8cdb-e3ebe9327553"}], "security_groups": [{"name": "tempest-securitygroup--49926455"}], "key_name": "tempest-keypair-822258600", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:36.148986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] validate_networks() for [('acc26b34-be56-4bde-8cdb-e3ebe9327553', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:36.763986 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e846b4b-cf3c-4d47-8ac0-9433ddc6dbc8 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 1.303588 Oct 19 00:58:36.765716 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1589/3053] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 00:58:35 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:36.770594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:36.771244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:36.789283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:36.789778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:36.790218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:36.791105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:36.793346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:36.795099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.039669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:37.065598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd3ab5c3-7721-4ec6-8069-3cef7624fcfb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1268 microversion: 2.1 time: 0.295102 Oct 19 00:58:37.066281 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1590/3054] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:36 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1268 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:37.082555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:37.083760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:37.121970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.122468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.122909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.123641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.124084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.124743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.162197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:37.311413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-262456e8-3ee8-459f-adec-56195c3f0e98 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce" status: 204 len: 0 microversion: 2.1 time: 0.242826 Oct 19 00:58:37.315600 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1591/3055] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:37 2022] DELETE /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:37.326929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:37.327836 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:37.336994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.337548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.338021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.344893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.347129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.347598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.868545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:37.869605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:37.870092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:37.870732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:37.871521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:37.888777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.889282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.889727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.890469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:37.899010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:37.899651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:37.949628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for project daa2d47392564feabc36c67f7382cddf. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:37.958324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for user 098f448796ff4635ac6b4b7262bf6ff1 and project daa2d47392564feabc36c67f7382cddf. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:37.975332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:37.978082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:38.053144 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3efa547-a724-41db-a6e6-50ad4c3b879b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.528053 Oct 19 00:58:38.056055 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1465/3056] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:35 2022] POST /compute/v2.1/servers => generated 400 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:58:38.071176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:38.073310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:38.102075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:38.113788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:38.124776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:38.125871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:38.126002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:38.126462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:38.126903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:38.131943 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12e2d6aa-1343-4760-9ad7-e99ac3b6204e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.808670 Oct 19 00:58:38.133019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1592/3057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:37 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:38.140470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5ecae23b-2d9e-4aa1-8811-f779ff86405f tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af4e58b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:38.863683 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:38.883053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:38.901983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ff11578-b7d1-4182-b000-b5e359e54040 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.843782 Oct 19 00:58:38.903204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1466/3058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:38 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:38.912163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:38.913133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:38.924093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:38.925439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:38.926112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:38.927484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:38.928163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:38.929245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:38.930787 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:38.985729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:39.112410 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:39.124907 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66104e6c-2733-44d4-8c99-b913c287999f tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 204 len: 0 microversion: 2.1 time: 0.220037 Oct 19 00:58:39.129438 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1467/3059] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:38 2022] DELETE /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:39.144287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:39.145028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:39.162962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:39.163499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:39.163940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:39.164690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:39.165135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:39.174424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:39.178294 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:39.524942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:39.534733 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1e6ddba-6822-4810-b30b-7473e52cf8aa tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1232 microversion: 2.1 time: 0.403884 Oct 19 00:58:39.537738 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1468/3060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:39 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1232 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:39.547196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:39.547994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:39.557779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:39.558459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:39.559012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:39.560090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:39.560811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:39.561415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.129285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:40.163680 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c5d41b7-e565-4137-a5e4-7038721f1b6b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.620636 Oct 19 00:58:40.164589 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1469/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:39 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:40.185083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750d52a9-e30d-44d3-bda1-1c5781c3d165", "tag": "d5d7410c-2980-4eda-a558-d2a209b1170c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:40.201447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:40.202369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:40.203096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.222113 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] Creating event network-changed:d5d7410c-2980-4eda-a558-d2a209b1170c for instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 on n-h2-master-1 Oct 19 00:58:40.228576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4acc70c4-9ac5-4ffd-996b-84f8fa46600b req-de576caf-5081-4ea4-95a0-f7a867c4ea0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053164 Oct 19 00:58:40.230138 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1470/3062] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:40.236759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:40.237857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:40.249442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:40.250623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:40.251206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.252062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:40.252756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:40.253424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.679090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:40.690720 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3c7b3c92-3bd0-481d-8faf-d91e142fe9de tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce" status: 200 len: 1511 microversion: 2.1 time: 0.459134 Oct 19 00:58:40.692487 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1471/3063] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:40 2022] GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:40.699733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:40.700787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:40.721157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:40.726112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:40.734917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.735696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:40.736765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:40.737225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:40.973895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5ecae23b-2d9e-4aa1-8811-f779ff86405f tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/05a32c85-eda5-4083-901c-e3812da121b5" status: 202 len: 0 microversion: 2.1 time: 2.836918 Oct 19 00:58:40.976199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1593/3064] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:58:38 2022] DELETE /compute/v2.1/os-floating-ips/05a32c85-eda5-4083-901c-e3812da121b5 => generated 0 bytes in 2842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:58:40.984001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:40.985413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:40.999102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:41.001352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:41.002754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:41.009121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:41.010084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:41.015106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:41.136284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:41.146102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b2226079-7fcb-42c7-a33d-72b0d98a5d08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.452212 Oct 19 00:58:41.147302 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1472/3065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:40 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:41.153408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:41.154533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:41.166318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:41.166795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:41.167727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:41.167960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:41.168460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:41.173258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:41.499446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:41.514048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd788368-eeb0-4c63-a0a6-c2b3800500b8 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.536391 Oct 19 00:58:41.515857 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1594/3066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:40 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:41.530028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8a97666-b09b-47f3-be63-ea549fc514ce", "name": "network-vif-deleted", "tag": "8e4e5b0d-fa90-4f37-b94d-e4719ef7d801"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:41.550583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:41.551070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:41.551517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:41.563804 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:41.583551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] Creating event network-vif-deleted:8e4e5b0d-fa90-4f37-b94d-e4719ef7d801 for instance f8a97666-b09b-47f3-be63-ea549fc514ce on n-h1-master-1 Oct 19 00:58:41.600356 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-eefbc8be-6545-447a-a0bd-42127799761a req-103fa740-0805-43d4-8ad5-ad41a389b1f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080502 Oct 19 00:58:41.601820 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1595/3067] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:41.615272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d65abd90-081c-4b08-b445-136e7c51b2fd tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af570db80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:42.100597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:42.114413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12915345-87ac-4e51-a196-f610a79e806a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1294 microversion: 2.1 time: 0.965850 Oct 19 00:58:42.116039 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1473/3068] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:41 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1294 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:42.127171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:42.128605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:42.138914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.140615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.142255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:42.144345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.145241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.145905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:42.735352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:42.759043 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a96ca44-8ddd-49bd-9435-6935902117a9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.641053 Oct 19 00:58:42.761948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1474/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:42 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:42.778688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:42.780316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: f8a97666-b09b-47f3-be63-ea549fc514ce] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:42.793382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.795239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.795711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:42.797148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.797635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.800939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:42.845087 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] HTTP exception thrown: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Request method failure captured: Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce HTTP/1.1 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0t7ZgYmsm9_su2t83lzV0onNfPmGQ-IOSewRJrtgxQMwJhZxtSJhBhKxK3fCg2I7Yw1sGWcX_nLvkszIqW0DiFYvXwaMylyHDmoWdPjPgihshUEsCGCkpLbFSneD9QfBNt9YU02fIo33EumExluzyfx2Vbwm-7gnvdAEKD2LFFwZto Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f1c3d8147eb24a4ab1aa72a7b973dd51 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1c3d8147eb24a4ab1aa72a7b973dd51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}] Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f1c3d8147eb24a4ab1aa72a7b973dd51 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MultipleCreateTestJSON-792600949-project Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2951a7c54a114bc5a778e0b3ff2e8f1e Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MultipleCreateTestJSON-792600949-project Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: exception: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f8a97666-b09b-47f3-be63-ea549fc514ce'} Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:42.847213 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Returning 404 to user: Instance f8a97666-b09b-47f3-be63-ea549fc514ce could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f6beb6b-61ff-4821-9b17-503fbcfddee2 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce" status: 404 len: 111 microversion: 2.1 time: 0.083798 Oct 19 00:58:42.851416 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1475/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:42 2022] GET /compute/v2.1/servers/f8a97666-b09b-47f3-be63-ea549fc514ce => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:42.861968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:42.862639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:42.924871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.925388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.929009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:42.934574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:42.935367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:42.935612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:43.446571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:43.465999 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54da6346-0dfc-4341-b9e9-795564b64c71 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.605732 Oct 19 00:58:43.467780 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1476/3071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:42 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:43.481395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68eeaef1-1894-4772-8682-5e936986fcea", "tag": "7bc14d55-b154-49d4-b553-69a23d1747a4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:43.521487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:43.522720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:43.523164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:43.565324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] Creating event network-changed:7bc14d55-b154-49d4-b553-69a23d1747a4 for instance 68eeaef1-1894-4772-8682-5e936986fcea on n-h1-master-1 Oct 19 00:58:43.578105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4dffe735-e5e7-4df6-9dbb-25e7d883ab85 req-7f5546c2-da09-4640-9720-65617791993e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104839 Oct 19 00:58:43.580021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1477/3072] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:43.591906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:43.593709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:43.611636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:43.612694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:43.613379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:43.614332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:43.615035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:43.615670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.017870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:44.040104 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-36dd81c0-c2aa-47f0-a178-511107ca066f tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.457573 Oct 19 00:58:44.046680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1478/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:43 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:44.070576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:44.071211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:44.101826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.103116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.105363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.106417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.107146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.108215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.301696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2951a7c54a114bc5a778e0b3ff2e8f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c3d8147eb24a4ab1aa72a7b973dd51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:44.327706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-69728497-23ca-4893-b1fd-d2bc20e702f9 tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 200 len: 1470 microversion: 2.1 time: 0.279965 Oct 19 00:58:44.329736 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1479/3074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:44 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:44.340853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d65abd90-081c-4b08-b445-136e7c51b2fd tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/6280da2f-2df5-422c-afae-bf7ba94523ef" status: 202 len: 0 microversion: 2.1 time: 2.734533 Oct 19 00:58:44.341833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1596/3075] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:58:41 2022] DELETE /compute/v2.1/os-floating-ips/6280da2f-2df5-422c-afae-bf7ba94523ef => generated 0 bytes in 2736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:58:44.346906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:44.347777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:44.348961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:44.349846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:44.357864 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:44.359465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.360097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.361112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.361944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.362124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.362718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.363640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.363773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.364764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.365388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.365532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.366173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.582587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:44.603306 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19be59c1-5d57-4174-8662-a1b1609b4df9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1294 microversion: 2.1 time: 0.272028 Oct 19 00:58:44.604416 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1480/3076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:44 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1294 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:44.622969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c57dd915-27b7-4efe-8d7b-ba0b8ff06c15", "tag": "b7f1241b-b814-483e-84d8-2503da456f91"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:44.661591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:44.665269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:44.665835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:44.707404 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] Creating event network-changed:b7f1241b-b814-483e-84d8-2503da456f91 for instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 on n-h2-master-1 Oct 19 00:58:44.728217 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5f21c5eb-e63c-4211-a212-dec203e0b004 req-f760cafc-2da9-4437-b772-9576114a31b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116616 Oct 19 00:58:44.729772 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1481/3077] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:44.735295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a99f7501-4341-4f43-a318-4aff23865e30 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] Calling method '.version_select at 0x7f2af465bee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:44.976086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:44.997751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bea37883-4606-405b-91ea-fddd25cf869d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.654719 Oct 19 00:58:45.008808 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1597/3078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:44 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:45.008808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:45.008808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:45.022002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:45.022654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:45.023228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:45.024055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:45.026533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:45.027240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:45.687475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:45.706788 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-47224bc9-656a-4fde-bdee-8d008fa1eca7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.701594 Oct 19 00:58:45.727810 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1598/3079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:45 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:45.738015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:45.740084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:45.764154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:45.768393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:45.769269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:45.770204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:45.770672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:45.771108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:46.226835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:46.246228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91b56305-f179-43a1-9a58-02374c0648c0 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.511964 Oct 19 00:58:46.250040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1599/3080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:45 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:46.271887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:46.273356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] [instance: bb0b9b48-5fed-43c0-b354-f255878786b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:46.288158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:46.296359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:46.297292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:46.299165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:46.300906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:46.302195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:46.344505 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] HTTP exception thrown: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Request method failure captured: Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 HTTP/1.1 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0t7ZgYmsm9_su2t83lzV0onNfPmGQ-IOSewRJrtgxQMwJhZxtSJhBhKxK3fCg2I7Yw1sGWcX_nLvkszIqW0DiFYvXwaMylyHDmoWdPjPgihshUEsCGCkpLbFSneD9QfBNt9YU02fIo33EumExluzyfx2Vbwm-7gnvdAEKD2LFFwZto Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: f1c3d8147eb24a4ab1aa72a7b973dd51 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f1c3d8147eb24a4ab1aa72a7b973dd51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f1c3d8147eb24a4ab1aa72a7b973dd51"}]}] Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: f1c3d8147eb24a4ab1aa72a7b973dd51 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MultipleCreateTestJSON-792600949 Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MultipleCreateTestJSON-792600949-project Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2951a7c54a114bc5a778e0b3ff2e8f1e Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MultipleCreateTestJSON-792600949-project Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: exception: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'bb0b9b48-5fed-43c0-b354-f255878786b8'} Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:46.356187 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. Oct 19 00:58:46.363950 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:46.371088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] Returning 404 to user: Instance bb0b9b48-5fed-43c0-b354-f255878786b8 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:46.372972 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34a1485e-62b9-4979-96c3-d614f29efd7b tempest-MultipleCreateTestJSON-792600949 tempest-MultipleCreateTestJSON-792600949-project] 10.222.0.27 "GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8" status: 404 len: 111 microversion: 2.1 time: 0.120108 Oct 19 00:58:46.379499 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1600/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:46 2022] GET /compute/v2.1/servers/bb0b9b48-5fed-43c0-b354-f255878786b8 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:46.404481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:46.406323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:46.414724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:46.416264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:46.416954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:46.421415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:46.424970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:46.425678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.294266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:47.298550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a99f7501-4341-4f43-a318-4aff23865e30 tempest-FloatingIPDetailsTestJSON-1781549353 tempest-FloatingIPDetailsTestJSON-1781549353-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/760af502-7892-41dc-915a-c2e059729edf" status: 202 len: 0 microversion: 2.1 time: 2.567285 Oct 19 00:58:47.300085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1482/3082] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 00:58:44 2022] DELETE /compute/v2.1/os-floating-ips/760af502-7892-41dc-915a-c2e059729edf => generated 0 bytes in 2570 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:58:47.308758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:47.311738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:47.321507 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3338a626-19a0-4a3c-a0e2-5d10fb73142f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.940092 Oct 19 00:58:47.325434 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1601/3083] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:46 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:47.335191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.339164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.339403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750d52a9-e30d-44d3-bda1-1c5781c3d165", "name": "network-vif-plugged", "status": "completed", "tag": "d5d7410c-2980-4eda-a558-d2a209b1170c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:47.340528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.345819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.348059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.348730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.363224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.364088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.364723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.386683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] Creating event network-vif-plugged:d5d7410c-2980-4eda-a558-d2a209b1170c for instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 on n-h2-master-1 Oct 19 00:58:47.394092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b33bbbf3-abb0-4252-9a59-1a1ffeb7707c req-1f114c95-7ac6-4a1a-9348-c3b1cf4ab784 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067168 Oct 19 00:58:47.395374 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1602/3084] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:47.403921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:47.405045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:47.414181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.414936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.415668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.418025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.418847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.419501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.823029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:47.832883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-79898fcd-6e4a-4172-bb18-bf82c93ef105 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.531351 Oct 19 00:58:47.857176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1483/3085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:47 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:47.866248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0b9b48-5fed-43c0-b354-f255878786b8", "name": "network-vif-deleted", "tag": "d20c010f-a937-4072-8223-f7923b59902b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:47.890814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.894559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.895143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.919403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] Creating event network-vif-deleted:d20c010f-a937-4072-8223-f7923b59902b for instance bb0b9b48-5fed-43c0-b354-f255878786b8 on n-h2-master-1 Oct 19 00:58:47.927573 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:47.934995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d9f4d8d3-6ddf-49e0-8f8a-2e211e3e0458 req-c72651c5-e37e-4163-9c8b-bfa0fbf91a59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076322 Oct 19 00:58:47.937693 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1484/3086] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:47.951102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:47.965471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:47.969527 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=22 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:47.974278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.974918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.975481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:47.976317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:47.977149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:47.977687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:48.032881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:48.042153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd71516b-5958-4bd2-bd4f-ce87ed50360b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.645239 Oct 19 00:58:48.043567 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1603/3087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:47 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:48.345306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:48.359518 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-113d7fb8-3b82-4f07-806e-4b36a4096be9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.420195 Oct 19 00:58:48.360060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:48.361877 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1485/3088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:47 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:48.364087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:48.381603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:48.382478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:48.385277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:48.386333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:48.387060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:48.388096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:48.747031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:48.755180 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17a4492c-a66e-4a46-96f4-de3d110217d0 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.404798 Oct 19 00:58:48.758931 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1604/3089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:48 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:48.872403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:48.873322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:48.883387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:48.890585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:48.891310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:48.892244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:48.893496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:48.894097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.069781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:49.070461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:49.081451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.081949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.082389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.083110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.083563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.083990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.625748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:49.640788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22ae0b7d-8976-40f3-a82e-18772a127dac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.773396 Oct 19 00:58:49.642466 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1486/3090] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:48 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:49.654731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:49.655558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:49.662887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:49.664606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.666707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.667384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.668284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.669326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.670111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.672003 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92149491-781a-49f9-98bf-8fbc872fa81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1315 microversion: 2.1 time: 0.606570 Oct 19 00:58:49.673175 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1605/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:49 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:58:49.678254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeaef1-1894-4772-8682-5e936986fcea", "name": "network-vif-plugged", "status": "completed", "tag": "7bc14d55-b154-49d4-b553-69a23d1747a4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:49.688580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.689478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.690078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.708594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] Creating event network-vif-plugged:7bc14d55-b154-49d4-b553-69a23d1747a4 for instance 68eeaef1-1894-4772-8682-5e936986fcea on n-h1-master-1 Oct 19 00:58:49.714752 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f9e6c181-1c76-49b2-ad80-196df2217478 req-d6b804f8-eb74-48a5-a6cb-033227553d3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040184 Oct 19 00:58:49.716223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1606/3092] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:49.796040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:49.797388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:49.804119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.804936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.807166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:49.808138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:49.808877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:49.809520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:50.082693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:50.096241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f70ce44-dfa0-441d-a90f-cbc46eca7f54 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.451346 Oct 19 00:58:50.097948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1487/3093] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:49 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:50.107201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c66c11-a25f-4e38-9147-4488c81b7f65", "tag": "31bdd485-52d8-47a9-9b0a-51bb32242328"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:50.144653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:50.145570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:50.146202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:50.183612 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] Creating event network-changed:31bdd485-52d8-47a9-9b0a-51bb32242328 for instance 58c66c11-a25f-4e38-9147-4488c81b7f65 on n-h1-master-1 Oct 19 00:58:50.191522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2a94dbeb-679d-4773-bd85-915917d08fc2 req-1952abc1-dd5b-4e47-889e-daed4477a44d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089171 Oct 19 00:58:50.193091 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1488/3094] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:50.208526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:50.218733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c862529f-0bde-4b14-8683-6b9f68ed79b5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.427220 Oct 19 00:58:50.221542 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1607/3095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:49 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:50.671489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:50.674139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:50.685754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:50.687177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:50.687854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:50.690097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:50.690760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:50.691204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:50.700276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:50.700922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:50.717217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:50.719906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:50.723722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:50.724876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:50.725510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:50.726137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.148916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:51.149365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:51.173116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2feb52f-9878-46c1-a6d7-a1863bae94d0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1503 microversion: 2.1 time: 0.478132 Oct 19 00:58:51.175043 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:51.182248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee1d5b08-3648-4333-9dd5-28e7265dd8fa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 0.518616 Oct 19 00:58:51.183162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1608/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:50 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1503 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:51.206016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:51.206903 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1489/3097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:50 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:51.207605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:51.216553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:51.217632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:51.226218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.227243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.227814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.234380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.236264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.237213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.237754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.238017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.239437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.240142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.241045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.245968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.304760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:51.496706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e952c643-d537-4c4e-a868-38196602baca tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 204 len: 0 microversion: 2.1 time: 0.286629 Oct 19 00:58:51.499296 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1490/3098] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:51 2022] DELETE /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:51.506097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:51.507271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:51.517226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.518684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.519578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:51.520881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:51.521538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:51.522039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:52.138756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:52.149350 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a92476f7-f526-44ed-b7d8-7449269bbde7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1321 microversion: 2.1 time: 0.964412 Oct 19 00:58:52.151479 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1609/3099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:51 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1321 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:52.167463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:52.168966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:52.177877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:52.179203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:52.180038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:52.181785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:52.182931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:52.183530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:52.400041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:52.411234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a31f29e-d7f7-4a03-a3b9-7ef89d7b70f2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.908141 Oct 19 00:58:52.433308 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1491/3100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:51 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:52.439709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57dd915-27b7-4efe-8d7b-ba0b8ff06c15", "name": "network-vif-plugged", "status": "completed", "tag": "b7f1241b-b814-483e-84d8-2503da456f91"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:52.464789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:52.466735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:52.468601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:52.484937 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] Creating event network-vif-plugged:b7f1241b-b814-483e-84d8-2503da456f91 for instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 on n-h2-master-1 Oct 19 00:58:52.494231 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-68d535fc-bef2-450d-9d79-2f47257e0161 req-8f7e5617-4527-41a6-9b4d-cd6d7261f909 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056099 Oct 19 00:58:52.502841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1492/3101] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:52.520952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:52.522078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:52.529135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:52.529827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:52.530465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:52.531878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:52.534281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:52.534936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:53.006844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:53.020901 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b1aa0bf-0b61-4f4d-a526-b2c26d0ecbfc tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1509 microversion: 2.1 time: 0.868025 Oct 19 00:58:53.044372 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1610/3102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:52 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1509 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:53.176426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:53.179097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:53.191987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:53.194259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:53.198159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:53.201232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:53.201955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:53.205947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:53.662761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:53.673950 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c82fca49-654c-4781-b009-35ec63507fa9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1308 microversion: 2.1 time: 1.169634 Oct 19 00:58:53.675100 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1493/3103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:52 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1308 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:53.681847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:53.682711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:53.704048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:53.706752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:53.709274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:53.711280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:53.712833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:53.715362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:53.829786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:53.854139 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff1ed4e9-6abb-4d8a-b093-9f343426702d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1470 microversion: 2.1 time: 0.682203 Oct 19 00:58:53.854751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1611/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:53 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1470 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:54.170325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:54.170942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] [instance: ceef2792-0920-44aa-a3c4-29f8ad46d7d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:54.184101 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] HTTP exception thrown: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Request method failure captured: Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ceef2792-0920-44aa-a3c4-29f8ad46d7d7/action HTTP/1.1 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxUKQUPULaT4ODkPTlr0MmRcj1DyaK61ENk93_cEGjFLtInf4UJSdEbwoy3VEfESuYqe3EbB1tkRFVNsM7sRIqbtenctod5YUzjPfafof0nOUrpHcusp_ejCEiMZx42Eqwq9m7WOe-VPbdP8aNBSNtv-tlDwK_2S9X2hJK40cAf_8 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aeb5e6dd8d6c46fab43fa07fa48cd99c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}] Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 59b1d506d2414984abe362472df8bcc2 Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: {"migrate": {}} Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ceef2792-0920-44aa-a3c4-29f8ad46d7d7', 'body': {'migrate': {}}} Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:54.187020 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. Oct 19 00:58:54.194336 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:58:54.198401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Returning 404 to user: Instance ceef2792-0920-44aa-a3c4-29f8ad46d7d7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:54.199826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-207d7b37-0997-4eb5-a1bb-e93e65d91b61 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ceef2792-0920-44aa-a3c4-29f8ad46d7d7/action" status: 404 len: 111 microversion: 2.1 time: 0.324919 Oct 19 00:58:54.219850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1612/3105] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:58:53 2022] POST /compute/v2.1/servers/ceef2792-0920-44aa-a3c4-29f8ad46d7d7/action => generated 111 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:54.226629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:54.229632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:54.288515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:54.289057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:54.289514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:54.291872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:54.292363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:54.292893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:54.410419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:54.426905 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-10f6f7be-ec94-4788-92b5-866ceb0322f5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.747114 Oct 19 00:58:54.444605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1494/3106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:53 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:54.452871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1137312550", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:54.526851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:54.992301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:55.015292 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9102b863-8f95-4182-a575-bdf04c91ad5a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 200 len: 1509 microversion: 2.1 time: 0.785477 Oct 19 00:58:55.017302 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1613/3107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:54 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 1509 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:55.031455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:55.032345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:55.059322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:55.059921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:55.060396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:55.061377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:55.061846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:55.062504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.192431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:56.194082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:56.194716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:56.195293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:56.199750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:56.204125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:56.216567 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6a4b56c-01ea-42a4-b83b-014f3e0f9736 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1490 microversion: 2.1 time: 1.192851 Oct 19 00:58:56.217597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1614/3108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:55 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1490 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:56.230304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.231973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.232718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.234497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750d52a9-e30d-44d3-bda1-1c5781c3d165", "name": "network-vif-deleted", "tag": "d5d7410c-2980-4eda-a558-d2a209b1170c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:56.237067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.237650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.238199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.249673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.250702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.251390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.272806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Getting quotas for project 413a1c08324d4c1d8829fe25c1f15c09. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:56.273815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] Creating event network-vif-deleted:d5d7410c-2980-4eda-a558-d2a209b1170c for instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 on n-h2-master-1 Oct 19 00:58:56.280464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Getting quotas for user d1f94c167c854cffb1ef9c36a278620d and project 413a1c08324d4c1d8829fe25c1f15c09. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:56.282573 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cd2c7893-a2f4-4cdb-ab02-6bd4b9d1b732 req-b99b993b-2f53-4b0b-aced-0bfb243280e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061981 Oct 19 00:58:56.283669 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1615/3109] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:56.291000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c66c11-a25f-4e38-9147-4488c81b7f65", "name": "network-vif-plugged", "status": "completed", "tag": "31bdd485-52d8-47a9-9b0a-51bb32242328"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:56.300575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:56.304269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:56.314617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.316003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.316885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.339170 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] Creating event network-vif-plugged:31bdd485-52d8-47a9-9b0a-51bb32242328 for instance 58c66c11-a25f-4e38-9147-4488c81b7f65 on n-h1-master-1 Oct 19 00:58:56.346441 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-40bc980b-6bd8-4b14-bd81-dd07a5b1c82e req-5a4d9fc8-69e3-4e33-ba90-f7e2929860ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060349 Oct 19 00:58:56.348435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1616/3110] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:56.357169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:56.358487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:56.366667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.367592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.369250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.371031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.374642 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5cdf5863-5071-49db-a4fd-13cc0ebea08d tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.928429 Oct 19 00:58:56.376161 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1495/3111] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:58:56.381668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:56.382946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:56.391205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.392007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.392893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.394039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.394991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.395968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.396774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.397259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.443588 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 HTTP/1.1 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '750d52a9-e30d-44d3-bda1-1c5781c3d165'} Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:58:56.451526 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 00:58:56.455838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:58:56.461503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:58:56.465536 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55eb6907-ceb5-4a39-9049-11439f5e8840 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 404 len: 111 microversion: 2.1 time: 0.085317 Oct 19 00:58:56.467510 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1496/3112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:56 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:58:56.479355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:56.484754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:56.494892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.496116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.496827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.498127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:56.498942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:56.499590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:56.638836 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1002d3f6-0b6b-49f3-806a-cba546b3b183 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "PUT /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1085 microversion: 2.1 time: 0.170188 Oct 19 00:58:56.640106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1497/3113] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:58:56 2022] PUT /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1085 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:56.645571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-455ada72-81bc-4a45-b834-bccbfd58a6c2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:56.646395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-455ada72-81bc-4a45-b834-bccbfd58a6c2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:56.860448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-455ada72-81bc-4a45-b834-bccbfd58a6c2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:56.867744 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-455ada72-81bc-4a45-b834-bccbfd58a6c2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1222 microversion: 2.1 time: 0.226180 Oct 19 00:58:56.872042 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1498/3114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:56 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:56.880540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1664284130", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:58:57.013578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:57.017564 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:57.033373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:58:57.046552 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2d6f7f44-716b-4eaf-a601-acd364090548 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1360 microversion: 2.1 time: 0.695308 Oct 19 00:58:57.053384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1617/3115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:56 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1360 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:57.062071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:57.062705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:57.080775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:57.081602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:57.082235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:57.082991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:57.083650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:57.084238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:57.540568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:57.551387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbd9748e-8d9a-4e14-b9c9-4842a6a09bd1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1511 microversion: 2.1 time: 0.496875 Oct 19 00:58:57.551984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1618/3116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:57 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1511 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:57.575501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:57.576527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:57.593154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:57.598305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:57.599126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:57.601027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:57.602988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:57.615175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:57.994663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:58.035387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-175a74d9-17ef-4cb3-a100-462e7c7938ae tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1511 microversion: 2.1 time: 0.464542 Oct 19 00:58:58.131896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1619/3117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:57 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1511 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:58:58.157772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:58.162018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:58.181787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.182961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.185685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.187271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.192607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.193193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.205573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:58:58.206151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:58:58.206494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:58:58.206910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:58:58.207543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:58:58.224859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.225356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.225802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.226533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.231279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.231279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.277410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:58:58.292975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:58:58.327303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:58:58.335470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:58:58.422597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b081087-e378-4e02-bb14-bf2e4398818a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549287 Oct 19 00:58:58.432803 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1499/3118] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:58:58.437870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:58.438743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:58.441509 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:58:58.447767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.448558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.449184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.450358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.451103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.451735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.676243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:58.706283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b7a0e8a5-cead-4a53-a2b8-9016b816eb13 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1282 microversion: 2.1 time: 0.570564 Oct 19 00:58:58.709089 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1620/3119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:58 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1282 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:58.714802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:58.715616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:58.724108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.736043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.737318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.740546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:58.742788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:58.744424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:58.802932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:58:58.998144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aca7de64-cd4a-40d2-83d9-7387673b417f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 204 len: 0 microversion: 2.1 time: 0.287289 Oct 19 00:58:59.002132 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1621/3120] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:58:58 2022] DELETE /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:58:59.011804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8231ebc-2605-4a2e-9373-845029cbf4cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:59.012595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8231ebc-2605-4a2e-9373-845029cbf4cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:59.061453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:59.070176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5efd65e4-6f76-4987-bfaa-b90bf31b49e5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1545 microversion: 2.1 time: 0.636185 Oct 19 00:58:59.077164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1500/3121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:58 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1545 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:59.082155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:59.085615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:59.101628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.103067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.107564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.108475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.109079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.109756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.280977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8231ebc-2605-4a2e-9373-845029cbf4cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:59.308223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8231ebc-2605-4a2e-9373-845029cbf4cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1215 microversion: 2.1 time: 0.308030 Oct 19 00:58:59.316093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1622/3122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:58 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1215 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:58:59.337732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:59.337977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:59.349996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.356377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.357419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.358573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.360177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.363901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.657780 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f119da54-1dd0-4b35-b410-4f34cdf4cd19 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.324859 Oct 19 00:58:59.658716 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1623/3123] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 00:58:59 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-interface => generated 284 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:58:59.744924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:58:59.778462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:58:59.779143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:58:59.783637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae5060c2-1785-4b85-8664-0ec5afdac5dc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1517 microversion: 2.1 time: 0.704606 Oct 19 00:58:59.790545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.791041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.791586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.792315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:58:59.792825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:58:59.793262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:58:59.798531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1501/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:59 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1517 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:00.343184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:00.354623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:00.375125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:00.376410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:00.381790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:00.383384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:00.384466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:00.385471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:00.466412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:00.484951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6133c5a2-f1e9-49ff-b471-d07d318e7849 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1280 microversion: 2.1 time: 0.750393 Oct 19 00:59:00.492957 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1624/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:58:59 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1280 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:00.732455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:00.751138 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ebf6c70-8aa5-4a05-a223-a0cb0e39ff3c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1275 microversion: 2.1 time: 0.415881 Oct 19 00:59:00.754280 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1502/3126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:00 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1275 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:00.820575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:00.822771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:00.833143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:00.840115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:00.840941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:00.841702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:00.842167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:00.842603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:01.518409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:01.519152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:01.540277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:01.540831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:01.541521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:01.542504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:01.543284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:01.544720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:01.893210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:01.907650 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0bc7b594-d8c0-4311-bcd7-d1ff2e035f8f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1517 microversion: 2.1 time: 1.098390 Oct 19 00:59:01.920657 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1625/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:00 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1517 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:01.921473 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:01.921686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:01.942580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:01.943088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:01.943535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:01.944966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:01.945428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:01.945874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:02.325097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:02.339556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ad0b4a6-50e0-4a83-be65-dbb31af2b409 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.826209 Oct 19 00:59:02.345676 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1503/3128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:01 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:02.358548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c57dd915-27b7-4efe-8d7b-ba0b8ff06c15", "name": "network-vif-deleted", "tag": "b7f1241b-b814-483e-84d8-2503da456f91"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:02.377208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:02.377768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:02.378125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:02.403465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] Creating event network-vif-deleted:b7f1241b-b814-483e-84d8-2503da456f91 for instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 on n-h2-master-1 Oct 19 00:59:02.423185 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1f350524-e711-453d-8b82-80777d0786b1 req-6ba47944-7846-4440-8a6e-bb5bb356e25d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076108 Oct 19 00:59:02.435443 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1504/3129] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:02.782152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:02.798601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17060ed2-3cf2-4bd1-89de-c49e71a756c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1273 microversion: 2.1 time: 0.887717 Oct 19 00:59:02.825426 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1626/3130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:01 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1273 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:02.937894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:02.939082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:02.962769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:02.963499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:02.964100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:02.967998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:02.968937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:02.971072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.075947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.076914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.077517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.078174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:03.165953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:03.179183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d087f6f-fa54-4ce0-8481-63d3126999c6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 200 len: 1319 microversion: 2.1 time: 0.248083 Oct 19 00:59:03.181560 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1505/3131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:02 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:03.364207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:03.364903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:03.385312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.385827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.386502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.387518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.387884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.388501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.826718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:03.827988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:03.835852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.836358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.838162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.851809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.853152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.853859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.870180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:03.885449 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-803a0716-4cbc-4d85-9d22-2bb91529c715 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.525366 Oct 19 00:59:03.886377 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1627/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:03 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:03.942578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c66c11-a25f-4e38-9147-4488c81b7f65", "tag": "31bdd485-52d8-47a9-9b0a-51bb32242328"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:03.956611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:03.958586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:03.959039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:03.995232 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] Creating event network-changed:31bdd485-52d8-47a9-9b0a-51bb32242328 for instance 58c66c11-a25f-4e38-9147-4488c81b7f65 on n-h1-master-1 Oct 19 00:59:04.002296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e716839f-9e0d-4d49-8c31-4e44649a3abf req-2d69f085-5de5-4b8c-b072-413423ed3100 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063428 Oct 19 00:59:04.003230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1628/3133] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:04.212655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:04.213456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:04.224655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:04.225223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:04.226259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:04.226573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:04.227087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:04.228137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:04.295134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 HTTP/1.1 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c57dd915-27b7-4efe-8d7b-ba0b8ff06c15'} Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:04.300498 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 00:59:04.306212 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:04.309401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:04.311147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-281c3277-ceab-49f1-8c14-85e446fa2ab9 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 404 len: 111 microversion: 2.1 time: 0.103800 Oct 19 00:59:04.313322 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1629/3134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:04 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 00:59:04.500254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1293257825", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1d6653c1-03c4-44e2-b509-10cd892d63b1"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:04.591917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] validate_networks() for [('1d6653c1-03c4-44e2-b509-10cd892d63b1', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:59:04.959996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:04.985120 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64501e8d-4286-48d8-816b-0405a48448db tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 1.163083 Oct 19 00:59:04.986032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1506/3135] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:03 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:04.991650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:04.992539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:05.013401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:05.014118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:05.014925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:05.015850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:05.016483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:05.017120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:05.884155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:05.893895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15305967-7d70-4185-a321-c0c4dc6dfae2 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.906564 Oct 19 00:59:05.894925 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1507/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:04 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:06.086854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82fdb697-28a3-4599-b19d-614c92f69281 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-583491942", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:06.095084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-82fdb697-28a3-4599-b19d-614c92f69281 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] HTTP exception thrown: min_count must be <= max_count Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82fdb697-28a3-4599-b19d-614c92f69281 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Request method failure captured: Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 183 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0vYng_73BKbC0xoX2Rlb2cncaY6-nNwUXpLtYonwHf6fEMdc8QJQuqRf9zhh7JNGZbuJV-90A50vUn0ohlkjBLCtr_SKPFpjXoTtrSFeRG-MiXiU5bBpfC3khXh003EGwoLvAlPrIfQpVf6ntQKgyXwqaBM8LNgmSKuZmYhbdfomFI Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef9dd5beb6746f893862247176d137b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}] Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d022dcfaa1e949118cd27a3a6217092d Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-583491942", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: exception: min_count must be <= max_count Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-583491942', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 19 00:59:06.099793 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.108265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82fdb697-28a3-4599-b19d-614c92f69281 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Returning 400 to user: min_count must be <= max_count {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:06.109754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82fdb697-28a3-4599-b19d-614c92f69281 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.213284 Oct 19 00:59:06.110729 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1508/3137] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 215 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 00:59:06.121847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:06.124741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:06.136977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.137940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.138615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.141114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.142158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.142999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.148411 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:06.546237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:06.547338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:06.548066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:06.549087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:06.549763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:06.569819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.572173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.572955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.574125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.576215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.577839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.613481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:06.620469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Getting quotas for user c9ac716a6af441a4bc02d8ef11f81487 and project 4dd9caff7d2f4782934111951d0c42fb. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:06.635515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:06.646735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:06.675435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:06.689210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1d918eb-38ba-4a68-9b8e-19243d1676be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 0.576586 Oct 19 00:59:06.690053 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1509/3138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:06 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:06.715004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b95b49b0-6d45-43ea-81d1-053b16533313", "tag": "600ec28a-4f87-40f9-9e9b-c768b8c6780b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:06.730362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.731107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.731716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.748841 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] Creating event network-changed:600ec28a-4f87-40f9-9e9b-c768b8c6780b for instance b95b49b0-6d45-43ea-81d1-053b16533313 on n-h2-master-1 Oct 19 00:59:06.754260 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c36d04b4-4fd2-4cfc-967c-192bf708841d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.255122 Oct 19 00:59:06.755564 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0519374f-ace0-49a0-a31a-86e259479778 req-30df4ddc-cf96-41a3-baff-ffa4564b2840 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047472 Oct 19 00:59:06.756672 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1510/3140] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:06.756801 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1630/3140] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:59:06.763854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69fb29e-5644-4c56-bfd8-8a26363863c6", "tag": "2941f79c-7fb8-4d2f-976a-8d48d378adf4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:06.777284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21584c70-c067-4ac3-83ac-76bb09b38eaa tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-280753197", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "max_count": 0}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:06.778543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.779053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.779851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.794707 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] Creating event network-changed:2941f79c-7fb8-4d2f-976a-8d48d378adf4 for instance e69fb29e-5644-4c56-bfd8-8a26363863c6 on n-h1-master-1 Oct 19 00:59:06.803452 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-20cf1cea-7227-42d9-ac85-91e5e5ea3bf2 req-bf836886-8b4e-4c07-b16a-107ba2c5f2ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043911 Oct 19 00:59:06.805004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1511/3141] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21584c70-c067-4ac3-83ac-76bb09b38eaa tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Request method failure captured: Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 167 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0vYng_73BKbC0xoX2Rlb2cncaY6-nNwUXpLtYonwHf6fEMdc8QJQuqRf9zhh7JNGZbuJV-90A50vUn0ohlkjBLCtr_SKPFpjXoTtrSFeRG-MiXiU5bBpfC3khXh003EGwoLvAlPrIfQpVf6ntQKgyXwqaBM8LNgmSKuZmYhbdfomFI Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef9dd5beb6746f893862247176d137b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}] Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d022dcfaa1e949118cd27a3a6217092d Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-280753197", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "max_count": 0}} Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-280753197', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'max_count': 0}}} Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 0 Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:06.811270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:06.817033 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.818262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b2554e31-14a6-43a6-9520-2c731939cce0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:06.818262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b2554e31-14a6-43a6-9520-2c731939cce0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:06.821472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21584c70-c067-4ac3-83ac-76bb09b38eaa tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:06.823639 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21584c70-c067-4ac3-83ac-76bb09b38eaa tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.065443 Oct 19 00:59:06.826040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1631/3142] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:06.912240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7e94614-f0f2-4d9f-afd8-c74ba830b684 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1086454855", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "max_count": 2.5}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7e94614-f0f2-4d9f-afd8-c74ba830b684 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Request method failure captured: Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 170 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0vYng_73BKbC0xoX2Rlb2cncaY6-nNwUXpLtYonwHf6fEMdc8QJQuqRf9zhh7JNGZbuJV-90A50vUn0ohlkjBLCtr_SKPFpjXoTtrSFeRG-MiXiU5bBpfC3khXh003EGwoLvAlPrIfQpVf6ntQKgyXwqaBM8LNgmSKuZmYhbdfomFI Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef9dd5beb6746f893862247176d137b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}] Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d022dcfaa1e949118cd27a3a6217092d Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1086454855", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "max_count": 2.5}} Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1086454855', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'max_count': 2.5}}} Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:06.920695 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:06.925092 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:06.927995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7e94614-f0f2-4d9f-afd8-c74ba830b684 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:06.929810 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7e94614-f0f2-4d9f-afd8-c74ba830b684 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021806 Oct 19 00:59:06.932808 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1632/3143] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:06 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 00:59:06.950518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:06.953124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:06.970965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.971677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.973210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.974060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:06.975086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:06.976005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:06.996457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b2554e31-14a6-43a6-9520-2c731939cce0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:07.011006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b2554e31-14a6-43a6-9520-2c731939cce0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1209 microversion: 2.1 time: 0.203669 Oct 19 00:59:07.011690 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1512/3144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:06 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1209 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:07.044369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cae4642-2ec5-4d7d-ba59-9684b413a7e0 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2102684262", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 0}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cae4642-2ec5-4d7d-ba59-9684b413a7e0 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Request method failure captured: Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 168 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0vYng_73BKbC0xoX2Rlb2cncaY6-nNwUXpLtYonwHf6fEMdc8QJQuqRf9zhh7JNGZbuJV-90A50vUn0ohlkjBLCtr_SKPFpjXoTtrSFeRG-MiXiU5bBpfC3khXh003EGwoLvAlPrIfQpVf6ntQKgyXwqaBM8LNgmSKuZmYhbdfomFI Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef9dd5beb6746f893862247176d137b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}] Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d022dcfaa1e949118cd27a3a6217092d Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2102684262", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 0}} Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2102684262', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'min_count': 0}}} Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 0 Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:07.050047 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cae4642-2ec5-4d7d-ba59-9684b413a7e0 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:07.058497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0cae4642-2ec5-4d7d-ba59-9684b413a7e0 tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.013179 Oct 19 00:59:07.064196 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1513/3145] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:07.149170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-891b01a0-d99d-4cd8-bf6f-161cada588bf tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1048530842", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 2.5}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-891b01a0-d99d-4cd8-bf6f-161cada588bf tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Request method failure captured: Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 170 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0vYng_73BKbC0xoX2Rlb2cncaY6-nNwUXpLtYonwHf6fEMdc8QJQuqRf9zhh7JNGZbuJV-90A50vUn0ohlkjBLCtr_SKPFpjXoTtrSFeRG-MiXiU5bBpfC3khXh003EGwoLvAlPrIfQpVf6ntQKgyXwqaBM8LNgmSKuZmYhbdfomFI Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cef9dd5beb6746f893862247176d137b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cef9dd5beb6746f893862247176d137b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cef9dd5beb6746f893862247176d137b"}]}] Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: cef9dd5beb6746f893862247176d137b Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1704441091 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d022dcfaa1e949118cd27a3a6217092d Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1704441091-project Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1048530842", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "min_count": 2.5}} Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1048530842', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'min_count': 2.5}}} Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 2.5 Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:07.164096 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-891b01a0-d99d-4cd8-bf6f-161cada588bf tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:07.168476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-891b01a0-d99d-4cd8-bf6f-161cada588bf tempest-MultipleCreateNegativeTestJSON-1704441091 tempest-MultipleCreateNegativeTestJSON-1704441091-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021762 Oct 19 00:59:07.192812 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1514/3146] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:07.370508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:07.382057 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f632433f-2b2f-4ffc-8806-457dffe926d7 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.442685 Oct 19 00:59:07.386792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1633/3147] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:06 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:07.724146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:07.725880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:07.737794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:07.738444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:07.740709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:07.741747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:07.742367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:07.743857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:08.038140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:08.038876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:08.063857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:08.064363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:08.064844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:08.065564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:08.066026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:08.066460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:08.253431 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:08.357814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:08.373468 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d82521ab-189c-4328-b8ba-3c609b984b00 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1261 microversion: 2.1 time: 0.340441 Oct 19 00:59:08.377130 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1634/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:08 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1261 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:08.411072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:08.413293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:08.426019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:08.428908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:08.429508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:08.430406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:08.431245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:08.431797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:09.009621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:09.023106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba62a4e0-587f-4f89-b2a2-b5d880367cf8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 1.307776 Oct 19 00:59:09.024507 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1515/3149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:07 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:09.350562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:09.361207 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d7a4e8f5-d422-4ae4-b860-6c57fe73c9df tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.954507 Oct 19 00:59:09.362701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1635/3150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:08 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:09.400143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:09.401652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:09.409148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:09.410694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:09.411532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:09.413809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:09.414537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:09.416056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:09.609194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:09.632118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8aacea3-a1a9-4024-9492-cceeeb4ddd0e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1267 microversion: 2.1 time: 0.236324 Oct 19 00:59:09.641171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1516/3151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:09 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1267 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:10.049982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:10.051760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:10.079076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.079602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.080054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:10.084478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.085847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.087881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:10.384991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:10.385615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:10.402539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.403613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.403613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:10.404820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.404820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.405191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:10.791966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:10.806518 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b5a1296-6016-484a-8db5-b2478ab6f3fa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 0.763057 Oct 19 00:59:10.809578 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1636/3152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:10 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:10.824185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:10.826544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:10.845088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.849329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.849953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:10.851687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:10.852403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:10.853278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.176124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:11.192740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5c5e5db8-7ddd-466c-9659-0af0499d7863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1267 microversion: 2.1 time: 0.381474 Oct 19 00:59:11.194659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1637/3153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:10 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1267 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:11.295556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95b49b0-6d45-43ea-81d1-053b16533313", "name": "network-vif-plugged", "status": "completed", "tag": "600ec28a-4f87-40f9-9e9b-c768b8c6780b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:11.312165 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:11.316671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:11.319812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:11.326069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.334332 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:11.362800 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] Creating event network-vif-plugged:600ec28a-4f87-40f9-9e9b-c768b8c6780b for instance b95b49b0-6d45-43ea-81d1-053b16533313 on n-h2-master-1 Oct 19 00:59:11.364035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:11.375396 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d3cb55a-a0c0-4551-826c-ae30a1cf4431 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.994490 Oct 19 00:59:11.375946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-32054666-8ad8-4641-a17c-e4f4396180c4 req-2f5bd389-0e7d-4a75-b32f-9882f9f74d32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081522 Oct 19 00:59:11.376651 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1517/3154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:10 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:11.377429 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1638/3155] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:11.642782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-115343947", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:11.741919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:11.741919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:11.741919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:11.742334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:11.745362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:11.767657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:11.768430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:11.769058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.769994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:11.770456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:11.770891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.811429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Getting quotas for project 743f53c93e3a415494d68d463e32f83a. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:11.826616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Getting quotas for user 3c8c797ddeb546fd932fd1e6b392304b and project 743f53c93e3a415494d68d463e32f83a. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:11.837469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:11.838727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:11.843793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:11.846715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:11.852640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:11.853162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:11.853610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.864761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:11.865714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:11.866171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:11.929692 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20a7944c-930d-47b2-b537-68a480fbd7bc tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.429121 Oct 19 00:59:11.942279 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1518/3156] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 00:59:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 00:59:11.950807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:11.951674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:12.170204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:12.180016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:12.182055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:12.183221 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fccfc8d-e075-4db2-a330-cb71f585cf30 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1280 microversion: 2.47 time: 0.239863 Oct 19 00:59:12.183788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1519/3157] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:11 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1280 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:59:12.230335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:12.230971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:12.244556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:12.253070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:12.253612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:12.254374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:12.254850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:12.255311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:12.825769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:12.839844 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9035c19c-d49f-409d-b52b-07371ce8d6ed tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 1.007844 Oct 19 00:59:12.874323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1639/3158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:11 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:12.902256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:12.905632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:12.918323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:12.919779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:12.927154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:12.928532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:12.929303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:12.931647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:13.322582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:13.342632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-781fd3bc-3fe6-4b7a-aff5-b7ac84437cbf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 1.120431 Oct 19 00:59:13.347882 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1520/3159] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:12 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:13.353828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:13.356243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:13.365685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:13.366545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:13.367226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:13.369688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:13.370435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:13.371020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:13.462491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:13.501312 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1a0640ec-605c-4eaa-b436-5023ddf06d22 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1322 microversion: 2.1 time: 0.617936 Oct 19 00:59:13.518455 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1640/3160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:12 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:13.597812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:13.610580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:13.618727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:13.620275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55558fdf-5f49-4833-88c2-65fe78883eb5 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1332 microversion: 2.47 time: 0.270852 Oct 19 00:59:13.621162 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1521/3161] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:13 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1332 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:59:13.865081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:13.866426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:13.874226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:13.875642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:13.876293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:13.877271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:13.877934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:13.878758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.052791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] Calling method '.version_select at 0x7f2af4853280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:14.328747 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6c77e3c1-1210-47ff-bdfd-6ce496427424 could not be found", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 00:59:14.330779 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] HTTP exception thrown: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] Request method failure captured: Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/os-floating-ips/6c77e3c1-1210-47ff-bdfd-6ce496427424 HTTP/1.1 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0vhSvFimCZ7FkpRHwFx9WGO2zdvl71Z-yImY5YkHoBoOOnY5ooUtCB_PvHaOXeqB-8vSJo86bwUrhR8tr5PCosupD-c5xL2NIRTVHNjJo4lc1EeiDZAXEB1T6Tho8tFF6vhhJ8D4zXnr8SPTpZQy0Jx-neGEhgeCP02u8HIZ0z97kY Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 52bbc99b42784505908f1f9d2f1498d8 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-595229833 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_52bbc99b42784505908f1f9d2f1498d8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52bbc99b42784505908f1f9d2f1498d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/52bbc99b42784505908f1f9d2f1498d8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/52bbc99b42784505908f1f9d2f1498d8"}]}] Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-595229833 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 52bbc99b42784505908f1f9d2f1498d8 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-595229833 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-595229833-project Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ce909e8b04834269b0194db091d7a777 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-595229833-project Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: exception: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '6c77e3c1-1210-47ff-bdfd-6ce496427424'} Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6c77e3c1-1210-47ff-bdfd-6ce496427424 could not be found Oct 19 00:59:14.334593 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f158e534-d044-48bd-ba82-b2ffd583985f'] Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424. Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424 Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424 Oct 19 00:59:14.338764 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:14.342159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] Returning 404 to user: Floating IP not found for ID 6c77e3c1-1210-47ff-bdfd-6ce496427424 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:14.343611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80411c62-16b6-47f0-a8f0-68231c33167a tempest-FloatingIPDetailsNegativeTestJSON-595229833 tempest-FloatingIPDetailsNegativeTestJSON-595229833-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/6c77e3c1-1210-47ff-bdfd-6ce496427424" status: 404 len: 111 microversion: 2.1 time: 0.376529 Oct 19 00:59:14.344746 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1522/3162] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:13 2022] GET /compute/v2.1/os-floating-ips/6c77e3c1-1210-47ff-bdfd-6ce496427424 => generated 111 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:14.380186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:14.380868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:14.391452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.391964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.392423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.396146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.397608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.397866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.613510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:14.626425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d7a10802-c602-4eb5-a011-e666eb03a996 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 0.766683 Oct 19 00:59:14.629019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1641/3163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:13 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:14.642608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:14.643539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:14.664341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.666419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.667149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.669222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.669961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.670663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.902238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:14.913519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d9ee6123-1f3c-49e4-99b5-ef0d6fa52d8d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.542105 Oct 19 00:59:14.934252 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1523/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:14 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:14.940478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:14.953704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:14.961056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.967418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.968166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:14.968979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:14.969457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:14.973471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.200338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:15.219288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:15.224913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:15.227698 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9673eb9-ad4d-4eb7-8e98-bd705180abde tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1338 microversion: 2.47 time: 0.291428 Oct 19 00:59:15.233193 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1524/3165] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:14 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1338 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:59:15.332011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69fb29e-5644-4c56-bfd8-8a26363863c6", "name": "network-vif-plugged", "status": "completed", "tag": "2941f79c-7fb8-4d2f-976a-8d48d378adf4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:15.357311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.359999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.360449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.387074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] Creating event network-vif-plugged:2941f79c-7fb8-4d2f-976a-8d48d378adf4 for instance e69fb29e-5644-4c56-bfd8-8a26363863c6 on n-h1-master-1 Oct 19 00:59:15.397157 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ac9b8a39-17fa-4ff9-a84b-7a7237280bca req-5d63f1ba-f53f-4464-a5ef-8c9053487cd2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069968 Oct 19 00:59:15.398449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1525/3166] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:15.460507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:15.472783 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4848f698-2558-4404-944b-c1e93b59f6a9 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1472 microversion: 2.1 time: 0.837960 Oct 19 00:59:15.476111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1642/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:14 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1472 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:15.505248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:15.506816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:15.516081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.516905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.524779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.526392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.529706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.530277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.569297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lazy-loading 'flavor' on Instance uuid b95b49b0-6d45-43ea-81d1-053b16533313 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:15.657047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:15.657845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:15.683808 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8718e2c-3ed8-48f7-9934-0b15270fa29e tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313/action" status: 202 len: 0 microversion: 2.1 time: 0.175431 Oct 19 00:59:15.687467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1526/3168] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:15 2022] POST /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:59:15.712814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.715844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.716333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.722346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.724778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.725212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:15.725794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.728280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:15.735737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.736550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.737251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:15.738217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:15.738895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:15.739387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:16.593429 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:16.630033 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:16.652025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:16.664827 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c0e8011-ab8a-41bc-b85b-d887ac8513ac tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1315 microversion: 2.1 time: 1.014555 Oct 19 00:59:16.665768 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1643/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:15 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:16.671546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:16.672443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:16.679472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:16.681351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:16.681915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:16.683195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:16.684232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:16.684822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:16.738989 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98de47ae-8d2a-4530-b3ac-11538d08a542 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1631 microversion: 2.1 time: 1.034945 Oct 19 00:59:16.742966 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1527/3170] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:15 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1631 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:16.762826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:16.765140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:16.772724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:16.773668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:16.774524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:16.775515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:16.776216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:16.776922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:16.965857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:16.981454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:16.994777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:16.996927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97af9094-514c-4892-a17f-8902a5390fca tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1359 microversion: 2.47 time: 0.250597 Oct 19 00:59:16.999141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1528/3171] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:16 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:59:17.009049 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac00e801-02bc-4213-876f-0fb173c23b04", "tag": "69bc52c1-2c85-49c6-854c-f807f7dd09f3"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:17.032496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.033342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.034267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.063005 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] Creating event network-changed:69bc52c1-2c85-49c6-854c-f807f7dd09f3 for instance ac00e801-02bc-4213-876f-0fb173c23b04 on n-h2-master-1 Oct 19 00:59:17.090341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff4d3a8c-9d48-4104-9cd3-6012e030e560 req-f377934b-98cb-4848-ba3e-49eda03885af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088416 Oct 19 00:59:17.096592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1529/3172] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:17.104220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1956727237"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:17.107829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:17.115527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.116230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.116954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.118405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.119043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.119647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.136820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:17.198001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00510a40-c667-46c4-b4c0-96a1d0175891 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.529657 Oct 19 00:59:17.220264 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1644/3173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:16 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:17.603092 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d15f199-817a-4206-ae43-59975fa58b60 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "POST /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f/action" status: 202 len: 52 microversion: 2.47 time: 0.503294 Oct 19 00:59:17.609300 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1530/3174] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 00:59:17 2022] POST /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f/action => generated 52 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 19 00:59:17.626846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:17.635228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:17.649600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.651403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.652764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.654135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.657056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.663081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.702696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:17.710207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:17.731779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.735747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.736958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.743326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:17.747895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:17.748824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:17.780154 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:17.792566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:17.978665 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0fbaaf08-73d8-497c-920d-4a1da1b41bf9 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 204 len: 0 microversion: 2.47 time: 0.364961 Oct 19 00:59:17.982455 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1645/3175] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:17 2022] DELETE /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 00:59:17.997689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:18.003561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:18.024600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:18.025144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:18.025586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:18.026329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:18.026789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:18.031378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:18.954716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:18.965875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b223fd5-4320-4c75-8d0d-4111b1fe9f7d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1502 microversion: 2.1 time: 1.273096 Oct 19 00:59:18.972063 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1531/3176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:17 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1502 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:18.978347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:18.978975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:18.987215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:18.988002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:18.988879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:18.989920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:18.990590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:18.991222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.163710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9aa601f7-5f88-48a1-a921-e36f8bb8f9e7 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1614 microversion: 2.1 time: 1.179940 Oct 19 00:59:19.167102 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1646/3177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:17 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1614 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:19.179246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:19.182257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:19.198445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.201415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.202019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.205963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.206598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.207045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.288682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:19.307820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:19.310359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:19.312669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5bc1826-991e-41c7-a431-21e34fe4ae08 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1365 microversion: 2.47 time: 0.339222 Oct 19 00:59:19.319957 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1532/3178] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:18 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1365 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 00:59:19.331255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:19.335223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:19.355541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.358347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.359201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.370050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.370959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.371644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.501196 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] HTTP exception thrown: Cannot 'migrate' instance b95b49b0-6d45-43ea-81d1-053b16533313 while it is in vm_state suspended Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Request method failure captured: Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313/action HTTP/1.1 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 15 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxUKQUPULaT4ODkPTlr0MmRcj1DyaK61ENk93_cEGjFLtInf4UJSdEbwoy3VEfESuYqe3EbB1tkRFVNsM7sRIqbtenctod5YUzjPfafof0nOUrpHcusp_ejCEiMZx42Eqwq9m7WOe-VPbdP8aNBSNtv-tlDwK_2S9X2hJK40cAf_8 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aeb5e6dd8d6c46fab43fa07fa48cd99c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}] Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 59b1d506d2414984abe362472df8bcc2 Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: {"migrate": {}} Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'migrate' instance b95b49b0-6d45-43ea-81d1-053b16533313 while it is in vm_state suspended Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b95b49b0-6d45-43ea-81d1-053b16533313', 'body': {'migrate': {}}} Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b95b49b0-6d45-43ea-81d1-053b16533313 in vm_state suspended. Cannot resize while the instance is in this state. Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:19.503586 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b95b49b0-6d45-43ea-81d1-053b16533313 while it is in vm_state suspended Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b95b49b0-6d45-43ea-81d1-053b16533313 while it is in vm_state suspended Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Returning 409 to user: Cannot 'migrate' instance b95b49b0-6d45-43ea-81d1-053b16533313 while it is in vm_state suspended {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:19.508398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c11648d3-5f03-4c00-b247-1524dfae5cff tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313/action" status: 409 len: 148 microversion: 2.1 time: 0.183872 Oct 19 00:59:19.511913 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1533/3179] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:19 2022] POST /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313/action => generated 148 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 00:59:19.525010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1338b46-a804-4f43-8487-36b19e9a2ee2 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1338b46-a804-4f43-8487-36b19e9a2ee2 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Request method failure captured: Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action HTTP/1.1 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 39 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxUKQUPULaT4ODkPTlr0MmRcj1DyaK61ENk93_cEGjFLtInf4UJSdEbwoy3VEfESuYqe3EbB1tkRFVNsM7sRIqbtenctod5YUzjPfafof0nOUrpHcusp_ejCEiMZx42Eqwq9m7WOe-VPbdP8aNBSNtv-tlDwK_2S9X2hJK40cAf_8 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aeb5e6dd8d6c46fab43fa07fa48cd99c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}] Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 59b1d506d2414984abe362472df8bcc2 Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: {"os-resetState": {"state": "invalid"}} Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '68eeaef1-1894-4772-8682-5e936986fcea', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:19.529582 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 19 00:59:19.533870 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.538156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1338b46-a804-4f43-8487-36b19e9a2ee2 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:19.539069 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d1338b46-a804-4f43-8487-36b19e9a2ee2 tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action" status: 400 len: 144 microversion: 2.1 time: 0.026106 Oct 19 00:59:19.540206 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1534/3180] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:19 2022] POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:19.565168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dfeb096-718a-47e2-97ff-46ad3c3e921b tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dfeb096-718a-47e2-97ff-46ad3c3e921b tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Request method failure captured: Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action HTTP/1.1 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 31 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxUKQUPULaT4ODkPTlr0MmRcj1DyaK61ENk93_cEGjFLtInf4UJSdEbwoy3VEfESuYqe3EbB1tkRFVNsM7sRIqbtenctod5YUzjPfafof0nOUrpHcusp_ejCEiMZx42Eqwq9m7WOe-VPbdP8aNBSNtv-tlDwK_2S9X2hJK40cAf_8 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aeb5e6dd8d6c46fab43fa07fa48cd99c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}] Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 59b1d506d2414984abe362472df8bcc2 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: {"os-resetState": {"state": 1}} Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '68eeaef1-1894-4772-8682-5e936986fcea', 'body': {'os-resetState': {'state': 1}}} Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 1 Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 00:59:19.576149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 19 00:59:19.581258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.586445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dfeb096-718a-47e2-97ff-46ad3c3e921b tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:19.588715 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4dfeb096-718a-47e2-97ff-46ad3c3e921b tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action" status: 400 len: 120 microversion: 2.1 time: 0.038549 Oct 19 00:59:19.590834 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1535/3181] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:19 2022] POST /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea/action => generated 120 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:19.605075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:19.607654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Failed to fetch instance by id 999 {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 00:59:19.608743 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Request method failure captured: Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 37 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxUKQUPULaT4ODkPTlr0MmRcj1DyaK61ENk93_cEGjFLtInf4UJSdEbwoy3VEfESuYqe3EbB1tkRFVNsM7sRIqbtenctod5YUzjPfafof0nOUrpHcusp_ejCEiMZx42Eqwq9m7WOe-VPbdP8aNBSNtv-tlDwK_2S9X2hJK40cAf_8 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aeb5e6dd8d6c46fab43fa07fa48cd99c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aeb5e6dd8d6c46fab43fa07fa48cd99c"}]}] Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: aeb5e6dd8d6c46fab43fa07fa48cd99c Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1989508372 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 59b1d506d2414984abe362472df8bcc2 Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1989508372-project-admin Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: {"os-resetState": {"state": "error"}} Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 999 could not be found. Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:19.618297 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:19.625566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:19.625566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 00:59:19.625566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:19.636991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:19.639125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8181c411-ff01-40e8-a1bd-2505d2dc18ec tempest-ServersAdminNegativeTestJSON-1989508372 tempest-ServersAdminNegativeTestJSON-1989508372-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.043978 Oct 19 00:59:19.649856 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1536/3182] 10.222.0.27 () {60 vars in 1179 bytes} [Wed Oct 19 00:59:19 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 00:59:19.666156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:19.669437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:19.689136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.689917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.691509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.692500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:19.693821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:19.696845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:19.703407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:19.733180 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db6afc12-a0cb-4bf6-b6b4-c5abd8e94673 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.562299 Oct 19 00:59:19.733819 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1647/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:19 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:19.775023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:20.001133 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d77df97f-355e-4842-a6f3-5b9e8f29c658 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 204 len: 0 microversion: 2.1 time: 0.349581 Oct 19 00:59:20.002623 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1537/3184] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:59:19 2022] DELETE /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:20.011783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:20.012414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:20.031035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.031543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.031990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:20.034689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.035211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.035641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:20.353039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:20.353687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:20.375007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.375777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.379982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:20.380818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.383724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.384397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:20.521367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:20.534916 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a0e845d-c576-4488-aaff-ee3ce0d76d83 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1469 microversion: 2.1 time: 0.527943 Oct 19 00:59:20.538633 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1648/3185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:20 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1469 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:20.598493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:20.615169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:20.616669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:20.618093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5aa1fe8-bc28-49ec-bafe-141ac7fe968f tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1365 microversion: 2.47 time: 0.271224 Oct 19 00:59:20.619989 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1538/3186] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:20 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:59:20.761503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:20.762613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:20.785973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.786478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.788928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:20.790253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:20.790735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:20.791173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.371112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:21.384327 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-05a189ee-9e7a-4cc2-8766-b7816f40cb19 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.625932 Oct 19 00:59:21.386658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1649/3187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:20 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:21.562016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:21.562799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:21.571230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.571841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.572551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.573411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.573978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.574771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.645648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:21.647136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:21.666875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.670556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.671305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.672287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.673342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.675274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.792761 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:21.828494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:21.845859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:21.852366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:21.855549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-655acc1e-a9a4-4b83-9c2e-73c993ee9308 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1365 microversion: 2.47 time: 0.213172 Oct 19 00:59:21.868644 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1650/3188] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:21 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:59:21.880096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d2f4a73-88ab-4f2a-b5be-34c3e1eb4503"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:21.882567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:21.890271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.894555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.895593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:21.896493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:21.897000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:21.898304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.014110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:22.044427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0bd7a846-0598-42d9-8fb6-50b0b3541e10 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1469 microversion: 2.1 time: 0.485392 Oct 19 00:59:22.056701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1539/3189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:21 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:22.416479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:22.418820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:22.424032 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=24 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:22.431756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:22.437269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:22.438118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.438935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:22.439539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:22.440809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.452740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d04a1420-64fe-4190-9107-794472062e5b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578288 Oct 19 00:59:22.458116 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1651/3190] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 00:59:21 2022] POST /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6/os-volume_attachments => generated 194 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:22.887508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:22.888212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:22.909630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:22.910133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:22.910584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.915025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:22.915574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:22.916033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.970171 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:22.984330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:22.998259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:22.998756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:22.999200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:22.999655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lazy-loading 'fault' on Instance uuid e308c9db-5ea5-4dc8-b93a-55321237a09f {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:23.012775 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f85ac46-7d59-4516-995e-05ca2430d5bf tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.605368 Oct 19 00:59:23.014880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1540/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:22 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:23.077269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:23.084128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:23.085005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:23.087848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:23.097419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3c8c797ddeb546fd932fd1e6b392304b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '743f53c93e3a415494d68d463e32f83a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:23.098687 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ed9d592f-6c32-4875-a093-d18406334fe7 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 200 len: 1370 microversion: 2.47 time: 0.217725 Oct 19 00:59:23.100111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:23.100873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:23.103422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:23.104699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:23.105375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:23.105975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:23.108975 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1652/3192] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:22 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 00:59:23.603007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:23.618624 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20eb8da0-dc8d-4ce5-9db0-ac857a48f01a tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1469 microversion: 2.1 time: 0.539270 Oct 19 00:59:23.619254 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1541/3193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:23 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1469 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:24.035423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:24.036736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:24.055480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.061050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.063167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.064126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.066807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.067520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.130475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:24.131623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] [instance: e308c9db-5ea5-4dc8-b93a-55321237a09f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:24.146148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.146656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.150823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.154635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.156008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.158915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.192365 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] HTTP exception thrown: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Request method failure captured: Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f HTTP/1.1 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0vfPEzFYhVR8hMpJHscB3CuslCgyZikCAEN9UIse7sQ2Z_DfNgWSPoO6sI3lO7DvGiszCCbnWX9cMxfhcs87LbuzZ7lqRBFnadS7jtzmjAAodaGQvAkpuIt8Tsg2e-UTIwvuLflLKxG5zPuTRgcGrafnddhkIkURlTz91mUUInT9Vw Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 743f53c93e3a415494d68d463e32f83a Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAaction247Test-1878495152 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_743f53c93e3a415494d68d463e32f83a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/743f53c93e3a415494d68d463e32f83a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/743f53c93e3a415494d68d463e32f83a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/743f53c93e3a415494d68d463e32f83a"}]}] Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAaction247Test-1878495152 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 743f53c93e3a415494d68d463e32f83a Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAaction247Test-1878495152 Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAaction247Test-1878495152-project Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 3c8c797ddeb546fd932fd1e6b392304b Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAaction247Test-1878495152-project Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e308c9db-5ea5-4dc8-b93a-55321237a09f'} Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:24.203160 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. Oct 19 00:59:24.209597 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:24.214218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] Returning 404 to user: Instance e308c9db-5ea5-4dc8-b93a-55321237a09f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:24.215399 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6010548a-97e7-4217-a2a7-e1c764ca0899 tempest-ServersAaction247Test-1878495152 tempest-ServersAaction247Test-1878495152-project] 10.222.0.27 "GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f" status: 404 len: 111 microversion: 2.47 time: 0.089239 Oct 19 00:59:24.216186 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1542/3194] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 00:59:24 2022] GET /compute/v2.1/servers/e308c9db-5ea5-4dc8-b93a-55321237a09f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 00:59:24.426219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:24.435778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dff4697c-2cb1-4f28-a3a4-cf67111be437 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.404285 Oct 19 00:59:24.440908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1653/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:24 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:24.651892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:24.653163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:24.660820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95b49b0-6d45-43ea-81d1-053b16533313", "name": "network-vif-deleted", "tag": "600ec28a-4f87-40f9-9e9b-c768b8c6780b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:24.685343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.685773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.686220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.686940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.687395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.694761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.702083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.702597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.703048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.748422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] Creating event network-vif-deleted:600ec28a-4f87-40f9-9e9b-c768b8c6780b for instance b95b49b0-6d45-43ea-81d1-053b16533313 on n-h2-master-1 Oct 19 00:59:24.768581 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-26bdca6b-9159-4bae-a874-1f513654f33b req-8e2e26f9-970d-460e-a744-2b5451524005 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.548144 Oct 19 00:59:24.770342 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1543/3196] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:24.791339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac00e801-02bc-4213-876f-0fb173c23b04", "name": "network-vif-plugged", "status": "completed", "tag": "69bc52c1-2c85-49c6-854c-f807f7dd09f3"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:24.808543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.810738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.811195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.811665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lazy-loading 'fault' on Instance uuid b95b49b0-6d45-43ea-81d1-053b16533313 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:24.821108 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:24.828998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:24.834198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:24.834198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:24.871712 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] Creating event network-vif-plugged:69bc52c1-2c85-49c6-854c-f807f7dd09f3 for instance ac00e801-02bc-4213-876f-0fb173c23b04 on n-h2-master-1 Oct 19 00:59:24.886261 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-becf7c73-ea9d-4028-8d6e-6708c68cb069 req-940c97de-aa15-41e1-8a5d-5dcf4b6b560b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113039 Oct 19 00:59:24.888709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1544/3197] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:25.095649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:25.107248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6694cad1-c352-46a1-b21f-46f1862c6668 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 200 len: 1312 microversion: 2.1 time: 0.462925 Oct 19 00:59:25.108255 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1654/3198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:24 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 1312 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:25.470061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:25.471251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:25.482922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:25.485015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:25.486792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:25.488086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:25.490993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:25.492027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.069062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:26.085246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4b092d3-3a9b-4202-b873-5070f512ec7e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1309 microversion: 2.1 time: 0.620295 Oct 19 00:59:26.099894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1545/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:25 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1309 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:26.136175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:26.137451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: b95b49b0-6d45-43ea-81d1-053b16533313] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:26.150996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.152825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.153524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.154942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.156324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.157699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.213105 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] HTTP exception thrown: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Request method failure captured: Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 HTTP/1.1 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uwtFaju53tY_rfVUO4oghVnCyi5V9Pk-FXqm-XqTziq2Lb3ORbMvr4Sj8CQG4YaxiKr7_B2hLp-vPq8x4QrWawTpa7I7m-Wn5pjTh1wYHXEETGUnF8VHt5PYI7FgkPxtOMTJFM5kuCNlirOQefxAuvFMGhnfjntuAFHziodZ3aEkI Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 413a1c08324d4c1d8829fe25c1f15c09 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_413a1c08324d4c1d8829fe25c1f15c09", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/413a1c08324d4c1d8829fe25c1f15c09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/413a1c08324d4c1d8829fe25c1f15c09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/413a1c08324d4c1d8829fe25c1f15c09"}]}] Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 413a1c08324d4c1d8829fe25c1f15c09 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminNegativeTestJSON-991347483-project Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d1f94c167c854cffb1ef9c36a278620d Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminNegativeTestJSON-991347483-project Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b95b49b0-6d45-43ea-81d1-053b16533313'} Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:26.216601 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. Oct 19 00:59:26.221172 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:26.233240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Returning 404 to user: Instance b95b49b0-6d45-43ea-81d1-053b16533313 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:26.234516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-969d2e5f-325f-4928-839c-2c33e4580de4 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313" status: 404 len: 111 microversion: 2.1 time: 0.103713 Oct 19 00:59:26.239233 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1655/3200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:26 2022] GET /compute/v2.1/servers/b95b49b0-6d45-43ea-81d1-053b16533313 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:26.249120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:26.249711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:26.262349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.262910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.263372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.264124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.264595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.267239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.354532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:26.569574 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30e54114-660f-421e-a5a7-325c7f8b7e7e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 204 len: 0 microversion: 2.1 time: 0.325029 Oct 19 00:59:26.575090 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1546/3201] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:59:26 2022] DELETE /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:26.580230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:26.589047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:26.604651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.607120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.607714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.611383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:26.612021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:26.612680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:26.953545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:26.987653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91291e7e-3953-49d3-abb2-55c194047f43 tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1476 microversion: 2.1 time: 0.405024 Oct 19 00:59:26.990759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1656/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:26 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:27.115691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:27.116698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:27.132321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.138053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.141546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:27.144058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.146083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.150522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:27.431221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:27.440105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08bb051c-a596-4274-8f13-3ecd2813488d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1491 microversion: 2.1 time: 0.329760 Oct 19 00:59:27.452648 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1547/3203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:27 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1491 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:27.465761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1605440476"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:27.468522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:27.475996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.476752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.477518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:27.478425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.478922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.479362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:27.571682 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fcbf5cef-70d9-4fc4-9fde-4b2917e91499 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "PUT /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1076 microversion: 2.1 time: 0.109662 Oct 19 00:59:27.587386 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1657/3204] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:59:27 2022] PUT /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1076 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:27.591879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:27.593137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:27.607800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.608821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.609503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:27.610452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:27.611088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:27.611696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:28.014664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:28.015465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:28.025115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:28.025616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:28.026048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:28.033684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:28.034386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:28.034995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:28.076282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:28.097342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2f58a5b-923d-47f3-b1e4-fdf90cbce6f1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1502 microversion: 2.1 time: 0.508852 Oct 19 00:59:28.114136 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1548/3205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:27 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1502 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:28.140854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:28.142572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:28.179285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:28.182777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:28.183935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:28.187393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:28.188937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:28.190262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:29.596758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:29.601182 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:29.605234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:29.612674 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-500a00c1-6be3-40b8-b09e-f83b2dbc8003 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1502 microversion: 2.1 time: 1.477352 Oct 19 00:59:29.613581 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-873512d4-8d63-4aa3-8e42-c24e94151bad tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1476 microversion: 2.1 time: 1.602769 Oct 19 00:59:29.614245 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1549/3206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:28 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1502 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:29.618613 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1658/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:28 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1476 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:29.643293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:29.659022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:29.667209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:29.667698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:29.815227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 00:59:29.910434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28f24b86-c16d-4a98-b84f-23b4fe4a4021 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "POST /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04/action" status: 202 len: 0 microversion: 2.1 time: 0.272709 Oct 19 00:59:29.915333 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1550/3208] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:29 2022] POST /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:59:29.929190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:29.930236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:29.963674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:29.964265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:29.964754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:29.967011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:29.970270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:29.973765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:30.574544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:30.578459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68eeaef1-1894-4772-8682-5e936986fcea", "name": "network-vif-deleted", "tag": "7bc14d55-b154-49d4-b553-69a23d1747a4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:30.586911 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61f26988-7a49-44eb-b58a-ee52739ee1b7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.669228 Oct 19 00:59:30.588585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1659/3209] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:29 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:30.623670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:30.626368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:30.627222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:30.637793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:30.641184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:30.655757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:30.661546 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] Creating event network-vif-deleted:7bc14d55-b154-49d4-b553-69a23d1747a4 for instance 68eeaef1-1894-4772-8682-5e936986fcea on n-h1-master-1 Oct 19 00:59:30.662567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:30.663247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:30.664784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:30.667482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:30.668251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:30.697502 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-429f0371-8fa3-40b7-9243-7e85510978b7 req-1dbd294f-155f-4b29-95e9-b278b4f00f40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121501 Oct 19 00:59:30.697502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1551/3210] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:30.793601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1f94c167c854cffb1ef9c36a278620d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413a1c08324d4c1d8829fe25c1f15c09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:30.816114 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b84977c-cc4b-4d71-bacb-fe73c58db02e tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 200 len: 1306 microversion: 2.1 time: 0.183132 Oct 19 00:59:30.819159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1660/3211] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:30 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 1306 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:31.611751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:31.612315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:31.628336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:31.629035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:31.634101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:31.635054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:31.635541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:31.638498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:31.846872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:31.848184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] [instance: 68eeaef1-1894-4772-8682-5e936986fcea] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:31.863326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:31.863838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:31.866630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:31.869803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:31.871287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:31.871907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:31.920276 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] HTTP exception thrown: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Request method failure captured: Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea HTTP/1.1 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uwtFaju53tY_rfVUO4oghVnCyi5V9Pk-FXqm-XqTziq2Lb3ORbMvr4Sj8CQG4YaxiKr7_B2hLp-vPq8x4QrWawTpa7I7m-Wn5pjTh1wYHXEETGUnF8VHt5PYI7FgkPxtOMTJFM5kuCNlirOQefxAuvFMGhnfjntuAFHziodZ3aEkI Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 413a1c08324d4c1d8829fe25c1f15c09 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_413a1c08324d4c1d8829fe25c1f15c09", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/413a1c08324d4c1d8829fe25c1f15c09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/413a1c08324d4c1d8829fe25c1f15c09"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/413a1c08324d4c1d8829fe25c1f15c09"}]}] Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 413a1c08324d4c1d8829fe25c1f15c09 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-991347483 Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminNegativeTestJSON-991347483-project Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d1f94c167c854cffb1ef9c36a278620d Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminNegativeTestJSON-991347483-project Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '68eeaef1-1894-4772-8682-5e936986fcea'} Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:31.922137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. Oct 19 00:59:31.927405 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:31.930324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] Returning 404 to user: Instance 68eeaef1-1894-4772-8682-5e936986fcea could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:31.933326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-321dd49e-418b-4bc4-b10c-ec5764b5d5ec tempest-ServersAdminNegativeTestJSON-991347483 tempest-ServersAdminNegativeTestJSON-991347483-project] 10.222.0.27 "GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea" status: 404 len: 111 microversion: 2.1 time: 0.090626 Oct 19 00:59:31.936827 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1661/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:31 2022] GET /compute/v2.1/servers/68eeaef1-1894-4772-8682-5e936986fcea => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:32.697300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:32.714317 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51c6446a-878e-4908-a7e7-50fdd1b72a61 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 1.106932 Oct 19 00:59:32.721780 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1552/3213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:31 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:33.752437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:33.753220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:33.764132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:33.764660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:33.765099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:33.774228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:33.774769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:33.775218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:34.120149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:34.128559 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4b18d76-ce38-4d22-abc8-6f5b17cafdda tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.385031 Oct 19 00:59:34.141610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1662/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:33 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:35.156576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:35.160079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:35.188097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-720926641", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:35.215300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:35.215793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:35.216230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:35.216974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:35.230017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:35.231145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:35.327266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:59:35.835745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:35.850412 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2450b6e4-0a35-4389-ad8e-a034dc5086d7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.698559 Oct 19 00:59:35.864647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1663/3215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:35 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:36.777934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:36.779210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:36.780108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:36.780965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:36.781781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:36.809109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:36.815210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:36.816124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:36.817464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:36.818202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:36.819332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:36.874639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f02bcdd9-35a7-4364-a438-1ee30a81b382 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:36.876181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:36.892757 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f02bcdd9-35a7-4364-a438-1ee30a81b382 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.278846 Oct 19 00:59:36.893428 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1664/3216] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:36.903078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:36.910436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:36.915931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:36.919276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:36.922071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:36.934401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:36.934901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:36.962586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:36.965464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:36.968829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:36.971672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:37.043371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-387c7a05-cb0d-45f0-889f-850373638ec8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.281258 Oct 19 00:59:37.046442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1553/3217] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:59:37.062672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f52e204a-0c2e-49f3-aa4f-77277ca2bfca tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.169029 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f52e204a-0c2e-49f3-aa4f-77277ca2bfca tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.120669 Oct 19 00:59:37.171502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1554/3218] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:37.177331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2d4ba2d-3416-4e11-a629-6385f75adcb2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.178209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2d4ba2d-3416-4e11-a629-6385f75adcb2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:37.466230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2d4ba2d-3416-4e11-a629-6385f75adcb2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:37.480945 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2d4ba2d-3416-4e11-a629-6385f75adcb2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1207 microversion: 2.1 time: 0.308077 Oct 19 00:59:37.484729 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1555/3219] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1207 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:37.496576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3951d31-2875-4059-aecc-018997ab8b74 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.506683 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3951d31-2875-4059-aecc-018997ab8b74 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020739 Oct 19 00:59:37.509477 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1556/3220] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:37.527095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25822e40-7268-43a4-ad3a-a344f4e30eab tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.550073 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25822e40-7268-43a4-ad3a-a344f4e30eab tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029980 Oct 19 00:59:37.552240 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1557/3221] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:37.564187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da38241d-bf71-4655-b733-e662329e402d tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.652176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da38241d-bf71-4655-b733-e662329e402d tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.092700 Oct 19 00:59:37.653121 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1558/3222] 10.222.0.27 () {58 vars in 1165 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:37.668974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:37.677469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d7d6337-2ab2-451f-a4e3-025c11a19ceb tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.684028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b1f757b-10eb-4770-88db-4aaf0260d653 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.789467 Oct 19 00:59:37.684986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1665/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:36 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:37.723620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.724449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:37.738465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d7d6337-2ab2-451f-a4e3-025c11a19ceb tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.050454 Oct 19 00:59:37.740164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1559/3224] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:37.742930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:37.743707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:37.747269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:37.749231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:37.749910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:37.750518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:37.754666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65b98a6e-034a-4da9-a7b9-70821ebfa533 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.804192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1dabb6f7-3e98-490b-a9fa-639a2f625d57 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/ips" status: 200 len: 145 microversion: 2.1 time: 0.083051 Oct 19 00:59:37.807126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1666/3225] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/ips => generated 145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:37.880988 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65b98a6e-034a-4da9-a7b9-70821ebfa533 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.127500 Oct 19 00:59:37.886517 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1560/3226] 10.222.0.27 () {58 vars in 1169 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:37.905407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6bdd5fd-1d76-4ece-bc01-252126bcdd0a tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.950019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6bdd5fd-1d76-4ece-bc01-252126bcdd0a tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.043702 Oct 19 00:59:37.951614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1667/3227] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:37.969555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1727fdb1-ea48-4649-827b-d4f6917f59a7 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:37.982805 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1727fdb1-ea48-4649-827b-d4f6917f59a7 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018381 Oct 19 00:59:37.985985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1561/3228] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:38.004369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-567f56de-1577-4a4c-8427-1341d5773b13 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.138144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-567f56de-1577-4a4c-8427-1341d5773b13 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.137561 Oct 19 00:59:38.142896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1668/3229] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 00:59:37 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:38.159387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3cd7ac9c-2c60-45d8-82c6-cbdc1bff6050 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.192931 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3cd7ac9c-2c60-45d8-82c6-cbdc1bff6050 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035691 Oct 19 00:59:38.197782 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1562/3230] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:38.209798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26308ace-4f05-49a3-89f6-b781eecac302 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.292103 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26308ace-4f05-49a3-89f6-b781eecac302 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.083094 Oct 19 00:59:38.293281 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1669/3231] 10.222.0.27 () {58 vars in 1144 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:38.308955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92e2ad22-62d7-4a3c-9749-838daf0f9bec tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.319083 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-92e2ad22-62d7-4a3c-9749-838daf0f9bec tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015254 Oct 19 00:59:38.320437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1563/3232] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:38.334861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0da1b07-cfb1-4a91-864b-24fb26cc6335 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.466803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0da1b07-cfb1-4a91-864b-24fb26cc6335 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.136703 Oct 19 00:59:38.470260 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1670/3233] 10.222.0.27 () {58 vars in 1148 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:38.483492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ceec409-24c1-4bd7-9531-1c05b777f9d3 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.507806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.508546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:38.521648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.522142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.522573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.529535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.530300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.531272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.534834 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ceec409-24c1-4bd7-9531-1c05b777f9d3 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.052518 Oct 19 00:59:38.535937 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1564/3234] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:38.555036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e15caa91-067a-4127-b176-dd723c601d49 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.582957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e15caa91-067a-4127-b176-dd723c601d49 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037610 Oct 19 00:59:38.598535 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1565/3235] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:38.637355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54be38dd-0f0c-4317-aa72-e65aa43bc0ad tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.707490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:38.721795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bcd454c-712f-4eac-826d-536abe7f57db tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1211 microversion: 2.1 time: 0.216398 Oct 19 00:59:38.722922 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1671/3236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1211 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:38.727870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.728598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:38.736787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.737640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.738253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.739357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.740173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.740808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.747302 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54be38dd-0f0c-4317-aa72-e65aa43bc0ad tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.133733 Oct 19 00:59:38.758109 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1566/3237] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:38.762905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:38.763149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:38.785931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.786694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.787756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.789333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:38.790192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:38.790814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:38.841817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:39.016090 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:39.112206 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10889d7f-ffd7-480d-b1d0-afd451673e4c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 204 len: 0 microversion: 2.1 time: 0.383644 Oct 19 00:59:39.113969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1672/3238] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:59:38 2022] DELETE /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:39.139629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e6eea3-492d-4302-a7e3-10231a9d4339 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:39.206479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:39.234436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e6eea3-492d-4302-a7e3-10231a9d4339 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.094721 Oct 19 00:59:39.243272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9edc9e53-97b6-4b17-b51d-67533c6c4a85 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.490721 Oct 19 00:59:39.250337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1673/3239] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 00:59:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:39.265712 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1567/3240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:38 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:39.271661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:39.278228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:39.280134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab587b27-ff5d-4235-9135-3f76e54d5aa5 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:39.296486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:39.297236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:39.297857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:39.298059 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab587b27-ff5d-4235-9135-3f76e54d5aa5 tempest-FlavorsV2TestJSON-972538689 tempest-FlavorsV2TestJSON-972538689-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031122 Oct 19 00:59:39.300089 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1568/3241] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 00:59:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:39.306244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:39.309575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:39.311612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:39.751195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:39.752025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:39.758459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:39.768959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15f0cac4-c0ea-49a6-b905-1bd2935943cd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1554 microversion: 2.1 time: 0.511544 Oct 19 00:59:39.771079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:39.771907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:39.772651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:39.774490 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1674/3242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:39 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1554 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:39.775635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:39.777201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:39.777815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:39.951813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:39.964975 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fcbc7e3-98a8-433f-98c6-d0d47ac40411 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1277 microversion: 2.1 time: 0.218184 Oct 19 00:59:39.968142 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1569/3243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:39 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:40.273776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:40.275493 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:40.301464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:40.302105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:40.302656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:40.303678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:40.304445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:40.305038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:40.746623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:40.754989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aaecdcc8-d149-41ac-898f-bf937404d0e2 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.486392 Oct 19 00:59:40.760890 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1675/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:40 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:40.821738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:40.822388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:40.853857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:40.855587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:40.856210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:40.859254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:40.860566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:40.866341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:40.994845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:40.995470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:41.008197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:41.008197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:41.008659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:41.013936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:41.014442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:41.014895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:41.766046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:41.778784 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8901971-82c6-4adb-bc09-b3ac9846ddf0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1265 microversion: 2.1 time: 0.788198 Oct 19 00:59:41.795554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1676/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:40 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1265 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:41.809166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:41.809791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:41.819287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:41.820932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:41.821632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:41.822906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:41.823819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:41.825289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:42.394297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:42.413902 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae5f1d5d-2a7c-44a2-a648-6f11e1544677 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1554 microversion: 2.1 time: 1.614524 Oct 19 00:59:42.418233 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1570/3246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:40 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1554 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:42.438941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49542454-0d35-43b4-8505-baccd6992d5d"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:42.444249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:42.466751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:42.468454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:42.469349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:42.485144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:42.489769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:42.490722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:43.030239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:43.039855 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1900308-3d69-4b94-af42-c81104046269 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 1.240791 Oct 19 00:59:43.047192 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1677/3247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:41 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:43.065851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:43.067957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:43.075988 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:43.092681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:43.101259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:43.102672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:43.105377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:43.105963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:43.110453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:43.259608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6985bce3-ee2d-4a97-a6d3-42a52ba1e88e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.839935 Oct 19 00:59:43.260253 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1571/3248] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 00:59:42 2022] POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:43.777032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:43.784991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6b8c8be-9f1b-41af-87f5-a7f5c487130a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.735864 Oct 19 00:59:43.785585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1678/3249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:43 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:43.795305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: .version_select at 0x7f2af936c700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1297588867", "policies": ["affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:43.797202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:43.803222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:43.827420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:43.833859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:43.844751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:43.846027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:43.846384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:43.847695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:43.848721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:43.861294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:43.955307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:43.968164 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-396dec1d-fd47-43f3-997a-7519a2ab438a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.180610 Oct 19 00:59:43.971833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1679/3250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:43 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:44.016604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:44.027842 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:44.035149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:44.102408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2b89192-fb58-45c2-b2ca-aa2e099d8962 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.840567 Oct 19 00:59:44.103009 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1572/3251] 10.222.0.27 () {60 vars in 1174 bytes} [Wed Oct 19 00:59:43 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:44.145498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:44.156431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:44.184679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.193432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.194293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.195553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.200462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.201884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.561783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:44.577903 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-adf0d8a0-2656-48cb-890e-540d64d4b497 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.457157 Oct 19 00:59:44.597361 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1573/3252] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:44 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:44.610025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: .version_select at 0x7f2af4e33430>, body: {"server_group": {"name": "tempest-server-group-1628921309", "policies": ["affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:44.635234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:44.652636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:44.754999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:44.760533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69fb29e-5644-4c56-bfd8-8a26363863c6", "name": "network-vif-deleted", "tag": "2941f79c-7fb8-4d2f-976a-8d48d378adf4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:44.763974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:44.776348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.776876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.777288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.825901 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] Creating event network-vif-deleted:2941f79c-7fb8-4d2f-976a-8d48d378adf4 for instance e69fb29e-5644-4c56-bfd8-8a26363863c6 on n-h1-master-1 Oct 19 00:59:44.833927 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d338d701-d930-4cd1-b227-ccc4a12ede4c req-85ca7881-95ef-4b65-9513-0c5757a0bdcc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.860447 Oct 19 00:59:44.834543 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1680/3253] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:44.849443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:44.850165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:44.857756 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e245171-08de-4a0b-a1ac-d3390bb1f0dc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.258841 Oct 19 00:59:44.860604 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1574/3254] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 00:59:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:44.872701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9276ba46-49f5-405b-af88-c0e926b5a630", "tag": "ad4714f7-2275-4b63-987e-d6cadad35c51"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:44.881791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.882827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.893321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.894136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.894620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.896871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.899937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:44.900313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:44.904589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:44.934644 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] Creating event network-changed:ad4714f7-2275-4b63-987e-d6cadad35c51 for instance 9276ba46-49f5-405b-af88-c0e926b5a630 on n-h2-master-1 Oct 19 00:59:44.951232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a061aed8-1967-444c-b8ef-eefcc8f886e6 req-d180578e-7df6-4415-851d-4abcc7b5a0e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088978 Oct 19 00:59:44.956992 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1575/3255] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:44.987911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: .version_select at 0x7f2af936cc10>, body: {"server_group": {"name": "tempest-server-group-1628921309", "policies": ["affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:45.074674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:45.094032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:45.207015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:45.224075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:45.264418 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c919ac2d-0d9d-4c7b-8f34-d3f4e54d2c97 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.304406 Oct 19 00:59:45.267371 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1576/3256] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 00:59:44 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:45.280543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.281639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:45.296215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:45.297209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:45.297836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:45.298741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:45.300749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:45.301406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:45.303921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:45.318686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4fbcc36-13cf-4955-ba1f-268ca03b3846 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.470932 Oct 19 00:59:45.319367 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1681/3257] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:44 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:45.324758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2b9281d-84bc-4d2a-8dfa-23eaef8f8e9e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.382561 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2b9281d-84bc-4d2a-8dfa-23eaef8f8e9e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/af245758-4283-4607-89ad-9bba2dab456f" status: 204 len: 0 microversion: 2.1 time: 0.061604 Oct 19 00:59:45.383638 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1682/3258] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:59:45 2022] DELETE /compute/v2.1/os-server-groups/af245758-4283-4607-89ad-9bba2dab456f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:45.392209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-faa83082-b2de-4ae4-874c-040f12934d18 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.451440 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-faa83082-b2de-4ae4-874c-040f12934d18 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.055948 Oct 19 00:59:45.452871 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1683/3259] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:59:45 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:45.473490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-535b9f11-ba20-4338-8d55-f8fdeabac2c6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.486704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:45.495584 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-259f9e66-15d1-4617-aa7f-eb36a4e7c096 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.225804 Oct 19 00:59:45.500417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1577/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:45 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:45.531979 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-535b9f11-ba20-4338-8d55-f8fdeabac2c6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/2dd7b431-54b2-4814-90ce-c1bbf7214328" status: 204 len: 0 microversion: 2.1 time: 0.069926 Oct 19 00:59:45.533724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1684/3261] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:59:45 2022] DELETE /compute/v2.1/os-server-groups/2dd7b431-54b2-4814-90ce-c1bbf7214328 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:59:45.544566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c4addb9-c1d8-4e76-b4db-0a02cc56ba2d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.575638 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c4addb9-c1d8-4e76-b4db-0a02cc56ba2d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035104 Oct 19 00:59:45.584055 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1578/3262] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:59:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:45.590557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: .version_select at 0x7f2af45280d0>, body: {"server_group": {"name": "tempest-server-group-1093507196", "policies": ["affinity"]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:45.605688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.606307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:45.627314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:45.633551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:45.636446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:45.637404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:45.637895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:45.638332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:45.658689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:45.672532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:45.823998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:45.839834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:45.873066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2de8a851-7123-48ec-8ec7-6f6075cb5db9 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.287551 Oct 19 00:59:45.879232 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1685/3263] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 00:59:45 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:45.887267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7203b1a-89e4-4e2b-9d6c-5594208d832d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.953783 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7203b1a-89e4-4e2b-9d6c-5594208d832d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b7c3a75e-11c9-4a68-82d8-fd190e7618c4" status: 204 len: 0 microversion: 2.1 time: 0.062974 Oct 19 00:59:45.959635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1686/3264] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:59:45 2022] DELETE /compute/v2.1/os-server-groups/b7c3a75e-11c9-4a68-82d8-fd190e7618c4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 00:59:45.979272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fddcacf0-d05f-4222-9b41-5ed529bf7094 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:45.979959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:45.993265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5a311d5a-7987-4fd7-a079-c666e24f9b1a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.391851 Oct 19 00:59:45.996092 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1579/3265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:45 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:46.024202 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fddcacf0-d05f-4222-9b41-5ed529bf7094 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.054457 Oct 19 00:59:46.027710 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1687/3266] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:59:45 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:46.039003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: .version_select at 0x7f2af9422af0>, body: {"server_group": {"name": "tempest-server-group-1596462987", "policies": ["anti-affinity"]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:46.109630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:46.131069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:46.231535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:46.242777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:46.279050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9f1b878-bb30-4d16-bf09-44514449163e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.243860 Oct 19 00:59:46.280761 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1580/3267] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 00:59:46 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:46.292043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a73552aa-c205-41f6-9841-c57a595180e1 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:46.347109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:46.348594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:46.350711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a73552aa-c205-41f6-9841-c57a595180e1 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/946489c8-b31b-405f-a8e6-567c125fd363" status: 204 len: 0 microversion: 2.1 time: 0.061348 Oct 19 00:59:46.352168 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1688/3268] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 00:59:46 2022] DELETE /compute/v2.1/os-server-groups/946489c8-b31b-405f-a8e6-567c125fd363 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:46.361523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:46.362576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:46.364442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:46.365992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:46.366881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:46.368561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eba47eb7-ffb3-495c-bcc5-143320e170ec tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:46.369616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:46.396649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eba47eb7-ffb3-495c-bcc5-143320e170ec tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040144 Oct 19 00:59:46.398403 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1689/3269] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 00:59:46 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:46.526646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:46.527449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:46.541507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:46.542009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:46.542462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:46.543194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:46.543679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:46.544081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:46.685242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:46.696606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-424294fc-2259-4483-a911-b693fad661d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.174586 Oct 19 00:59:46.702919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:46.707819 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1690/3270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:46 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:46.713156 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dff169fa-5b2b-4c4f-ab2e-726d692d6c64 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.374353 Oct 19 00:59:46.715525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1581/3271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:46 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:46.792191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-514108895", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "c2b87adf-e29d-436d-9a8c-60749f34532d"}]}, "os:scheduler_hints": {"group": "7419f82e-511d-4013-980a-0ada9b715468"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:46.885299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] validate_networks() for [('c2b87adf-e29d-436d-9a8c-60749f34532d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:59:47.025325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:47.026583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:47.029269 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:47.037902 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:47.056926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:47.061976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:47.064378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:47.067877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:47.068751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:47.071163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:47.537986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:47.551836 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-799c88a2-f280-4440-98fe-a7c510a1a619 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.530892 Oct 19 00:59:47.552872 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1582/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:47 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:47.558162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f312596-4316-49d1-89af-3790d63296d6 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af4853e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:47.638365 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f312596-4316-49d1-89af-3790d63296d6 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab" status: 200 len: 637 microversion: 2.1 time: 0.084370 Oct 19 00:59:47.649477 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1583/3273] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:47 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab => generated 637 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:47.660975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f83be7ed-c200-486d-bec7-03093d52ce76 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af4f610d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:47.747597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f83be7ed-c200-486d-bec7-03093d52ce76 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:47.758737 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f83be7ed-c200-486d-bec7-03093d52ce76 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:48.252328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f83be7ed-c200-486d-bec7-03093d52ce76 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.598437 Oct 19 00:59:48.253033 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1584/3274] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:47 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:48.260155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:48.263690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:48.282810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.284092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.289117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.290470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.293548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.295807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.598524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:48.599584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:48.600287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:48.602138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:48.602988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:48.638529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.640248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.640846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.643674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.644293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.645709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.699635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:48.716340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:48.740379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:48.744222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:48.777299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:48.788148 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e58de95-9dbf-4b85-a78a-56de956fdaea tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.532069 Oct 19 00:59:48.789735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1585/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:48 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:48.795129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:48.796147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:48.804832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.805841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.806568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.807574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:48.808598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:48.809222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:48.862645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131449) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 19 00:59:48.924421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_group_members'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:48.943633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:48.949889 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=12,nova_api:INSERT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:48.953693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_group_members'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:48.956720 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2b74b3f-b954-4383-8247-53866f96ecb8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.164079 Oct 19 00:59:48.957444 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1586/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:48 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:48.975004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc90339a-9d46-45da-8f84-d3937c16556e tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af4f7b820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:49.077268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_group_members'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:49.097521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Getting quotas for user 77b49d34906d44819c47d0ad5f1a9bc4 and project d7cd9e94413f41e6aebee479e4c87705. Resources: {'server_group_members'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:49.153289 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7c5712b-d823-44af-9eed-31332471fb2a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.365075 Oct 19 00:59:49.154497 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1691/3277] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2367 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:59:49.161280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:49.162313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:49.171483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:49.172243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:49.173634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:49.174612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:49.175304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:49.176225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:49.502097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:49.509792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc90339a-9d46-45da-8f84-d3937c16556e tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "DELETE /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.550423 Oct 19 00:59:49.510958 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1587/3278] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 00:59:48 2022] DELETE /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_version => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:49.515532 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5dd214ea-e9d1-4c09-be4f-03320057bcf5 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.359270 Oct 19 00:59:49.528660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1692/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:49 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:49.528921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-934199e1-7d93-4004-a6b4-b8e05a469b13 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:49.528921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-934199e1-7d93-4004-a6b4-b8e05a469b13 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:49.529141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb9d5379-8b6c-4688-b5eb-01c093641ff0 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af93400d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:49.576351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb9d5379-8b6c-4688-b5eb-01c093641ff0 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 37 microversion: 2.1 time: 0.058655 Oct 19 00:59:49.576997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1693/3280] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:49 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 37 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:49.587748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6ce09e5-ff7f-46c4-902a-effe01018be5 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af55228b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:49.621019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-934199e1-7d93-4004-a6b4-b8e05a469b13 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:49.628355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-934199e1-7d93-4004-a6b4-b8e05a469b13 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1212 microversion: 2.1 time: 0.115922 Oct 19 00:59:49.648939 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1588/3281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:49 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1212 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:49.678267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e6ce09e5-ff7f-46c4-902a-effe01018be5 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:49.685172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e6ce09e5-ff7f-46c4-902a-effe01018be5 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:49.826537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:49.829694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:49.842353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:49.843202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:49.844636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:49.845933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:49.848106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:49.848977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:49.858846 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:50.072136 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6ce09e5-ff7f-46c4-902a-effe01018be5 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.488772 Oct 19 00:59:50.075705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:50.077560 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1694/3282] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:49 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:50.082272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:50.083257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:50.084182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ffb398d-44d0-4aed-a526-b9af9be970ad tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.268981 Oct 19 00:59:50.085118 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1589/3283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:49 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:50.090150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52d984fb-d597-427e-85c0-ad8fb34d9c85 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af5782ee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:50.105370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.106103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.106834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.107537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.108157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.108826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.137453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52d984fb-d597-427e-85c0-ad8fb34d9c85 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051235 Oct 19 00:59:50.138677 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1590/3284] 10.222.0.27 () {58 vars in 1290 bytes} [Wed Oct 19 00:59:50 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_distro => generated 33 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:50.149801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4c4ec74-5981-48e4-a499-fc6cb4b321fb tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af4f7be50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:50.190357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:50.202056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7cbd597a-3194-44de-8d4a-79c40175dd89 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.122957 Oct 19 00:59:50.202982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1695/3285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:50 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:50.216584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b4c4ec74-5981-48e4-a499-fc6cb4b321fb tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:50.223028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b4c4ec74-5981-48e4-a499-fc6cb4b321fb tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:50.437281 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4c4ec74-5981-48e4-a499-fc6cb4b321fb tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.291795 Oct 19 00:59:50.445827 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1591/3286] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:50 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:50.452926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50a4f9e1-1415-4faa-a95c-68d6612a0895 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af488b940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:50.517588 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50a4f9e1-1415-4faa-a95c-68d6612a0895 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.069958 Oct 19 00:59:50.518305 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1592/3287] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:50 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:50.532752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fe3fe59-0be5-493a-bbe6-9cede52ffd4d tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af9349700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:50.600181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9fe3fe59-0be5-493a-bbe6-9cede52ffd4d tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:50.605949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9fe3fe59-0be5-493a-bbe6-9cede52ffd4d tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:50.670393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9276ba46-49f5-405b-af88-c0e926b5a630", "name": "network-vif-plugged", "status": "completed", "tag": "ad4714f7-2275-4b63-987e-d6cadad35c51"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:50.680430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.681064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.681355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.698178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] Creating event network-vif-plugged:ad4714f7-2275-4b63-987e-d6cadad35c51 for instance 9276ba46-49f5-405b-af88-c0e926b5a630 on n-h2-master-1 Oct 19 00:59:50.703396 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-66bb5d6e-c91e-49c2-8a74-ae894d579a3d req-989192a5-8181-4794-852f-d905bf9d084c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.317559 Oct 19 00:59:50.704261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1696/3288] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 00:59:50.710487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:50.711262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:50.718309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.718775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.719382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.720240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.720971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.721562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.776923 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fe3fe59-0be5-493a-bbe6-9cede52ffd4d tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.251125 Oct 19 00:59:50.777763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1593/3289] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:50 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:59:50.783437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:50.784365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:50.791785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.792354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.792937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.793865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:50.794343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:50.794845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:50.888830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:50.899336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ce71f79-cfc0-4c62-88ba-074a9b72a93a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1264 microversion: 2.1 time: 0.120270 Oct 19 00:59:50.912718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1594/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:50 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1264 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:50.912718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5c82296-af53-416b-b962-b8e9e272736c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af5639790>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:50.967687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:50.987792 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84733a27-60ca-4a70-9359-c0f94ac32bf7 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.282031 Oct 19 00:59:50.989554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1697/3291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:50 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:50.995635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d5c82296-af53-416b-b962-b8e9e272736c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:51.003090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d5c82296-af53-416b-b962-b8e9e272736c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:51.108404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:51.109077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:51.116045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.117783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.118507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.119403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.120036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.120654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.270805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:51.280349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1b45ecf-5cdd-42d4-b0d2-577d903ab6c7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.175786 Oct 19 00:59:51.280958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1698/3292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:51 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:51.297075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:51.303010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:51.324137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.325612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.326851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.328246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.328958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.329804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.419661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5c82296-af53-416b-b962-b8e9e272736c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 64 microversion: 2.1 time: 0.518548 Oct 19 00:59:51.420682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1595/3293] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:50 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 64 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:51.431617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-997a447c-b915-4bf6-9393-47fd8cddc8df tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af488bdc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:51.443800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:51.464868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a73cebce-79f9-4e24-8bee-070b2e29f121 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 200 len: 1346 microversion: 2.1 time: 0.178002 Oct 19 00:59:51.465518 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1699/3294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:51 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 1346 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:51.506422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-997a447c-b915-4bf6-9393-47fd8cddc8df tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080084 Oct 19 00:59:51.507627 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1596/3295] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:51 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 64 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:51.518845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d96abfd-be93-4dfe-a1da-85a0c870b84c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af4761af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:51.582177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6d96abfd-be93-4dfe-a1da-85a0c870b84c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:51.589654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6d96abfd-be93-4dfe-a1da-85a0c870b84c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:51.940308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:51.941438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:51.958559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.959068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.959517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.960280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:51.960780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:51.961336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:51.964198 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d96abfd-be93-4dfe-a1da-85a0c870b84c tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.449866 Oct 19 00:59:51.964898 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1700/3296] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:51 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:51.974815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d00f68b-11d4-45ec-b398-21dbc4b30a03 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update', calling method: .version_select at 0x7f2af5522b80>, body: {"meta": {"os_version": "alt"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:52.086500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8d00f68b-11d4-45ec-b398-21dbc4b30a03 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:52.100653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8d00f68b-11d4-45ec-b398-21dbc4b30a03 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:52.117755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:52.130044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-34c43d69-719f-46c4-8647-7317452d0324 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1270 microversion: 2.1 time: 0.205982 Oct 19 00:59:52.130652 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1597/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:51 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 00:59:52.137543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:52.138461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:52.145922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.146744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.147964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.148968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.149534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.150111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.417758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:52.427463 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-569e8061-b811-40a5-a239-af0004faa9ce tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.294274 Oct 19 00:59:52.428397 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1598/3298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:52 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:52.434510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:52.435287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:52.450733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.453082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.454163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.457109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.457634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.458069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.723385 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d00f68b-11d4-45ec-b398-21dbc4b30a03 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.752963 Oct 19 00:59:52.724391 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1701/3299] 10.222.0.27 () {60 vars in 1313 bytes} [Wed Oct 19 00:59:51 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata/os_version => generated 31 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 00:59:52.734272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:52.738876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:52.760244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.760889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.761432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.762251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:52.762951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:52.763485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:52.767530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:52.787335 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba89588e-a9c1-4efd-889b-58855727891e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1307 microversion: 2.1 time: 0.357285 Oct 19 00:59:52.787946 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1599/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:52 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:52.809995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4fc7a2f-f221-44fd-9bca-98ad679b4ba8 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af4853700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:52.810755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 HTTP/1.1 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e69fb29e-5644-4c56-bfd8-8a26363863c6'} Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:52.817374 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 00:59:52.822911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:52.832424 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09c2b43a-98e8-45fa-9b5c-1c0e6acb5e99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 404 len: 111 microversion: 2.1 time: 0.103133 Oct 19 00:59:52.832424 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1702/3301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:52 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:52.879876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4fc7a2f-f221-44fd-9bca-98ad679b4ba8 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 58 microversion: 2.1 time: 0.083461 Oct 19 00:59:52.882324 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1600/3302] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:52 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 58 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:52.892855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5c823bdc-2427-4940-85f0-6d8e2c5173a2 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'update_all', calling method: .version_select at 0x7f2af4f6f0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:52.979940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5c823bdc-2427-4940-85f0-6d8e2c5173a2 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:52.987229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5c823bdc-2427-4940-85f0-6d8e2c5173a2 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:53.108993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:53.113804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:53.128886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.131187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.133835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.134919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.135695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.136145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.179022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6/os-volume_attachments HTTP/1.1 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': 'e69fb29e-5644-4c56-bfd8-8a26363863c6'} Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:53.181572 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:53.187513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e897b55-3f67-4f47-ac72-c4299346b124 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.083171 Oct 19 00:59:53.192852 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1601/3303] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 00:59:53 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:53.206033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:53.207055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:53.214905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.215797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.216449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.217485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.218184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.218901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.515558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5c823bdc-2427-4940-85f0-6d8e2c5173a2 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.626574 Oct 19 00:59:53.516470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1703/3304] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 00:59:52 2022] PUT /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 61 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:53.521790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:53.522414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:53.546123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.546685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.547145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.551208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:53.551764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:53.552222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:53.659391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:53.671599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec221f58-3c86-4969-bfad-3c352cc6b384 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.477529 Oct 19 00:59:53.673765 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1602/3305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:53 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:53.680062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad289038-f484-4e40-bf6e-ddb75e61a978 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Action: 'create', calling method: .version_select at 0x7f2af5f59b80>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:53.746369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ad289038-f484-4e40-bf6e-ddb75e61a978 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:53.758159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ad289038-f484-4e40-bf6e-ddb75e61a978 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Getting quotas for user 2e2de00d2682446689b3bf7d1a7d391f and project ffd06d4e7c51407298329292acc58529. Resources: dict_keys(['metadata_items']) {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:53.909111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:53.921409 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-35f21b6e-1862-4ffd-a463-9d2ab8a9c39d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1512 microversion: 2.1 time: 0.402436 Oct 19 00:59:53.922013 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1704/3306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:53 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1512 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:53.929162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-396157740", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:53.997183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:59:54.352265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad289038-f484-4e40-bf6e-ddb75e61a978 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "POST /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 85 microversion: 2.1 time: 0.676800 Oct 19 00:59:54.352895 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1603/3307] 10.222.0.27 () {60 vars in 1281 bytes} [Wed Oct 19 00:59:53 2022] POST /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 85 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:54.365077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:54.365914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:54.379807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:54.380586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:54.384273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:54.385354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:54.386010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:54.387082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:54.910739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:54.919754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2061c6d3-10ac-4609-805a-537e91883210 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1487 microversion: 2.1 time: 0.560988 Oct 19 00:59:54.920605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1604/3308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:54 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1487 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:54.946632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac947f0e-1066-4cf9-bbb2-06b495d5e227 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] Calling method '.version_select at 0x7f2af5753a60>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:55.002051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac947f0e-1066-4cf9-bbb2-06b495d5e227 tempest-ImagesMetadataTestJSON-115288305 tempest-ImagesMetadataTestJSON-115288305-project] 10.222.0.27 "GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata" status: 200 len: 85 microversion: 2.1 time: 0.067394 Oct 19 00:59:55.002788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1605/3309] 10.222.0.27 () {58 vars in 1260 bytes} [Wed Oct 19 00:59:54 2022] GET /compute/v2.1/images/f24775d0-9661-407b-9fd3-d28be2ee74ab/metadata => generated 85 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 00:59:55.017092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:55.017736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:55.031045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.031561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.032021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.033147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.033831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.034447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.086300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:55.086845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:55.087436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:55.087948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:55.088637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:55.102653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.106585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.109633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.110853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.111571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.114990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.191377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:55.198944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:55.220673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:55.225783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:55.330473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d3f5770-714e-4826-8261-bce19d249320 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.405890 Oct 19 00:59:55.331369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1705/3310] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 00:59:55.342315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ab45ed-948a-45dc-bb0e-e0de19d2572a", "tag": "0bc4e9c2-7c47-4094-a854-7d2f0ee1d464"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:55.362065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.362553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.362993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.396098 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] Creating event network-changed:0bc4e9c2-7c47-4094-a854-7d2f0ee1d464 for instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a on n-h2-master-1 Oct 19 00:59:55.404437 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-537bae08-9931-47cf-953a-429ee06a93d4 req-acda9302-0ece-4280-af6d-d8c3f4da3a45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068713 Oct 19 00:59:55.405149 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1706/3311] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 00:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 00:59:55.419163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:55.420059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:55.432718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.440679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.441568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.442496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.443133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.443745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.466297 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:55.576112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65807d95-e6ad-41e7-b067-429c179241ca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630/action" status: 202 len: 0 microversion: 2.1 time: 0.161369 Oct 19 00:59:55.577321 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1707/3312] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:55 2022] POST /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 00:59:55.588762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:55.591443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:55.610276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.610993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.613182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.614172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:55.615734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:55.616557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:55.957941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:55.967094 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ea3d9a3-7f18-4199-9b49-20812185cd5a tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.963252 Oct 19 00:59:55.967682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1606/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:55 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:55.980459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24320540-e044-43e3-8372-09da56dad0d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:55.981133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24320540-e044-43e3-8372-09da56dad0d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:56.089846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24320540-e044-43e3-8372-09da56dad0d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:56.094134 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24320540-e044-43e3-8372-09da56dad0d2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179" status: 200 len: 1214 microversion: 2.1 time: 0.125427 Oct 19 00:59:56.094718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1607/3314] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:55 2022] GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:56.109767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:56.110665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:56.118597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.128800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.129431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.130536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.131185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.132337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.263783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:56.280241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c4d5caa-2404-463b-8300-ab7b04c0e863 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1489 microversion: 2.1 time: 0.701514 Oct 19 00:59:56.280886 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1708/3315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:55 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1489 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:56.285661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:56.286184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:56.331357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:56.366602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.367508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.368171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.415940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'flavor' on Instance uuid 0af2a74f-2c50-42f5-a7cf-750b826e0179 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:56.448732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'system_metadata' on Instance uuid 0af2a74f-2c50-42f5-a7cf-750b826e0179 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:56.472137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:56.489140 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e432752-4595-4054-b240-15c1d22e6777 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 200 len: 1472 microversion: 2.1 time: 0.382287 Oct 19 00:59:56.490870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1608/3316] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:56 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:56.497712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1713527102"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:56.501855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:56.512874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.514115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.515067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.516136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.517027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.517836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.555722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'metadata' on Instance uuid 0af2a74f-2c50-42f5-a7cf-750b826e0179 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 00:59:56.697756 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1831f85d-d177-496f-a630-eabb08ea5b47 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "PUT /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1062 microversion: 2.1 time: 0.204782 Oct 19 00:59:56.701869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1609/3317] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 00:59:56 2022] PUT /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1062 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:56.717989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-410658395"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:56.724983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:56.742352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.744977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.745439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:56.747562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:56.748063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:56.748514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.188000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03f31eb2-67b9-40c3-9a25-55fe5bc3d49a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630/action" status: 202 len: 0 microversion: 2.1 time: 0.478547 Oct 19 00:59:57.193900 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1610/3318] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 00:59:56 2022] POST /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 00:59:57.207687 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:57.213188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:57.227568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.229989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.233440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.235745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.238474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.239657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.335540 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:57.413675 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0bf8a33f-10a5-49ec-b6eb-76bd0b5db850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179" status: 204 len: 0 microversion: 2.1 time: 1.115766 Oct 19 00:59:57.416528 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1709/3319] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:59:56 2022] DELETE /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:57.465182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:57.467728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:57.498107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.498707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.500382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.501153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.503410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.505136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.591096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:57.602726 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9364823e-c6d0-4e61-9165-bba92df50aa3 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1489 microversion: 2.1 time: 0.403500 Oct 19 00:59:57.604828 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1611/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:57 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1489 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:57.610255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b577e14-a51f-4427-a01a-8dce8eb57c73 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af488bc10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:57.697411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b577e14-a51f-4427-a01a-8dce8eb57c73 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.091444 Oct 19 00:59:57.700102 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1612/3321] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:57 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:57.707945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:57.711453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:57.730845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.731457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.732008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.733226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.733821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.734364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.752420 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 HTTP/1.1 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0af2a74f-2c50-42f5-a7cf-750b826e0179'} Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 00:59:57.755360 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 00:59:57.761155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 00:59:57.762539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fb02509-90d6-40cc-ad32-d65536a6cb59 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179" status: 404 len: 111 microversion: 2.1 time: 0.061107 Oct 19 00:59:57.773687 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1613/3322] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:57 2022] GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 00:59:57.779834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:57.780656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:57.792350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.794125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.795331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.796827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:57.798767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:57.799426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:57.804401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:57.818455 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c479b646-04f2-43eb-b00e-433aca779c30 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.394779 Oct 19 00:59:57.829213 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1710/3323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:57 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:58.046331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:58.057132 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70b2e53d-41b4-496d-a1b0-b81690682e7b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1489 microversion: 2.1 time: 0.282096 Oct 19 00:59:58.057733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1614/3324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:57 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1489 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:58.082715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:58.083234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:58.094039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.094539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.095076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:58.095792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.096255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.099807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:58.114645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-880042310", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 00:59:58.165985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 00:59:58.219865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 00:59:58.348995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68271529-be06-43be-8569-f773c3ed03eb tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 204 len: 0 microversion: 2.1 time: 0.270067 Oct 19 00:59:58.349939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1711/3325] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 00:59:58 2022] DELETE /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 00:59:58.359185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:58.362863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:58.376096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.378991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.379671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:58.380590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.383024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.384232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:58.788131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:58.805135 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37e80e99-8725-4740-b143-25853d94c18c tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1495 microversion: 2.1 time: 0.447711 Oct 19 00:59:58.808242 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1712/3326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:58 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1495 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:58.817977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0b8dddf-5be1-4e11-b7c8-7be6ca0adc5b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4322550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:58.881547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0b8dddf-5be1-4e11-b7c8-7be6ca0adc5b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.071875 Oct 19 00:59:58.882708 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1713/3327] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:58 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:58.893783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:58.894402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:58.900885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.901376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.902208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:58.902902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:58.903592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:58.904122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:59.406399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 00:59:59.407440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 00:59:59.407933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 00:59:59.408353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 00:59:59.408824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 00:59:59.421961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:59.422591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:59.423362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:59.424277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:59.425226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:59.425540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:59.435613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:59.458579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4296c3c7-b6f5-4a8f-a05e-89ea483a3b0e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.568933 Oct 19 00:59:59.459010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1714/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:58 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:59.470956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 00:59:59.477310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 00:59:59.502200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 00:59:59.504778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 00:59:59.575675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb0eb492-1ce2-4c04-91eb-c57892fda63c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467470 Oct 19 00:59:59.576763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1615/3329] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 00:59:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 00:59:59.588178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dfe2740b-a03f-4684-9fb7-66ea54d47c9b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:59.588822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dfe2740b-a03f-4684-9fb7-66ea54d47c9b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:59.691509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dfe2740b-a03f-4684-9fb7-66ea54d47c9b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 00:59:59.702777 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dfe2740b-a03f-4684-9fb7-66ea54d47c9b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1214 microversion: 2.1 time: 0.117407 Oct 19 00:59:59.708761 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1715/3330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:59 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 00:59:59.835719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 00:59:59.836356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 00:59:59.842558 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 00:59:59.846416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:59.846932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:59.847388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:59.848173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 00:59:59.848663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 00:59:59.849418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 00:59:59.910680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55fd1795-89f4-46df-aab1-55ed8eef0732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4346c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:00.002690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55fd1795-89f4-46df-aab1-55ed8eef0732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.107566 Oct 19 01:00:00.003719 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1716/3331] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 00:59:59 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:00.108297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:00.110925 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:00.119556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-854e1e93-111f-422d-9f55-2ec0c8c68077 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1495 microversion: 2.1 time: 0.289954 Oct 19 01:00:00.121070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1616/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 00:59:59 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1495 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:00.485308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:00.485891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:00.499978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:00.515090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:00.516770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:00.519763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:00.524468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:00.525410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:00.597396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-946d6489-e435-45bf-9cc1-13baed18b3ac tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af432f4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMU+1dAVn7IzqkDv6qRFdkl75gYPdJ+UCdX7qx3U5eIuwaHA8nVf/j2ZvnVw4YhnEuHEa7qTcPUdI1W7LwOC0Fop7d5RhBbxwID6Nk4BGW1O6eEFD8LuXQn/LmqMeGUVQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-946d6489-e435-45bf-9cc1-13baed18b3ac tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 257 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMU+1dAVn7IzqkDv6qRFdkl75gYPdJ+UCdX7qx3U5eIuwaHA8nVf/j2ZvnVw4YhnEuHEa7qTcPUdI1W7LwOC0Fop7d5RhBbxwID6Nk4BGW1O6eEFD8LuXQn/LmqMeGUVQ=="}} Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMU+1dAVn7IzqkDv6qRFdkl75gYPdJ+UCdX7qx3U5eIuwaHA8nVf/j2ZvnVw4YhnEuHEa7qTcPUdI1W7LwOC0Fop7d5RhBbxwID6Nk4BGW1O6eEFD8LuXQn/LmqMeGUVQ=='}}} Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 19 01:00:00.603715 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-946d6489-e435-45bf-9cc1-13baed18b3ac tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:00.610458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-946d6489-e435-45bf-9cc1-13baed18b3ac tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.605055 Oct 19 01:00:00.617800 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1717/3333] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:00 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 614 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:00:00.637422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac00e801-02bc-4213-876f-0fb173c23b04", "name": "network-vif-deleted", "tag": "69bc52c1-2c85-49c6-854c-f807f7dd09f3"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:00.664355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:00.665333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:00.667911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:00.694765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] Creating event network-vif-deleted:69bc52c1-2c85-49c6-854c-f807f7dd09f3 for instance ac00e801-02bc-4213-876f-0fb173c23b04 on n-h2-master-1 Oct 19 01:00:00.705297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-fd0c089c-624d-4264-a039-924d007e6a4f req-f4c7e443-a8a5-4812-9e05-a197b562b180 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084089 Oct 19 01:00:00.707852 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1718/3334] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:00.719404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af440be50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450211525", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:00.767389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:00.787159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for user cc36181de6f34dc6b59bbf1eb6cc383e and project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:00.831055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:00.841408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9454f86d-9c13-479d-bc80-8f9eb320120b tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.361616 Oct 19 01:00:00.844445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1617/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:00 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:00.858521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:00.870655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:00.871906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:00.879155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:00.879802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:00.880409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:00.881376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:00.882014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:00.882696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 2166 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-450211525", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:00.884415 n-d-master-1 devstack@n-api.service[131449]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-450211525', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:00.887513 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:00.891834 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e82fc7f7-1b4a-410b-a64e-92c5ca92a5b5 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.178616 Oct 19 01:00:00.893600 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1719/3336] 10.222.0.27 () {60 vars in 1160 bytes} [Wed Oct 19 01:00:00 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 183 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:00.905001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eeb03df3-0ae3-4675-adc9-61e2780f4c3c tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af42e5550>, body: {"keypair": {"name": "tempest-keypair-1417787722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9vPvdHUt7hs5hrrEI4tLzdKb23IotWyeWQp4VjxvtuniJS62WiRNQnA8OwvZoUpeLjE7YESWMMyTiJfIfYAOoQQpMuttFhl23X7cG2Tz74oGWInTkrEvqFBDN9NwOLig=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:00.945389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eeb03df3-0ae3-4675-adc9-61e2780f4c3c tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:00.960349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eeb03df3-0ae3-4675-adc9-61e2780f4c3c tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for user cc36181de6f34dc6b59bbf1eb6cc383e and project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:01.039045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:01.040387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eeb03df3-0ae3-4675-adc9-61e2780f4c3c tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139227 Oct 19 01:00:01.041470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1720/3337] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:01.058299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-442e27a1-c6c1-464e-aa99-a89d3d637a21 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42db820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:01.066298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fce338f3-78ec-4b3f-899b-841d5f83f2d4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1210 microversion: 2.1 time: 0.199046 Oct 19 01:00:01.067030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1618/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:00 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:01.089261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af93aa160>, body: {"keypair": {"name": "tempest-keypair-1417787722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbxPTvaZXLlWeo71OgdSAMMEShO2XThPN598I2rSX2YfPEalqoj9rpHs4KKOUXMDdwEKvqmO+ODg3P5+cAHccoMt7mrGsy7cN7pmpcA6g7USOlH5h9LHDCRXT/t0WtspQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.132384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:01.137529 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-442e27a1-c6c1-464e-aa99-a89d3d637a21 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.094546 Oct 19 01:00:01.139082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for user cc36181de6f34dc6b59bbf1eb6cc383e and project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:01.148991 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1721/3339] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:01 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:01.167484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:01.169321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:01.179862 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] HTTP exception thrown: Key pair 'tempest-keypair-1417787722' already exists. Oct 19 01:00:01.190134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.190676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.191135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:01.192212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.192702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.194672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 273 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: {"keypair": {"name": "tempest-keypair-1417787722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbxPTvaZXLlWeo71OgdSAMMEShO2XThPN598I2rSX2YfPEalqoj9rpHs4KKOUXMDdwEKvqmO+ODg3P5+cAHccoMt7mrGsy7cN7pmpcA6g7USOlH5h9LHDCRXT/t0WtspQ=="}} Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: exception: Key pair 'tempest-keypair-1417787722' already exists. Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1417787722', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbxPTvaZXLlWeo71OgdSAMMEShO2XThPN598I2rSX2YfPEalqoj9rpHs4KKOUXMDdwEKvqmO+ODg3P5+cAHccoMt7mrGsy7cN7pmpcA6g7USOlH5h9LHDCRXT/t0WtspQ=='}}} Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result.read() Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cc36181de6f34dc6b59bbf1eb6cc383e-tempest-keypair-1417787722' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 01:00:01.212966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi session.flush() Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result.read() Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 19 01:00:01.218384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cc36181de6f34dc6b59bbf1eb6cc383e-tempest-keypair-1417787722' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 19, 1, 0, 1, 168158), 'updated_at': None, 'name': 'tempest-keypair-1417787722', 'user_id': 'cc36181de6f34dc6b59bbf1eb6cc383e', 'fingerprint': 'a2:9c:97:22:89:9f:6f:13:93:c8:0d:e1:4e:50:90:07', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbxPTvaZXLlWeo71OgdSAMMEShO2XThPN598I2rSX2YfPEalqoj9rpHs4KKOUXMDdwEKvqmO+ODg3P5+cAHccoMt7mrGsy7cN7pmpcA6g7USOlH5h9LHDCRXT/t0WtspQ==', 'type': 'ssh'}] Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi keypair.create() Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._create() Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1417787722' already exists. Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 19 01:00:01.228528 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1417787722' already exists. Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1417787722' already exists. Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 409 to user: Key pair 'tempest-keypair-1417787722' already exists. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b12ca65-7278-4c80-8e16-27664e5ce08b tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.131024 Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1619/3340] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:00:01.235309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3bba8e26-e67e-4865-9e48-0055b3e60ecc tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Calling method '.version_select at 0x7f2af5e6e9d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:01.279883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3bba8e26-e67e-4865-9e48-0055b3e60ecc tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417787722" status: 202 len: 0 microversion: 2.1 time: 0.060076 Oct 19 01:00:01.286139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1620/3341] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417787722 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:00:01.294218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea46983a-d546-48e6-adef-9885e3f72c78 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af4d52550>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+Wb5gcjXDkO9QIgA5lsGfyVg3zxXSdHrfBDpShKlcixylyxmCDchqyW58Thn60Aczi2FMFjxPNZsuV/pWtVJmY2Jgs76bo9GQ0dNLRHbD0f+757rVLF6FOmBlCOG/VXQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea46983a-d546-48e6-adef-9885e3f72c78 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 247 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+Wb5gcjXDkO9QIgA5lsGfyVg3zxXSdHrfBDpShKlcixylyxmCDchqyW58Thn60Aczi2FMFjxPNZsuV/pWtVJmY2Jgs76bo9GQ0dNLRHbD0f+757rVLF6FOmBlCOG/VXQ=="}} Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+Wb5gcjXDkO9QIgA5lsGfyVg3zxXSdHrfBDpShKlcixylyxmCDchqyW58Thn60Aczi2FMFjxPNZsuV/pWtVJmY2Jgs76bo9GQ0dNLRHbD0f+757rVLF6FOmBlCOG/VXQ=='}}} Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi '' Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:00:01.307041 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.312600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea46983a-d546-48e6-adef-9885e3f72c78 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.313774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.313871 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea46983a-d546-48e6-adef-9885e3f72c78 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.019642 Oct 19 01:00:01.313971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.314066 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1621/3342] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:00:01.316911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:01.317787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid ac00e801-02bc-4213-876f-0fb173c23b04 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:00:01.334562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af4bf1ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865683871", "public_key": " "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.388487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:01.392431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:01.406716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for user cc36181de6f34dc6b59bbf1eb6cc383e and project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:01.417926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14806046-10e8-416c-9085-3693d781439d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 200 len: 1310 microversion: 2.1 time: 0.265085 Oct 19 01:00:01.418765 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1722/3343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:01 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:01.429229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ab45ed-948a-45dc-bb0e-e0de19d2572a", "name": "network-vif-plugged", "status": "completed", "tag": "0bc4e9c2-7c47-4094-a854-7d2f0ee1d464"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.455642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.458468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.459116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:01.464704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 95 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1865683871", "public_key": " "}} Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1865683871', 'public_key': ' '}}} Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.470770 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.477143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.482705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.484639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f93d45e-34cd-4ba9-bafe-b31e3a6e6f14 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.165261 Oct 19 01:00:01.487152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1622/3344] 10.222.0.27 () {60 vars in 1158 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:01.502722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] Creating event network-vif-plugged:0bc4e9c2-7c47-4094-a854-7d2f0ee1d464 for instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a on n-h2-master-1 Oct 19 01:00:01.504830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44466701-a47d-4d0d-b260-ab036647d7ca tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af4cb8dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNchWfr5NaVXt32jczwpiCUvEIY30nugFXXg95Hrv/cauQx7j78yYEw8nRD8Jltu/l7zO86PnBmRZ1Vv1sjxkByPQaG06SNfsizoPCJvpKcP+y16xoSf4ftcRKt8JcARgw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.513226 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-83e6101c-310f-4807-aced-90a99be87aa5 req-a18c5285-7b05-4e22-87a5-164d10670df6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093039 Oct 19 01:00:01.517109 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1723/3345] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44466701-a47d-4d0d-b260-ab036647d7ca tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 507 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNchWfr5NaVXt32jczwpiCUvEIY30nugFXXg95Hrv/cauQx7j78yYEw8nRD8Jltu/l7zO86PnBmRZ1Vv1sjxkByPQaG06SNfsizoPCJvpKcP+y16xoSf4ftcRKt8JcARgw=="}} Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNchWfr5NaVXt32jczwpiCUvEIY30nugFXXg95Hrv/cauQx7j78yYEw8nRD8Jltu/l7zO86PnBmRZ1Vv1sjxkByPQaG06SNfsizoPCJvpKcP+y16xoSf4ftcRKt8JcARgw=='}}} Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 19 01:00:01.520942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 19 01:00:01.525477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.529377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44466701-a47d-4d0d-b260-ab036647d7ca tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.539624 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44466701-a47d-4d0d-b260-ab036647d7ca tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.034885 Oct 19 01:00:01.539624 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1623/3346] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:00:01.545816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Action: 'create', calling method: .version_select at 0x7f2af42e53a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1277384294", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:01.568352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:01.577394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Getting quotas for user cc36181de6f34dc6b59bbf1eb6cc383e and project 19fba46eb5574a409d9804a21e10d7ba. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:01.598487 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 118 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1277384294", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: exception: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1277384294', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 19 01:00:01.601864 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb500477-3343-49bd-9622-7a7576ff3289 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.062683 Oct 19 01:00:01.612107 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1724/3347] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:00:01 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 01:00:01.617004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af04f828-2b36-42de-942b-82083b673fc7 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Calling method '.version_select at 0x7f2af555d430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:01.632438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-af04f828-2b36-42de-942b-82083b673fc7 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af04f828-2b36-42de-942b-82083b673fc7 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Request method failure captured: Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-144648145 HTTP/1.1 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wPmX_tLnM0DmUgW0_hAFgY5N6UNhC-FTQcwNdMJtzYScUEyz4pf1ztjl2q-P--SsaSdMNsEIplubMlIa5i63ZuLXtslayoTrTDUX1u4y749gx-ASCJEf1DKHJDpjO4FK2rh2u7yMReSL_uo13NEmwrfgoS2bVgv-pLtUf3869HZfE Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_19fba46eb5574a409d9804a21e10d7ba", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/19fba46eb5574a409d9804a21e10d7ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/19fba46eb5574a409d9804a21e10d7ba"}]}] Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 19fba46eb5574a409d9804a21e10d7ba Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1081481601 Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1081481601-project Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: exception: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'tempest-keypair-non-existent-144648145'} Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise self.value Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.634359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:01.639441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af04f828-2b36-42de-942b-82083b673fc7 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] Returning 404 to user: Keypair tempest-keypair-non-existent-144648145 not found for user cc36181de6f34dc6b59bbf1eb6cc383e {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:01.646543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af04f828-2b36-42de-942b-82083b673fc7 tempest-KeyPairsNegativeTestJSON-1081481601 tempest-KeyPairsNegativeTestJSON-1081481601-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-144648145" status: 404 len: 144 microversion: 2.1 time: 0.036239 Oct 19 01:00:01.650041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1624/3348] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 01:00:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-144648145 => generated 144 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:01.876107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:01.877632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:01.900961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.902577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.905828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:01.907170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:01.908154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:01.909114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.095902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.097274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.107249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.108176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.108932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.109846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.111003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.111790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.280508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:02.297811 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-74803536-18b9-40a1-a777-9edc80fbda75 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1272 microversion: 2.1 time: 0.206247 Oct 19 01:00:02.298419 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1625/3349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:02.303141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf056119-ff67-40be-8fe3-b6144f810ecd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4f1ce50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.374300 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf056119-ff67-40be-8fe3-b6144f810ecd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.074042 Oct 19 01:00:02.375636 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1626/3350] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:02.381082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:02.392330 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28b9071c-148e-4ef0-a6f8-113707752c71 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1312 microversion: 2.1 time: 0.524460 Oct 19 01:00:02.398717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1725/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:01 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1312 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:02.446831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.447605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.455766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.456588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.457626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.458676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.459377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.460642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.476980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 HTTP/1.1 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ac00e801-02bc-4213-876f-0fb173c23b04'} Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.479149 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.484356 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.488530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.489623 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87e1f1e6-cdba-4e00-b682-e8068277a34b tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 404 len: 111 microversion: 2.1 time: 0.047581 Oct 19 01:00:02.490293 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1627/3352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.512738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.513603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.521935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.523309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.524169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.525314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.526176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.526824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.544176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 HTTP/1.1 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ac00e801-02bc-4213-876f-0fb173c23b04'} Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.546710 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.551926 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.555464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.557203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33461830-b66b-492a-ac7e-6f2fa6e642fc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 404 len: 111 microversion: 2.1 time: 0.050137 Oct 19 01:00:02.568729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.569651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: ac00e801-02bc-4213-876f-0fb173c23b04] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.573836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1726/3353] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:02 2022] DELETE /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.579291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.579825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.580461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.581260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.581983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.582625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.606181 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 HTTP/1.1 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ac00e801-02bc-4213-876f-0fb173c23b04'} Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.611922 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance ac00e801-02bc-4213-876f-0fb173c23b04 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.617276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a6059368-d0d5-4eeb-b798-46218f335e50 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04" status: 404 len: 111 microversion: 2.1 time: 0.050396 Oct 19 01:00:02.622570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.623596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.633018 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1628/3354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/ac00e801-02bc-4213-876f-0fb173c23b04 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.634523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.637410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.641770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.643100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.643922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.644795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.685309 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 HTTP/1.1 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c57dd915-27b7-4efe-8d7b-ba0b8ff06c15'} Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.686922 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.692154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.698371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8fe96abe-8f31-4f08-ac05-603afb812698 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 404 len: 111 microversion: 2.1 time: 0.069512 Oct 19 01:00:02.702119 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1727/3355] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:02 2022] DELETE /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:00:02.708087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.708737 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: c57dd915-27b7-4efe-8d7b-ba0b8ff06c15] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.720141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.723769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.724590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.727439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.727990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.729153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.755117 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 HTTP/1.1 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c57dd915-27b7-4efe-8d7b-ba0b8ff06c15'} Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.759996 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.765231 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37820b3b-75ca-43f0-8012-4d55a0231cd0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15" status: 404 len: 111 microversion: 2.1 time: 0.060495 Oct 19 01:00:02.768532 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1629/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/c57dd915-27b7-4efe-8d7b-ba0b8ff06c15 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.774852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.775613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.783307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.784083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.784542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.785275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.785954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.786580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.815220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 HTTP/1.1 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0e7bec6a-e56c-4f86-aea8-b3cac8a54f63'} Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.817119 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.823041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.825303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.826521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-739455f3-b10a-4239-8366-026c257f7b12 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 404 len: 111 microversion: 2.1 time: 0.056789 Oct 19 01:00:02.826939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1728/3357] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:02 2022] DELETE /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.836926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.837539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.847018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.848877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.849758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.852432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.853076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.853358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.878438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 HTTP/1.1 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0e7bec6a-e56c-4f86-aea8-b3cac8a54f63'} Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.888942 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. Oct 19 01:00:02.893848 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.903778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.905420 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-857c9717-9fb4-4539-a316-e7f8e97c6c5a tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63" status: 404 len: 111 microversion: 2.1 time: 0.073796 Oct 19 01:00:02.906683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1630/3358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/0e7bec6a-e56c-4f86-aea8-b3cac8a54f63 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:02.914560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:02.915057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:02.928752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.929256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.929694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.932366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:02.932872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:02.933305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:02.979000 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=13,nova_cell1:INSERT=2,nova_cell1:DELETE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:02.982337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 HTTP/1.1 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '2e6f1035-007d-47b4-97a6-b29083848983'} Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:02.987954 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:02.992789 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-671a8e30-156e-4a52-950a-b4269af5c51d tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 404 len: 111 microversion: 2.1 time: 0.080807 Oct 19 01:00:02.995253 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1729/3359] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:02 2022] DELETE /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.004450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.006266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 2e6f1035-007d-47b4-97a6-b29083848983] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.020278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.020837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.021285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.032852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.035156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.035953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.102599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 HTTP/1.1 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2e6f1035-007d-47b4-97a6-b29083848983'} Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.104658 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. Oct 19 01:00:03.109228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.111690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 2e6f1035-007d-47b4-97a6-b29083848983 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.113210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-129945a2-1f23-4046-894c-f48df863affa tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983" status: 404 len: 111 microversion: 2.1 time: 0.113734 Oct 19 01:00:03.118023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1631/3360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:02 2022] GET /compute/v2.1/servers/2e6f1035-007d-47b4-97a6-b29083848983 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.123665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.124170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.151727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.153084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.157215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.173872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.173872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.173872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.193486 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c HTTP/1.1 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: exception: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'caf12d9e-0820-459a-8ee5-ece31d9c538c'} Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.195137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.201347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-406e020c-6972-49c6-b3e0-60a4783a7ce6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 404 len: 111 microversion: 2.1 time: 0.077816 Oct 19 01:00:03.206354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.206976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf12d9e-0820-459a-8ee5-ece31d9c538c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.213017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1730/3361] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:03 2022] DELETE /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.213967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.214460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.214905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.215607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.216063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.216498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.232870 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c HTTP/1.1 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: exception: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'caf12d9e-0820-459a-8ee5-ece31d9c538c'} Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.234969 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. Oct 19 01:00:03.239524 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.241879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance caf12d9e-0820-459a-8ee5-ece31d9c538c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.243020 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f260ae1b-055f-4935-95ab-af46d19d797e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c" status: 404 len: 111 microversion: 2.1 time: 0.040761 Oct 19 01:00:03.255249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.256047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.260237 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1632/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/servers/caf12d9e-0820-459a-8ee5-ece31d9c538c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.263990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.264539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.265082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.266079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.267005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.267734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.283606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca HTTP/1.1 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: exception: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'dc4dd459-fc61-4ee4-a19d-87b8696bdcca'} Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.285521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06cd1140-458e-408f-90e9-3b47373656ac tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 404 len: 111 microversion: 2.1 time: 0.037629 Oct 19 01:00:03.292179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1731/3363] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:03 2022] DELETE /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.297551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.298147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: dc4dd459-fc61-4ee4-a19d-87b8696bdcca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.307547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.308707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.309174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.309898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.310363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.310799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.327077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.327730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.336340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca HTTP/1.1 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dc4dd459-fc61-4ee4-a19d-87b8696bdcca'} Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.339882 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. Oct 19 01:00:03.344468 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.345793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.348439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance dc4dd459-fc61-4ee4-a19d-87b8696bdcca could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.349984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bec53851-548c-492e-b277-9c38733ed4d0 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca" status: 404 len: 111 microversion: 2.1 time: 0.056690 Oct 19 01:00:03.352070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1633/3364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/servers/dc4dd459-fc61-4ee4-a19d-87b8696bdcca => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.361620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.362646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.371342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.372344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.373082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.374142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.374850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.375904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.394653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 HTTP/1.1 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9de65650-94b2-4e53-b933-0d63547b4f40'} Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.396903 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.401923 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.407296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.408437 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8107a33b-0707-4113-b460-1507964152a6 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40" status: 404 len: 111 microversion: 2.1 time: 0.053091 Oct 19 01:00:03.409683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1634/3365] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:03 2022] DELETE /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.416865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bea34dab-b644-424c-aea8-c9ff33541577 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af93aa8b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.488808 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bea34dab-b644-424c-aea8-c9ff33541577 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.077035 Oct 19 01:00:03.495891 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1635/3366] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:03.503802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.505785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: 9de65650-94b2-4e53-b933-0d63547b4f40] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.519026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.521734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.522945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.524833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.526079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.527255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.585391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 HTTP/1.1 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9de65650-94b2-4e53-b933-0d63547b4f40'} Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.588741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. Oct 19 01:00:03.595019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:03.597165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance 9de65650-94b2-4e53-b933-0d63547b4f40 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:03.598667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3f9795b-1dac-41aa-bbb3-c8342b95e6cc tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40" status: 404 len: 111 microversion: 2.1 time: 0.101363 Oct 19 01:00:03.599451 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1636/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/servers/9de65650-94b2-4e53-b933-0d63547b4f40 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:03.607949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:03.608670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:03.618332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.619577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.619861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.621725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.622379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.623149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.823006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:03.838011 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-48082d8d-c509-4e79-8a73-ad3a4570bc13 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.515124 Oct 19 01:00:03.841811 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1732/3368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:03.849384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9276ba46-49f5-405b-af88-c0e926b5a630", "name": "network-vif-plugged", "status": "completed", "tag": "ad4714f7-2275-4b63-987e-d6cadad35c51"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:03.883472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:03.908358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:03.910774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:03.965172 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] Creating event network-vif-plugged:ad4714f7-2275-4b63-987e-d6cadad35c51 for instance 9276ba46-49f5-405b-af88-c0e926b5a630 on n-h2-master-1 Oct 19 01:00:03.988393 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d7c5f615-6813-4452-b307-aace952d3797 req-aa470357-b4f4-4539-984a-076b21f1f37b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143847 Oct 19 01:00:03.993982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1733/3369] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:04.003018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.003614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:04.046293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.051100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.059498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.060932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.063813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.065828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.122744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:04.136562 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab2700e9-fad1-44c7-a84c-18a8f964d341 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1497 microversion: 2.1 time: 0.534557 Oct 19 01:00:04.137624 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1637/3370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:03 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1497 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:04.165568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.205282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_groups [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Querying cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) for 1 instances {{(pid=131450) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 01:00:04.206649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.207485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.208167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.213670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:00:04.265497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d20ad370-37fd-450c-8cb2-71dea5170a15 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468" status: 200 len: 222 microversion: 2.1 time: 0.104919 Oct 19 01:00:04.268114 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1638/3371] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:00:04 2022] GET /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468 => generated 222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:00:04.280548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.281192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.317399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.387211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:00:04.406683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf17df76-419d-4220-bbc3-990a19dbde43 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "DELETE /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 204 len: 0 microversion: 2.1 time: 0.405717 Oct 19 01:00:04.409463 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1734/3372] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:03 2022] DELETE /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:00:04.430470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.433546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:04.456363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.458883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.460403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.463025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.464555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.465838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.550338 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-584a42ae-1dd1-4933-a799-7957ff1ed428 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 204 len: 0 microversion: 2.1 time: 0.273597 Oct 19 01:00:04.551160 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1639/3373] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:04 2022] DELETE /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:00:04.560069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-445ba9f3-d2d1-40bf-8b76-e372520681de tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4b9f9d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.613367 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-445ba9f3-d2d1-40bf-8b76-e372520681de tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.060303 Oct 19 01:00:04.615103 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1640/3374] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:04 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:04.626447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.628267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:04.644366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.645025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.645497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.646230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.646692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.647826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.857998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:04.871585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-715b395c-bcaa-40c8-81bc-d1967438cda1 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1480 microversion: 2.1 time: 0.454337 Oct 19 01:00:04.887220 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1735/3375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:04 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1480 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:04.899758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:04.900669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:04.914566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.915067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.915509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.916223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:04.916700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:04.917130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:04.960112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:04.970760 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-06016dfd-8899-47f6-8b91-a0c0d82085e6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1503 microversion: 2.1 time: 0.352322 Oct 19 01:00:04.972670 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1641/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:04 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:05.150864 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:05.274120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:05.287461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-96c74603-5ad2-4eb1-afd5-938edece0ef0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.394315 Oct 19 01:00:05.311178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1736/3377] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:04 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:05.634194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c784ca11-abb6-4c14-a5da-d83fa3c64363 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4d67c10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:05.708575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c784ca11-abb6-4c14-a5da-d83fa3c64363 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.082598 Oct 19 01:00:05.709197 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1642/3378] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:05 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:05.904034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:05.905491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:05.921977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:05.924011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:05.925351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:05.929710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:05.933738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:05.934921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.000345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:06.000936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:06.014999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:06.015501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:06.015956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.038955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:06.039655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:06.040123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.811191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:06.870558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-013be358-e81e-4825-950a-25ff1e178af7 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1503 microversion: 2.1 time: 0.876124 Oct 19 01:00:06.876676 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1643/3379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:05 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1503 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:06.876676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e77d1863-1d71-49e1-95ff-948460a41aa7", "tag": "b7a11db6-be7c-4723-a365-39316ad4bac1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:06.891377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:06.908795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae47c519-3c8c-46e9-bf77-1937445b746e tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1480 microversion: 2.1 time: 1.012902 Oct 19 01:00:06.909392 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1737/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:05 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1480 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:06.918749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:06.919247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:06.919684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.926596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:06.927207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:06.937290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:06.937826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:06.938464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.939357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:06.940101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:06.940805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:06.956803 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] Creating event network-changed:b7a11db6-be7c-4723-a365-39316ad4bac1 for instance e77d1863-1d71-49e1-95ff-948460a41aa7 on n-h1-master-1 Oct 19 01:00:06.973214 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-03b1d7d1-c8ac-4ae4-af84-ed5f2d860ba0 req-1ffea92f-2525-4096-b239-321dd13cf178 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098803 Oct 19 01:00:06.977309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1644/3381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:06.997017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:07.010538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.011040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.011492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.071972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:00:07.143316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bca88a3b-ec5c-4da6-9d05-3b07725b663d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action" status: 202 len: 0 microversion: 2.1 time: 0.161176 Oct 19 01:00:07.147753 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1645/3382] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:00:06 2022] POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:00:07.158731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c2f8c7ed-24ae-4080-92f1-1e20c212ee01 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4b9f040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:07.244662 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c2f8c7ed-24ae-4080-92f1-1e20c212ee01 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.094792 Oct 19 01:00:07.245558 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1646/3383] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:07 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:07.251865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:07.252869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:07.284117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.284999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.288185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.289529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.306319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.307061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.517652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:07.527649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de06e4cb-4939-44af-a741-918069fe2402 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.617145 Oct 19 01:00:07.528172 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1738/3384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:06 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:07.851904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:07.869510 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc539fc5-53e2-4845-9ef4-01c7d14436cd tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.620384 Oct 19 01:00:07.872969 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1647/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:07 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:07.898545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:07.903107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:07.933868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:07.934708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:07.937937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.942973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.946027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.953661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.954492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.956239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.957171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.963145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.965937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:07.966965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:07.968441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:07.969358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:08.206817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b49d34906d44819c47d0ad5f1a9bc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7cd9e94413f41e6aebee479e4c87705', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:08.217513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8ee920fc-e0ab-4f8b-b593-19d18ff513ba tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 200 len: 1461 microversion: 2.1 time: 0.324998 Oct 19 01:00:08.221637 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1739/3386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:07 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 1461 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:08.255755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ab45ed-948a-45dc-bb0e-e0de19d2572a", "name": "network-vif-deleted", "tag": "0bc4e9c2-7c47-4094-a854-7d2f0ee1d464"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:08.270348 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:08.288177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:08.289809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:08.291139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:08.328763 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] Creating event network-vif-deleted:0bc4e9c2-7c47-4094-a854-7d2f0ee1d464 for instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a on n-h2-master-1 Oct 19 01:00:08.335504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:08.339512 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:08.353612 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4862120c-8016-4a15-b12e-432752598ccb req-e0b69252-33b8-48e7-af70-def5d01adaea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130377 Oct 19 01:00:08.356919 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1740/3387] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:08.361405 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be0e7660-bbaf-4d0b-a3e3-6c971daf8f9f tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1438 microversion: 2.1 time: 0.431564 Oct 19 01:00:08.377904 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1648/3388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:07 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1438 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:08.390634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-628e52db-f8a0-4fd4-8c58-d5805770487c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42ebaf0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:08.472575 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-628e52db-f8a0-4fd4-8c58-d5805770487c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.112662 Oct 19 01:00:08.473232 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1741/3389] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:08 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:08.557572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:08.558396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:08.623060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:08.629776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:08.633481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:08.634535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:08.637650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:08.638389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:08.896358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:08.898407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:08.918492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:08.919393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:08.921031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:08.923284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:08.937014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:08.939560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.417122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:09.425365 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b991a0f-3a02-4a86-8929-d596383e31aa tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.873949 Oct 19 01:00:09.431858 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1649/3390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:08 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:09.436649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:09.437280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:09.440239 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:09.485585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.486094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.486548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.495641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.496180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.496668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.549333 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a HTTP/1.1 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '03ab45ed-948a-45dc-bb0e-e0de19d2572a'} Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:09.570873 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:09.576493 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:09.583993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:09.585232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-546d6170-00e0-4850-9585-c5e6cb87c327 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 404 len: 111 microversion: 2.1 time: 0.152416 Oct 19 01:00:09.585987 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1650/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:09 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:09.602259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2", "name": "network-vif-deleted", "tag": "38fb0bfd-8693-4276-af89-25bcd04edb6d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:09.625050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.625542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.625981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.676690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] Creating event network-vif-deleted:38fb0bfd-8693-4276-af89-25bcd04edb6d for instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 on n-h1-master-1 Oct 19 01:00:09.676992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:09.692549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9725c2a-fc5d-4bf8-aa70-de0b0807b15f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.800931 Oct 19 01:00:09.695227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1742/3392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:08 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:09.696484 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-903432ec-5d4f-496b-b1bd-493bb9222393 req-ffbb1903-2a5e-483d-8e48-bccc5a5920bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103898 Oct 19 01:00:09.704221 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1651/3393] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:09.712931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:09.715517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:09.732000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.732493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.741196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.741987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.742465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.742898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.756942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e5cb2aa-7471-4fda-8502-9b4230b05223 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4c36f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:09.873743 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e5cb2aa-7471-4fda-8502-9b4230b05223 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.166818 Oct 19 01:00:09.878515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.879311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.880109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:09.880816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lazy-loading 'fault' on Instance uuid caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:00:09.883239 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1652/3394] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:09 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:09.891555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:09.951976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9ac716a6af441a4bc02d8ef11f81487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dd9caff7d2f4782934111951d0c42fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:09.969322 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9b8ad51-930d-4578-bf32-7bb46b1a97ba tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 200 len: 1283 microversion: 2.1 time: 0.269137 Oct 19 01:00:09.974509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_groups [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Querying cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) for 1 instances {{(pid=131450) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 01:00:09.983614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:09.984958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:09.986082 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1743/3395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:09 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 1283 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:09.989961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.030618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9956beb7-3a67-4062-b420-746fc14952cd tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.141327 Oct 19 01:00:10.034187 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1653/3396] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:00:09 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:10.047536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.087476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.compute.server_groups [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Querying cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) for 1 instances {{(pid=131449) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 19 01:00:10.088656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.095581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.096665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.119437 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1049fb2-862b-4541-82ba-f1568f4ac465 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468" status: 200 len: 184 microversion: 2.1 time: 0.077666 Oct 19 01:00:10.124943 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1744/3397] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:00:10 2022] GET /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468 => generated 184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:10.137539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.138250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:10.156091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.157813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.158376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.159199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.159904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.160354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.223519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a HTTP/1.1 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '03ab45ed-948a-45dc-bb0e-e0de19d2572a'} Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:10.227971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.233240 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a52a31d0-be35-4e47-a7f3-8b3be187c76d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 404 len: 111 microversion: 2.1 time: 0.099746 Oct 19 01:00:10.238807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1654/3398] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.247700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.247700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] [instance: 03ab45ed-948a-45dc-bb0e-e0de19d2572a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:10.264135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.266769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.269474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.271616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.273077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.275756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.316807 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a HTTP/1.1 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '03ab45ed-948a-45dc-bb0e-e0de19d2572a'} Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.322503 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.329894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance 03ab45ed-948a-45dc-bb0e-e0de19d2572a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.331194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e5121b5-1f2a-4e3c-9fb5-fd7009e5feca tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a" status: 404 len: 111 microversion: 2.1 time: 0.087925 Oct 19 01:00:10.333320 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1745/3399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:10 2022] GET /compute/v2.1/servers/03ab45ed-948a-45dc-bb0e-e0de19d2572a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.344953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb4184a9-c912-4503-8033-52154161f19d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.358893 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-eb4184a9-c912-4503-8033-52154161f19d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb4184a9-c912-4503-8033-52154161f19d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-server-groups/946489c8-b31b-405f-a8e6-567c125fd363 HTTP/1.1 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: exception: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '946489c8-b31b-405f-a8e6-567c125fd363'} Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.373893 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb4184a9-c912-4503-8033-52154161f19d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance group 946489c8-b31b-405f-a8e6-567c125fd363 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.379427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb4184a9-c912-4503-8033-52154161f19d tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/946489c8-b31b-405f-a8e6-567c125fd363" status: 404 len: 117 microversion: 2.1 time: 0.036799 Oct 19 01:00:10.380295 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1655/3400] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/os-server-groups/946489c8-b31b-405f-a8e6-567c125fd363 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.385207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91c9f4df-47a0-4100-8a8d-dc5a795a0fbc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.393895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-91c9f4df-47a0-4100-8a8d-dc5a795a0fbc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91c9f4df-47a0-4100-8a8d-dc5a795a0fbc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-server-groups/b7c3a75e-11c9-4a68-82d8-fd190e7618c4 HTTP/1.1 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: exception: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b7c3a75e-11c9-4a68-82d8-fd190e7618c4'} Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.396301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. Oct 19 01:00:10.402643 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.408416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91c9f4df-47a0-4100-8a8d-dc5a795a0fbc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance group b7c3a75e-11c9-4a68-82d8-fd190e7618c4 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.412395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91c9f4df-47a0-4100-8a8d-dc5a795a0fbc tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/b7c3a75e-11c9-4a68-82d8-fd190e7618c4" status: 404 len: 117 microversion: 2.1 time: 0.031088 Oct 19 01:00:10.420120 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1746/3401] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/os-server-groups/b7c3a75e-11c9-4a68-82d8-fd190e7618c4 => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.424674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9d96971-e2ca-475d-994e-a4ef34d1b28e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.448182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e9d96971-e2ca-475d-994e-a4ef34d1b28e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9d96971-e2ca-475d-994e-a4ef34d1b28e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-server-groups/2dd7b431-54b2-4814-90ce-c1bbf7214328 HTTP/1.1 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: exception: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2dd7b431-54b2-4814-90ce-c1bbf7214328'} Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.450162 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9d96971-e2ca-475d-994e-a4ef34d1b28e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance group 2dd7b431-54b2-4814-90ce-c1bbf7214328 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.455651 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9d96971-e2ca-475d-994e-a4ef34d1b28e tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/2dd7b431-54b2-4814-90ce-c1bbf7214328" status: 404 len: 117 microversion: 2.1 time: 0.032095 Oct 19 01:00:10.458199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.459111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:10.460366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1656/3402] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/os-server-groups/2dd7b431-54b2-4814-90ce-c1bbf7214328 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.471236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.471946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.472558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.473552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.474233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.474831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.486723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87a796f4-9387-4121-a6e6-cd464a031953 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.523440 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-87a796f4-9387-4121-a6e6-cd464a031953 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] HTTP exception thrown: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87a796f4-9387-4121-a6e6-cd464a031953 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Request method failure captured: Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-server-groups/af245758-4283-4607-89ad-9bba2dab456f HTTP/1.1 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v-DTR54N2aDG9Zr_cJKKqB6GxAM_iAnCX0mdQg_12rp8nhcOjgdga7dasQT5u4PS9fXKD_rJz6twqHOJevz44y5N18ktzBDuNAvSrSYsvmTI-jtVj4qcjLLWHNglMAuZ107zuorMXjXQo_YRfVny_kh2Nr0TR0CsGN9N0GC_Zy6ow Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d7cd9e94413f41e6aebee479e4c87705", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d7cd9e94413f41e6aebee479e4c87705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d7cd9e94413f41e6aebee479e4c87705"}]}] Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d7cd9e94413f41e6aebee479e4c87705 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroupTestJSON-2109603396 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 77b49d34906d44819c47d0ad5f1a9bc4 Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroupTestJSON-2109603396-project Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: exception: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'af245758-4283-4607-89ad-9bba2dab456f'} Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.536239 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87a796f4-9387-4121-a6e6-cd464a031953 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Returning 404 to user: Instance group af245758-4283-4607-89ad-9bba2dab456f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87a796f4-9387-4121-a6e6-cd464a031953 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/af245758-4283-4607-89ad-9bba2dab456f" status: 404 len: 117 microversion: 2.1 time: 0.078142 Oct 19 01:00:10.541971 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1657/3403] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/os-server-groups/af245758-4283-4607-89ad-9bba2dab456f => generated 117 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:10.562205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-587f44d8-ca9f-406f-92b4-fdb823e602f6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.603280 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:10.654342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-587f44d8-ca9f-406f-92b4-fdb823e602f6 tempest-ServerGroupTestJSON-2109603396 tempest-ServerGroupTestJSON-2109603396-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468" status: 204 len: 0 microversion: 2.1 time: 0.105386 Oct 19 01:00:10.659921 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1658/3404] 10.222.0.27 () {58 vars in 1266 bytes} [Wed Oct 19 01:00:10 2022] DELETE /compute/v2.1/os-server-groups/7419f82e-511d-4013-980a-0ada9b715468 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:00:10.726576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:10.727212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:10.744426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.745048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.745552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.746226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:10.746672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:10.747114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:10.926020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:10.941650 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa8481bf-064c-4970-af2a-327908e44ea0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.495308 Oct 19 01:00:10.942643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1747/3405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:10 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:10.958805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-969a4d3f-19d0-4db2-8123-53b42fb5de32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4348790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:11.068799 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-969a4d3f-19d0-4db2-8123-53b42fb5de32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.124683 Oct 19 01:00:11.072325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1748/3406] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:10 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:11.101024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:11.101985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] [instance: caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:11.137851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:11.138374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:11.138829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:11.146161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:11.151857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:11.152447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:11.185681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] HTTP exception thrown: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Request method failure captured: Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 HTTP/1.1 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0sMehm6KE7x-b6rY3RVZyPS8cIemCtIiA1bIm-I510aVstzYGrvV7Y7StOHZaI24bz5Rgvp8cj4nLmxLgty4IqphgAjO8Rjtkv67u2ozN9dwBuarMg3Che5yYzla8AaSdnVIMNwXiFlED92lJtHep4uqfLocfNOCVBQmhTGx0_TPNo Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4dd9caff7d2f4782934111951d0c42fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4dd9caff7d2f4782934111951d0c42fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4dd9caff7d2f4782934111951d0c42fb"}]}] Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestJSON-72219216 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4dd9caff7d2f4782934111951d0c42fb Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestJSON-72219216 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestJSON-72219216-project Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c9ac716a6af441a4bc02d8ef11f81487 Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestJSON-72219216-project Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: exception: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2'} Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:11.193026 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. Oct 19 01:00:11.198626 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:11.200313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] Returning 404 to user: Instance caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:11.201394 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d21dbb5-e5ab-49d0-9807-dd1f95ef7636 tempest-ServersTestJSON-72219216 tempest-ServersTestJSON-72219216-project] 10.222.0.27 "GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2" status: 404 len: 111 microversion: 2.1 time: 0.127372 Oct 19 01:00:11.203566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1749/3407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:11 2022] GET /compute/v2.1/servers/caf55e6e-a9fb-4ceb-a85b-2d7f833bc2a2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:11.375848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:11.413319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d227eb8b-ca9f-4928-8a23-36bb7700f894 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.686010 Oct 19 01:00:11.418904 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1659/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:10 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:11.970573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:11.971973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:11.980434 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=58 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:11.988812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:11.989133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:11.989590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:11.990339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:11.997029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:11.997557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:12.088302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81a2b949-eddb-4322-b676-9128a7c58932 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af49db430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:12.102053 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=78 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:12.180885 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81a2b949-eddb-4322-b676-9128a7c58932 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.093076 Oct 19 01:00:12.183409 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1660/3409] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:12 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:12.443257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:12.445274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:12.462425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:12.470005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:12.471128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:12.473881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:12.474628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:12.476615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:12.484534 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:12.494558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-edb7b5ae-01c5-4599-8dd2-ddfe7f77f985 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 0.527765 Oct 19 01:00:12.495152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1750/3410] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:11 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:13.201872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-258d830e-9e98-48a5-9277-020fcec1885c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af432f820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:13.297357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-258d830e-9e98-48a5-9277-020fcec1885c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.099603 Oct 19 01:00:13.298059 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1751/3411] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:13 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:13.372151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:13.381065 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a300d5f-b74f-4761-aa59-750c1b3cb00b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.941589 Oct 19 01:00:13.398488 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1661/3412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:12 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:13.524609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:13.525535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:13.555466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:13.558218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:13.558798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:13.561385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:13.561978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:13.562975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:14.314348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0dabfdcd-ac5c-4133-8fb1-16b0d61a53fe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4bc35e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:14.415341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0dabfdcd-ac5c-4133-8fb1-16b0d61a53fe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.105133 Oct 19 01:00:14.418899 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1662/3413] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:14 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:14.428646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:14.429286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:14.469705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:14.470214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:14.470665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:14.471402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:14.471876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:14.472311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:15.040164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:15.058046 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ef9b5cc-4f9b-42f6-a3d2-e701910f8c86 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 1.540420 Oct 19 01:00:15.062299 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1752/3414] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:13 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:15.076388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77d1863-1d71-49e1-95ff-948460a41aa7", "name": "network-vif-plugged", "status": "completed", "tag": "b7a11db6-be7c-4723-a365-39316ad4bac1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:15.096168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:15.097305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:15.100420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:15.107854 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:15.140477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] Creating event network-vif-plugged:b7a11db6-be7c-4723-a365-39316ad4bac1 for instance e77d1863-1d71-49e1-95ff-948460a41aa7 on n-h1-master-1 Oct 19 01:00:15.149763 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ddec6856-9c86-41d7-92ec-c67a6845b454 req-98df398b-22f6-4d49-a634-84c477f24fe2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085886 Oct 19 01:00:15.153751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1753/3415] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:15.433180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cfc96129-deb6-42c4-8b70-21c439b669ff tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42eb160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:15.535981 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cfc96129-deb6-42c4-8b70-21c439b669ff tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.108421 Oct 19 01:00:15.538465 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1754/3416] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:15 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:15.981521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:15.998030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4b70a91-0f78-4ffb-9425-2a4aeca27606 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 1.577927 Oct 19 01:00:16.024588 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1663/3417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:14 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:16.083993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:16.085993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:16.104444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:16.108965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:16.113374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:16.114167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:16.114657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:16.120502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:16.551910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0025fba2-947e-4212-978e-8042ce5e563b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af9444820>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:16.661834 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0025fba2-947e-4212-978e-8042ce5e563b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.109556 Oct 19 01:00:16.666838 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1664/3418] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:16 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:17.031386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:17.032098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:17.042614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:17.043112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:17.043565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:17.044294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:17.044791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:17.045273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:17.374835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:17.384802 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cfe06676-3ccc-4e60-bc53-19cb075771c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1314 microversion: 2.1 time: 1.305109 Oct 19 01:00:17.385410 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1755/3419] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:16 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:17.693087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f23b669d-f7ee-477d-bfe1-399c2d831678 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4348ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:17.813776 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f23b669d-f7ee-477d-bfe1-399c2d831678 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.139888 Oct 19 01:00:17.816340 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1756/3420] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:17 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:17.960173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:17.974673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f397ddc2-305e-4c0b-b92a-c2cc54cb90c3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.947634 Oct 19 01:00:18.003414 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1665/3421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:17 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:18.434909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:18.437137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:18.459877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:18.461338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:18.461995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:18.463600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:18.464339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:18.465784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:18.831853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c7400a7-353c-4b83-9261-e18484b00854 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4d67af0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:18.921253 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c7400a7-353c-4b83-9261-e18484b00854 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.092940 Oct 19 01:00:18.924908 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1666/3422] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:18 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:19.016176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:19.022080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:19.050746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.051401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.054722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:19.057145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.062853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.066376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:19.337361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:19.349745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb76cd24-bf13-4cf4-93d6-7fc4ce86f9af tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1502 microversion: 2.1 time: 0.938028 Oct 19 01:00:19.373970 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1757/3423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:18 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1502 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:19.390809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:19.391732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:19.403929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.404861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.406529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:19.407511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.409339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.412605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:19.547130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-966b5a20-1f49-4531-9396-51e834b2fba1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7/action" status: 202 len: 0 microversion: 2.1 time: 0.171030 Oct 19 01:00:19.551998 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1758/3424] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:00:19 2022] POST /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:00:19.562928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:19.563658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:19.596044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.597200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.598614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:19.599545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:19.600747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:19.601350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:21.512602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:21.535458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7bd7cc57-3863-4f1c-b57c-38f14bd4a766 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1507 microversion: 2.1 time: 1.983173 Oct 19 01:00:21.538160 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1759/3425] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:19 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1507 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:21.550330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ca6ac1e-4891-43f5-8c11-8396e2336c5a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4348d30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:21.663128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ca6ac1e-4891-43f5-8c11-8396e2336c5a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.122911 Oct 19 01:00:21.667839 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1760/3426] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:21 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:21.690138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:21.723267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e5439ef-376b-4f8c-9ca6-8ebe547c4957 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 2.714417 Oct 19 01:00:21.752647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1667/3427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:19 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 2737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:22.561038 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:22.561663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:22.579883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:22.581612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:22.582338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:22.585190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:22.585881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:22.586512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:22.684668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-421d6a94-0f55-4e65-bc92-7b9cbab21454 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af49db5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:22.791308 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-421d6a94-0f55-4e65-bc92-7b9cbab21454 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.111500 Oct 19 01:00:22.793464 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1668/3428] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:22 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:22.804639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:22.806447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:22.819365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:22.821493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:22.822136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:22.823790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:22.825519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:22.826213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:23.118347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:23.129961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9549313-73d3-4425-b033-ebb69753f0de tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1487 microversion: 2.1 time: 0.574217 Oct 19 01:00:23.148208 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1761/3429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:22 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1487 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:23.161444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:23.163753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:23.181184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:23.182282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:23.183783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:23.186363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:23.187918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:23.189141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:23.253263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:00:23.301303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:23.320401 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-329a0e97-b189-4370-ac77-040624086b09 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1720 microversion: 2.1 time: 0.520594 Oct 19 01:00:23.324323 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1669/3430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:22 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1720 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:23.595382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7daf527c-5e6b-4433-827e-05ea7adfa1c4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 204 len: 0 microversion: 2.1 time: 0.443613 Oct 19 01:00:23.599223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1762/3431] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:23 2022] DELETE /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:00:23.611234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:23.612244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:23.632376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:23.634499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:23.635670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:23.637832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:23.642087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:23.642855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:23.810304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d4e14fc1-edfe-4ce5-b176-c10d3686fb9e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af438a820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:23.941601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d4e14fc1-edfe-4ce5-b176-c10d3686fb9e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.134296 Oct 19 01:00:23.961074 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1763/3432] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:23 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:24.201361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:24.214393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-576004e6-dacc-48c1-a59b-a4bbf79b89c7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1493 microversion: 2.1 time: 0.609371 Oct 19 01:00:24.216441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1670/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:23 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1493 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:24.347623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:24.348512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:24.361902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:24.364775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:24.367975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:24.369431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:24.372136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:24.374754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:24.741294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:24.753917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3e97d3a-0376-475b-aaea-37379fae3585 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1697 microversion: 2.1 time: 0.411648 Oct 19 01:00:24.755195 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1671/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:24 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1697 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:24.781456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:24.793721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:24.795128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:24.798340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:24.856188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Going to try to start instance {{(pid=131450) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:00:24.958599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31ad1643-4ff9-4dcf-b01d-e36acde35b13 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action" status: 202 len: 0 microversion: 2.1 time: 0.182324 Oct 19 01:00:24.960955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1672/3435] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:00:24 2022] POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:00:24.977950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:24.980552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:24.998818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:24.999724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:25.002149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:25.002987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:25.004375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:25.005803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:25.089792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Calling method '.version_select at 0x7f2af4346430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:25.163282 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 01:00:25.164222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Neutron security group ebee557f-141f-4809-aac4-6f66f8e5670e not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 01:00:25.169109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] HTTP exception thrown: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.169109 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Request method failure captured: Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/ebee557f-141f-4809-aac4-6f66f8e5670e HTTP/1.1 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wobNnujEWLRAUocDi4kewRoirh8uDEVkVY_PgwJ7ycLp-jU0oR2a6auWoyxChSMhl1la_jGAkWl7KioucMj0OvMQ__QaW16K-yyLg2DIPxAY-gF1_ji1PPObQTXfnXsFRN5fg1m_NI5a_PJ8m0KvLPqyQssh4jCeRVKPz8i_H4ccs Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d0aac4d8ecb47ff8ad2e666de23c1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}] Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8f138ca4a03c4459ab40866b7f2e2d94 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: exception: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ebee557f-141f-4809-aac4-6f66f8e5670e'} Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 01:00:25.173196 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] Oct 19 01:00:25.179203 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:25.186067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Returning 404 to user: Security group ebee557f-141f-4809-aac4-6f66f8e5670e does not exist Oct 19 01:00:25.186067 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-839ca330-5146-49e7-bcad-a74af272bdc9'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:25.186868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b14c8564-9850-4a87-9d7a-011b63bd2505 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/ebee557f-141f-4809-aac4-6f66f8e5670e" status: 404 len: 194 microversion: 2.1 time: 0.855767 Oct 19 01:00:25.188672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1764/3436] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 01:00:24 2022] DELETE /compute/v2.1/os-security-groups/ebee557f-141f-4809-aac4-6f66f8e5670e => generated 194 bytes in 859 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:25.229490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f1102db-7201-425a-92ba-19ed94e8f34b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42925e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:25.405158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f1102db-7201-425a-92ba-19ed94e8f34b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.209320 Oct 19 01:00:25.406085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1765/3437] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:25 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:25.430563 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-930430be-c953-4d17-a6f5-c28f58e47806 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.023009 Oct 19 01:00:25.437244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1766/3438] 10.222.0.27 () {58 vars in 1164 bytes} [Wed Oct 19 01:00:25 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 19 01:00:25.469879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:25.470744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:25.486920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:25.487812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:25.488504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:25.489469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:25.493532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:25.494726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:26.852726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:26.882421 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-883c989f-5e19-4b29-bc86-3414088a43b4 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1706 microversion: 2.1 time: 1.915283 Oct 19 01:00:26.886508 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1673/3439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:24 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1706 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:26.901248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8b7abad-8124-45d2-b191-09d928d20bbc tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Calling method '.version_select at 0x7f2af4b97430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:27.079390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:27.089411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97382bff-bc40-4cf5-a43c-f874d3a72f88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 200 len: 1493 microversion: 2.1 time: 1.645937 Oct 19 01:00:27.102627 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1767/3440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:25 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 1493 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:27.124177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64080e93-ae86-40ec-875d-d3b03ea4fcf9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4346940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:27.241514 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64080e93-ae86-40ec-875d-d3b03ea4fcf9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.137482 Oct 19 01:00:27.252866 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1768/3441] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:27 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:27.269778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e77d1863-1d71-49e1-95ff-948460a41aa7", "name": "network-vif-deleted", "tag": "b7a11db6-be7c-4723-a365-39316ad4bac1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:27.305293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:27.306472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:27.306919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:27.351475 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] Creating event network-vif-deleted:b7a11db6-be7c-4723-a365-39316ad4bac1 for instance e77d1863-1d71-49e1-95ff-948460a41aa7 on n-h1-master-1 Oct 19 01:00:27.365928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0b2fca0b-1b53-4754-a42b-c721edaa80f4 req-dbd7208d-288b-465e-948a-6fc4889cf0f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109586 Oct 19 01:00:27.371817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1769/3442] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:27.596567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8b7abad-8124-45d2-b191-09d928d20bbc tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.706997 Oct 19 01:00:27.597539 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1674/3443] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 01:00:26 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:27.613474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Calling method '.version_select at 0x7f2af432ff70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:27.914783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:27.915684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:27.941722 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 01:00:27.942096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:27.943350 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 19 01:00:27.943350 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Request method failure captured: Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/os-security-groups/f88a6bd3-5b60-4e60-9cd3-6c9c1dde4289 HTTP/1.1 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wobNnujEWLRAUocDi4kewRoirh8uDEVkVY_PgwJ7ycLp-jU0oR2a6auWoyxChSMhl1la_jGAkWl7KioucMj0OvMQ__QaW16K-yyLg2DIPxAY-gF1_ji1PPObQTXfnXsFRN5fg1m_NI5a_PJ8m0KvLPqyQssh4jCeRVKPz8i_H4ccs Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d0aac4d8ecb47ff8ad2e666de23c1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}] Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8f138ca4a03c4459ab40866b7f2e2d94 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: exception: Insufficient rights for removing default security group. Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f88a6bd3-5b60-4e60-9cd3-6c9c1dde4289'} Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 01:00:27.945589 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] Oct 19 01:00:27.950359 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:27.956933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:27.956933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:27.957700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 19 01:00:27.957700 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4658316f-4f1d-49cc-ba77-3ef5357f6564'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:27.957700 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e26f93ca-2509-4140-b70e-03f35fb33cb4 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f88a6bd3-5b60-4e60-9cd3-6c9c1dde4289" status: 400 len: 182 microversion: 2.1 time: 0.347119 Oct 19 01:00:27.959448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:27.959448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:27.960375 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1770/3444] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 01:00:27 2022] DELETE /compute/v2.1/os-security-groups/f88a6bd3-5b60-4e60-9cd3-6c9c1dde4289 => generated 182 bytes in 352 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:00:27.972161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:27.974054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Calling method '.version_select at 0x7f2af42eb5e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:28.515464 n-d-master-1 devstack@n-api.service[131449]: DEBUG neutronclient.v2_0.client [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist", "detail": ""}} {{(pid=131449) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 01:00:28.516170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.security_group_api [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Neutron security group 60710ec4-2d39-4085-8e94-e4147a53d612 not found {{(pid=131449) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 01:00:28.517048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] HTTP exception thrown: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.517048 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Request method failure captured: Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/os-security-groups/60710ec4-2d39-4085-8e94-e4147a53d612 HTTP/1.1 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wobNnujEWLRAUocDi4kewRoirh8uDEVkVY_PgwJ7ycLp-jU0oR2a6auWoyxChSMhl1la_jGAkWl7KioucMj0OvMQ__QaW16K-yyLg2DIPxAY-gF1_ji1PPObQTXfnXsFRN5fg1m_NI5a_PJ8m0KvLPqyQssh4jCeRVKPz8i_H4ccs Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d0aac4d8ecb47ff8ad2e666de23c1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}] Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 8f138ca4a03c4459ab40866b7f2e2d94 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: exception: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '60710ec4-2d39-4085-8e94-e4147a53d612'} Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 01:00:28.519290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Returning 404 to user: Security group 60710ec4-2d39-4085-8e94-e4147a53d612 does not exist Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: Neutron server returns request_ids: ['req-4f3a3085-8185-4f2e-af48-148a1774f05f'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b8f58be-cb7d-4325-ae26-3865e0357349 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/60710ec4-2d39-4085-8e94-e4147a53d612" status: 404 len: 194 microversion: 2.1 time: 0.551636 Oct 19 01:00:28.524063 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1771/3445] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:00:27 2022] GET /compute/v2.1/os-security-groups/60710ec4-2d39-4085-8e94-e4147a53d612 => generated 194 bytes in 554 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:00:28.547738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:28.559775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:28.608903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:28.609403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:28.609843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:28.610549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:28.643324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:28.643639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:28.688068 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 HTTP/1.1 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e77d1863-1d71-49e1-95ff-948460a41aa7'} Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.690233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:00:28.696348 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.699400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:28.702845 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f9d5f14-8386-4933-8b4b-d0f26804a13e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 404 len: 111 microversion: 2.1 time: 0.178747 Oct 19 01:00:28.703928 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1772/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:28 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:28.710347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:28.720737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a54092e-fc69-4ba8-a97e-e985fd2f2394 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42a38b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:28.752006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6bf308c9-4007-4c46-8bce-ed07806b859f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1706 microversion: 2.1 time: 0.843893 Oct 19 01:00:28.758366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1675/3447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:27 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1706 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:28.772349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Action: 'update', calling method: .version_select at 0x7f2af4b71700>, body: {"security_group": {"name": "tempest-sg-449510707", "description": "tempest-description-142202223"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:28.828988 n-d-master-1 devstack@n-api.service[131450]: DEBUG neutronclient.v2_0.client [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist", "detail": ""}} {{(pid=131450) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 19 01:00:28.829686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Neutron security group 7d7f3649-125a-4182-9875-9ce9fe99b375 not found {{(pid=131450) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 19 01:00:28.830281 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] HTTP exception thrown: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.830281 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.840721 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a54092e-fc69-4ba8-a97e-e985fd2f2394 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.135480 Oct 19 01:00:28.842311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1773/3448] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:28 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Request method failure captured: Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/os-security-groups/7d7f3649-125a-4182-9875-9ce9fe99b375 HTTP/1.1 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 100 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0wobNnujEWLRAUocDi4kewRoirh8uDEVkVY_PgwJ7ycLp-jU0oR2a6auWoyxChSMhl1la_jGAkWl7KioucMj0OvMQ__QaW16K-yyLg2DIPxAY-gF1_ji1PPObQTXfnXsFRN5fg1m_NI5a_PJ8m0KvLPqyQssh4jCeRVKPz8i_H4ccs Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7d0aac4d8ecb47ff8ad2e666de23c1c1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7d0aac4d8ecb47ff8ad2e666de23c1c1"}]}] Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7d0aac4d8ecb47ff8ad2e666de23c1c1 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-62827554 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 8f138ca4a03c4459ab40866b7f2e2d94 Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-62827554-project Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: {"security_group": {"name": "tempest-sg-449510707", "description": "tempest-description-142202223"}} Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: exception: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '7d7f3649-125a-4182-9875-9ce9fe99b375', 'body': {'security_group': {'name': 'tempest-sg-449510707', 'description': 'tempest-description-142202223'}}} Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 19 01:00:28.842451 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] Oct 19 01:00:28.846757 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:00:28.852605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] Returning 404 to user: Security group 7d7f3649-125a-4182-9875-9ce9fe99b375 does not exist Oct 19 01:00:28.852605 n-d-master-1 devstack@n-api.service[131450]: Neutron server returns request_ids: ['req-99136902-d28f-4c8f-9561-45c8941e666b'] {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:00:28.853614 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb0ba7c3-581b-434e-babb-0d6231b50693 tempest-SecurityGroupsNegativeTestJSON-62827554 tempest-SecurityGroupsNegativeTestJSON-62827554-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/7d7f3649-125a-4182-9875-9ce9fe99b375" status: 404 len: 194 microversion: 2.1 time: 0.092098 Oct 19 01:00:28.854208 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1676/3449] 10.222.0.27 () {60 vars in 1290 bytes} [Wed Oct 19 01:00:28 2022] PUT /compute/v2.1/os-security-groups/7d7f3649-125a-4182-9875-9ce9fe99b375 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:00:28.948635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1975343756", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:29.081479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:00:29.205912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-938096753", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:29.357623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:00:29.366070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:00:29.367156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:00:29.367864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:00:29.368466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:00:29.413621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:29.414473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:29.415123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:29.416413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:29.417122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:29.418059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:29.468423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Getting quotas for project 77d9e3bc97b04b3da34be56965ef38fe. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:29.486348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Getting quotas for user 6d8de036391d4f91865e6810c91937b3 and project 77d9e3bc97b04b3da34be56965ef38fe. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:29.555931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:00:29.561511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:00:29.771143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39d3e436-6ff3-45c3-9403-82cd2a14da30 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.919322 Oct 19 01:00:29.785860 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1774/3450] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 01:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:00:29.804444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:29.836789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:29.868169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:29.872570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:29.875198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:29.880093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:29.885368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:29.886152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:30.638999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:30.652316 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a57a98d3-1a3b-4329-9f83-91e26433124f tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1710 microversion: 2.1 time: 0.865243 Oct 19 01:00:30.653136 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1775/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:29 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1710 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:30.684461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:30.690188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:31.142577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:31.161045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:31.169905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:31.171633 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ba6cac6-d1ee-4cc4-bd27-50867a35282e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1277 microversion: 2.54 time: 0.504719 Oct 19 01:00:31.177627 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1776/3452] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:30 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1277 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:31.192519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3981c9b3-adfa-4a7d-8967-ab626f191db2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42a3790>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:31.291075 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3981c9b3-adfa-4a7d-8967-ab626f191db2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.111958 Oct 19 01:00:31.292981 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1777/3453] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:31 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:31.385984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:00:31.386522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:00:31.387124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:00:31.387760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:00:31.388354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:00:31.431129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:31.431627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:31.438391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:31.441471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:31.444029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:31.445111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:31.518074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:31.529455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:31.563000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:00:31.565952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:00:31.742474 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5db69947-f3d2-486b-85cd-7b1714c112e2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.800910 Oct 19 01:00:31.743374 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1677/3454] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:00:31.756761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73899f3d-e5e4-454b-92f3-baaa0ff8c0c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:31.758090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73899f3d-e5e4-454b-92f3-baaa0ff8c0c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:32.088315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73899f3d-e5e4-454b-92f3-baaa0ff8c0c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:32.096092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73899f3d-e5e4-454b-92f3-baaa0ff8c0c8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1215 microversion: 2.1 time: 0.344921 Oct 19 01:00:32.108654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1778/3455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:31 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:32.208130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:32.209545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:32.234302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:32.235949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:32.247664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:32.249305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:32.251148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:32.253107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:32.307986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0520ea4-ded5-4788-b0bf-9f1e34040b0e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42bf280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:32.465960 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0520ea4-ded5-4788-b0bf-9f1e34040b0e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.162621 Oct 19 01:00:32.468714 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1779/3456] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:32 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:32.574461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:32.587858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:32.604364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:32.619207 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e976be7-bb1d-4779-b77b-7dfba737fdf9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1329 microversion: 2.54 time: 0.408118 Oct 19 01:00:32.621537 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1678/3457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:32 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1329 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:33.123849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:33.125863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:33.152507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:33.153460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:33.155633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:33.156723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:33.157877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:33.159616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:33.484435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-841ffc6b-310a-424f-96d5-2b1e97b0f129 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4bf18b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:33.489658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:33.510541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-742611fc-5493-490b-8ed7-7aa981e021ab tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1219 microversion: 2.1 time: 0.380002 Oct 19 01:00:33.514161 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1780/3458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:33 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1219 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:33.643390 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-841ffc6b-310a-424f-96d5-2b1e97b0f129 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.163974 Oct 19 01:00:33.648002 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1679/3459] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:33 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:33.655030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:33.655440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:33.664236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:33.674407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:33.678557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:33.682706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:33.690664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:33.694742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:34.198410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:34.207798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:34.221729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:34.233750 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b16aacb5-debf-4da4-8f22-976c07091242 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1335 microversion: 2.54 time: 0.582294 Oct 19 01:00:34.234402 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1781/3460] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:33 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1335 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:34.541902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:34.542819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:34.566487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:34.583746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:34.587850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:34.588941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:34.589670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:34.591697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:34.662804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ca233e67-b845-440a-990c-1f1145323201 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42c3dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:34.805947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ca233e67-b845-440a-990c-1f1145323201 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.148223 Oct 19 01:00:34.807000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1782/3461] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:34 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:34.977420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:34.979928 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:34.987210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6f802c20-fc54-490d-829f-84db62eea81d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1285 microversion: 2.1 time: 0.451683 Oct 19 01:00:35.006869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1680/3462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:34 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1285 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:35.267601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:35.268201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:35.282789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:35.283200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:35.290078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:35.291091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:35.297812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:35.298443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:35.486777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:35.496863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:35.514469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:35.518813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b29a9af-72da-4711-b996-dc0698fe6d06 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1335 microversion: 2.54 time: 0.256615 Oct 19 01:00:35.519591 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1783/3463] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:35 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1335 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:35.823762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45b60504-6512-4f7f-8439-a043673e052f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4bf1dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:36.008914 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45b60504-6512-4f7f-8439-a043673e052f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1411 microversion: 2.1 time: 0.190699 Oct 19 01:00:36.010557 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1681/3464] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:35 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1411 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:36.016482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:36.017986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:36.029858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.032032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.036448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:36.038409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.041085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.041725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:36.308771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:36.317366 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6efeb9e8-b2cf-4666-8622-8d723f36828e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1273 microversion: 2.1 time: 0.304574 Oct 19 01:00:36.323400 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1784/3465] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:36 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:36.553820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:36.554789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:36.568965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.575960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.576562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:36.577523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.578102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.578642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:36.733653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:36.761172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:36.766472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:36.768826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9eeb7b5-fb38-4d76-8c9e-93975aed6acf tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1356 microversion: 2.54 time: 0.225342 Oct 19 01:00:36.769420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1682/3466] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:36 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1356 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:36.797343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0027ba68-1afb-4020-aca4-6c5cc0e1d345 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Action: 'create', calling method: .version_select at 0x7f2af42a3dc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-208441862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbjIRsvphELOVFXU+qzLtIu7Yzzf2aEDrGYEwW7SvX4+1OoZzpHKKrL7cyf6bOJkxJH7BUIy6/4+jb/hVPn1y+YyKs+8vV0sl6208qWB2VrebRN4CwznrEgTzigQFaU+w=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:36.837655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0027ba68-1afb-4020-aca4-6c5cc0e1d345 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Getting quotas for project 77d9e3bc97b04b3da34be56965ef38fe. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:36.859265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0027ba68-1afb-4020-aca4-6c5cc0e1d345 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Getting quotas for user 6d8de036391d4f91865e6810c91937b3 and project 77d9e3bc97b04b3da34be56965ef38fe. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:36.937195 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0027ba68-1afb-4020-aca4-6c5cc0e1d345 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.143656 Oct 19 01:00:36.944446 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1785/3467] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 01:00:36 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 01:00:36.950976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-208441862", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:36.955002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:36.983326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.983853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.984315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:36.985090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:36.985608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:36.986055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.026942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d828ced-ea1a-4217-a1d4-f2fb8d7eda78 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42ccb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:37.251078 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d828ced-ea1a-4217-a1d4-f2fb8d7eda78 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1420 microversion: 2.1 time: 0.228536 Oct 19 01:00:37.264258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1786/3468] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:37 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:37.281819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af5321b7-ce7b-4636-8b72-83f3613d4757 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42e5ee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:37.315986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:00:37.327952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:00:37.334990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:00:37.335563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:00:37.336156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:00:37.387191 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af5321b7-ce7b-4636-8b72-83f3613d4757 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 200 len: 1420 microversion: 2.1 time: 0.117177 Oct 19 01:00:37.400667 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1787/3469] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:00:37 2022] GET /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:37.405019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:37.406042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:37.432507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.434585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.445385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.447821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.449533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.452640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.576937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:37.608481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.609329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.610329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.612044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.614555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.616552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.690414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:37.701049 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:37.705891 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3993398-6e54-4464-b0ec-c0fda4e1bbdf tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1273 microversion: 2.1 time: 0.308888 Oct 19 01:00:37.717982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b70b7a01-8480-418d-a57b-d61efbbba1f6 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "POST /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e/action" status: 202 len: 1138 microversion: 2.54 time: 0.772153 Oct 19 01:00:37.718612 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1683/3470] 10.222.0.27 () {62 vars in 1320 bytes} [Wed Oct 19 01:00:36 2022] POST /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e/action => generated 1138 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 19 01:00:37.733010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1788/3471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:37 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:37.746399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:37.747614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:37.754354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2577a942-4ccb-433d-b996-49d44b2a7c37 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af49db5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:37.756150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.756932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.757536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.758409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:37.759031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:37.759643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:37.905179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:37.925920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:37.927670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:37.939716 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-378c9fc4-fb02-4258-bd69-a6c6f2f345b1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.197680 Oct 19 01:00:37.945643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1789/3472] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:37 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:38.748674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:38.749929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:38.759876 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:38.769819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:38.770322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:38.770811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:38.775482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:38.775981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:38.776415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:39.439673 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:39.454142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2577a942-4ccb-433d-b996-49d44b2a7c37 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 204 len: 0 microversion: 2.1 time: 1.734414 Oct 19 01:00:39.462771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1684/3473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:37 2022] DELETE /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 0 bytes in 1743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:00:39.478985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:39.486206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:39.513678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:39.514526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:39.515172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:39.516111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:39.517196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:39.517844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:39.691076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:39.710135 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bfd69c3-e89c-4b51-8392-564a2a4c28a1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 0.960771 Oct 19 01:00:39.710135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1790/3474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:38 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:39.725987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:39.726597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:39.736267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:39.737161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:39.737878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:39.738834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:39.740053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:39.740757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:39.830150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:00:39.952488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:39.981248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:39.990362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:39.997084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4253999a-bd20-4e7e-9f72-837e802cac4e tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.527588 Oct 19 01:00:40.009645 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1685/3475] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:39 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:40.111014 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-072ca328-3f22-4786-97f7-dd2dc7c88694 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 204 len: 0 microversion: 2.1 time: 0.397256 Oct 19 01:00:40.113757 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1791/3476] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:00:39 2022] DELETE /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:00:40.373892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1672402539", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:40.438162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:00:40.668737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9276ba46-49f5-405b-af88-c0e926b5a630", "name": "network-vif-unplugged", "status": "completed", "tag": "ad4714f7-2275-4b63-987e-d6cadad35c51"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:40.690437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:40.690926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:40.692464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:40.720126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] Creating event network-vif-unplugged:ad4714f7-2275-4b63-987e-d6cadad35c51 for instance 9276ba46-49f5-405b-af88-c0e926b5a630 on n-h2-master-1 Oct 19 01:00:40.741739 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d157fa2b-578c-4de1-8af2-03869603ff3f req-c2e025a8-7222-408f-b360-dbd471bc3323 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080372 Oct 19 01:00:40.743489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1792/3477] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:00:40.750145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:40.751095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:40.760207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:40.760937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:40.761572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:40.762828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:40.763860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:40.764701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.337713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:41.350004 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe9460e8-31fb-453b-8c19-cedc59ff1282 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 0.602988 Oct 19 01:00:41.351977 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1793/3478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:40 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:41.364786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:41.369627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:41.384271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:41.385382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:41.386134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.387150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:41.387841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:41.388550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.481029 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:41.503293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:41.523147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:41.525202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:41.528793 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b9ad1af-d5f5-4d1d-87ad-154eda54d4ba tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.173315 Oct 19 01:00:41.530472 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1794/3479] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:41 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:41.536585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc832ba5-2475-4b09-ab86-e7e2adc1694b", "tag": "07783e2f-b58a-490c-964c-e21d100b472c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:41.548009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:41.548891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:41.549602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.550693 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:41.566162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Creating event network-changed:07783e2f-b58a-490c-964c-e21d100b472c for instance dc832ba5-2475-4b09-ab86-e7e2adc1694b on n-h2-master-1 Oct 19 01:00:41.573759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041637 Oct 19 01:00:41.575510 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1795/3480] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:41.577360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:41.578825 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-81376fee-832e-45b8-a4e6-fe2d6354fa17 req-dcee6828-ddf1-4b96-9dd0-eed4d90b16f0 service nova] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001971 Oct 19 01:00:41.580072 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1796/3481] 10.222.0.27 () {56 vars in 886 bytes} [Wed Oct 19 01:00:41 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 01:00:41.673259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:00:41.673774 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:00:41.675425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:00:41.676214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:00:41.678124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:00:41.681141 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:41.695938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:41.696477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:41.697585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.698523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:41.699466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:41.700020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:41.750966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:00:41.763661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:00:41.798501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:00:41.820290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:00:41.938816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd414461-8b40-4e6d-8a93-b28cc83727dd tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569393 Oct 19 01:00:41.953273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ba4b52b-b070-4c78-998b-41c6b6b691a5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:41.954984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ba4b52b-b070-4c78-998b-41c6b6b691a5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:41.956369 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1686/3482] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:00:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:00:42.167799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ba4b52b-b070-4c78-998b-41c6b6b691a5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:42.185176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ba4b52b-b070-4c78-998b-41c6b6b691a5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1208 microversion: 2.1 time: 0.237911 Oct 19 01:00:42.188936 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1797/3483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:41 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1208 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:42.389276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:42.394243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:42.426668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:42.428445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:42.430111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:42.432363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:42.435307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:42.440020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:42.558951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:42.559788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:42.572053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:42.575042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:42.575975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:42.578810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:42.580110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:42.581377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:42.846341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:42.862786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:42.867816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:42.870383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-241ae2c7-f6cc-4a11-b305-93fabc347f93 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.315717 Oct 19 01:00:42.872724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1798/3484] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:42 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:00:43.221905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:43.224033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:43.235081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:43.235801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:43.236428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:43.237493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:43.238171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:43.239194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:43.391211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:43.403154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23ed89e2-5ccb-4c21-8788-a29ad15e13ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1204 microversion: 2.1 time: 0.191267 Oct 19 01:00:43.417988 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1799/3485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:43 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1204 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:43.501620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:43.510171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f2515bc-5461-42a6-a534-32de58cf8759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 1.139010 Oct 19 01:00:43.510767 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1687/3486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:42 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:43.900849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:43.901448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:43.912711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:43.917602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:43.918860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:43.920377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:43.920922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:43.921361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.218687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:44.229903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:44.231342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:44.232505 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04cf3d61-ef32-4697-aa37-14b3a6efa530 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.336010 Oct 19 01:00:44.253154 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1800/3487] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:43 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:44.429456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:44.430097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:44.444500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:44.445022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:44.448767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.450100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:44.450582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:44.451019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.537438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:44.538894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:44.562058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:44.564948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:44.566918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.569626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:44.571586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:44.573587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.698497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:44.719434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c928dce-1659-4df2-a006-71f1ae56d59a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1278 microversion: 2.1 time: 0.294926 Oct 19 01:00:44.745084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1688/3488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:44 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:44.760963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9276ba46-49f5-405b-af88-c0e926b5a630", "name": "network-vif-deleted", "tag": "ad4714f7-2275-4b63-987e-d6cadad35c51"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:44.807649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:44.809171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:44.811132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:44.846158 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] Creating event network-vif-deleted:ad4714f7-2275-4b63-987e-d6cadad35c51 for instance 9276ba46-49f5-405b-af88-c0e926b5a630 on n-h2-master-1 Oct 19 01:00:44.861100 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6c6d77ac-c99c-49b8-9b6b-e16caf953334 req-b0c84b66-ce63-485b-9222-858649c512ad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113757 Oct 19 01:00:44.862418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1689/3489] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:45.291315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:45.293706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:45.305643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:45.306548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:45.308517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:45.309784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:45.310469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:45.313816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:45.314439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:45.328127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ea97f84-475f-42da-9860-316b2b99e850 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 0.797059 Oct 19 01:00:45.329823 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1801/3490] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:44 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:45.524858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:45.543474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:45.548502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:45.553388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d632558-e680-4dbb-ad9c-e4f86c8996c7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.271600 Oct 19 01:00:45.554305 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1690/3491] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:45 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:00:45.748795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:45.749467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:45.760873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:45.765585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:45.767649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:45.768716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:45.775096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:45.776301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:45.977188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:45.991800 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-453f04d3-51a2-4b76-b04a-9c6bc88811b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1266 microversion: 2.1 time: 0.249121 Oct 19 01:00:46.010314 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1802/3492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:45 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:46.364113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:46.365327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:46.376391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:46.376923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:46.377372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:46.378093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:46.378553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:46.384873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:46.581194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:46.582195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:46.590384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:46.590942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:46.592018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:46.593571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:46.594407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:46.595044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:47.252280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:47.267511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:47.274170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:47.279323 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae55785d-54b6-4563-8e20-d4b198a99bd9 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.702269 Oct 19 01:00:47.303546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1803/3493] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:46 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:47.312514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:47.313580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:47.325426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:47.326300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:47.329370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:47.330452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:47.333756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:47.334621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:47.520443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:47.543818 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fac72973-986c-4767-8be6-207b70fc40f3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 1.195253 Oct 19 01:00:47.544424 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1691/3494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:46 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:47.778348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:47.792252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7ca05ee-f0e2-43be-81b8-e19ba9f443e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.487210 Oct 19 01:00:47.797380 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1804/3495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:47 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:48.317125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:48.317928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:48.343554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.344507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.345429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.346506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.347184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.348101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.571957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:48.573251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:48.596353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.598230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.604374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.605521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.607309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.613389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.648368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:48.663350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:48.666177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:48.669413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-773e2bc2-17b9-40b5-a900-13073cab1ab7 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.356694 Oct 19 01:00:48.672997 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1692/3496] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:48 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:48.822680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:48.823531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:48.833902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.835556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.836095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.836982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:48.837715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:48.838457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:48.982777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:49.007934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d54b797-002a-46d4-92c7-780e590c7f02 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 0.438487 Oct 19 01:00:49.009267 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1805/3497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:48 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:49.022687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc832ba5-2475-4b09-ab86-e7e2adc1694b", "name": "network-vif-plugged", "status": "completed", "tag": "07783e2f-b58a-490c-964c-e21d100b472c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:49.077517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:49.078382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:49.082687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:49.111549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] Creating event network-vif-plugged:07783e2f-b58a-490c-964c-e21d100b472c for instance dc832ba5-2475-4b09-ab86-e7e2adc1694b on n-h2-master-1 Oct 19 01:00:49.120490 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-90f6366c-11ef-45e8-a1db-5609c1992b73 req-862518b6-e936-4270-afea-c7ab4b8737ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106025 Oct 19 01:00:49.122132 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1806/3498] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:49.245849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:49.269789 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-495208de-0f01-459e-a3f4-e3b3f1dc76ef tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.452154 Oct 19 01:00:49.271309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1693/3499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:48 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:49.707232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:49.708327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:49.726089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:49.726957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:49.729681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:49.734317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:49.737461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:49.738510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.037578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:50.038204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:50.068783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:50.069297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:50.069748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.096736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:50.097409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:50.097903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.118554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:50.126935 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:50.130530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:50.145252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:50.147466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40d9fd1d-e527-407b-9b27-354d0a7e623c tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.446587 Oct 19 01:00:50.148076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1807/3500] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:49 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:50.297719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:50.299218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:50.313242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:50.318852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:50.320216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.322799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:50.323581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:50.326151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.847541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:50.861414 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53f04751-00ff-4766-8ee7-d8a9409b8257 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1315 microversion: 2.1 time: 0.829154 Oct 19 01:00:50.865972 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1694/3501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:50 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:50.880557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1d418aa-2e73-4d69-a123-af4b9941aaf7", "tag": "f91180b1-af91-411b-bab5-7bf6e464db2a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:50.925970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:50.934974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:50.935721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:50.966001 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] Creating event network-changed:f91180b1-af91-411b-bab5-7bf6e464db2a for instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 on n-h1-master-1 Oct 19 01:00:50.978210 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6d0b1a16-6c59-4907-877e-36316682c7c5 req-abcee68d-98b3-4c68-9dae-54f7a0f4709f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107997 Oct 19 01:00:50.979992 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1695/3502] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:51.008055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:51.016863 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27138f47-ecdc-4991-b2a5-6502e9697c00 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.725019 Oct 19 01:00:51.037381 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1808/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:50 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:51.179751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:51.181341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:51.212435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:51.213787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:51.215694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:51.218774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:51.221774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:51.225268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:51.526036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:51.535882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:51.538758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:51.540722 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0eaff38b-d0af-4f88-94b5-1a37d560d774 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.366321 Oct 19 01:00:51.542048 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1696/3504] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:51 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:51.891504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:51.892123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:51.902274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:51.903446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:51.904187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:51.905262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:51.906014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:51.906640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.045403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:52.046368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:52.053011 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:52.053860 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:52.055564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.056421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.057239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.058328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.058808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.059251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.175571 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:52.370298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:52.384112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3a7065a-7dad-431d-b88e-8fb63ff43126 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1502 microversion: 2.1 time: 0.495307 Oct 19 01:00:52.385257 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1809/3505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:51 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1502 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:52.410484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:52.411396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:52.422670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.425232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.425849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.427800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.429049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.430553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.524813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:52.529342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'flavor' on Instance uuid dc832ba5-2475-4b09-ab86-e7e2adc1694b {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:00:52.544030 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e08e6172-21bd-45f7-b74f-4c36433558ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.503133 Oct 19 01:00:52.590037 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1697/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:52 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:00:52.604953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:52.609108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:52.623668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.624679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.629362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.631286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:52.632013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:52.633712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:52.880387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:52.919707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:52.935117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:52.948787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7516f861-dec5-47e3-87ad-c42d3b08676a tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.356609 Oct 19 01:00:52.961225 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1698/3507] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:52 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:53.108950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-723e3174-21c5-477c-9777-057bee9c3097 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b/action" status: 202 len: 0 microversion: 2.1 time: 0.704185 Oct 19 01:00:53.110653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1810/3508] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:00:52 2022] POST /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:00:53.119442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:53.120445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:53.133196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:53.134191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:53.134815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:53.138104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:53.138830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:53.139441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:53.151720 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:00:53.589507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:53.590694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:53.615094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:53.615693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:53.616147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:53.617008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:53.623696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:53.624645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:54.129943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:54.146097 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b213c4b7-d62d-4799-b951-9be88fa29971 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 1.030134 Oct 19 01:00:54.146704 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1699/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:53 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:54.185030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:54.197469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:54.212111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:54.218524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:54.221187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:54.223163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:54.235447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:54.235932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:54.527325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:54.541078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:54.545079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c65d9bec-af9a-44fe-b0f2-844a82ec0eb5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.952386 Oct 19 01:00:54.549975 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1811/3510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:53 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:54.573280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:54.578566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:54.579876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73be2b47-3e1b-418c-b92b-849dfa2915dd tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.405268 Oct 19 01:00:54.583968 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1700/3511] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:54 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:55.172145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:55.173007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:55.182502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:55.186931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:55.191352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:55.193878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:55.196114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:55.196908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:55.579245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:55.579879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:55.598260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:55.604981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:55.606192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:55.608691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:55.609189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:55.609636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:57.174302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:57.203221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0045bbdf-835c-4e81-84f7-50fb0620631e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 2.034756 Oct 19 01:00:57.204172 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1812/3512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:55 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:57.213187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:57.215930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:57.239349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:57.240068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:57.240512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:57.241289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:57.241750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:57.246332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:57.365929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:57.380700 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8afd5ecd-b136-43a5-9cc2-91311cd6b4a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 1.804768 Oct 19 01:00:57.381620 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1701/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:55 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:57.439580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:57.458117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:57.466006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:57.476579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0edfb501-0acc-4235-9753-3b607a003fe2 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.271059 Oct 19 01:00:57.477924 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1813/3514] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:57 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:57.791401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d418aa-2e73-4d69-a123-af4b9941aaf7", "name": "network-vif-plugged", "status": "completed", "tag": "f91180b1-af91-411b-bab5-7bf6e464db2a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:00:57.815080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:57.815586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:57.816032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:57.842815 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] Creating event network-vif-plugged:f91180b1-af91-411b-bab5-7bf6e464db2a for instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 on n-h1-master-1 Oct 19 01:00:57.856881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d666cda9-16da-4594-a882-6fd6409dd174 req-02782ee0-a9db-413e-8359-52b76dbeef36 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068761 Oct 19 01:00:57.858904 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1702/3515] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:00:58.231771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:58.232602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:58.260654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.276963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.278184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.287581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.289100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.290644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.417599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:58.420364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:58.430634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.431656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.433173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.434328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.434974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.435770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.677865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:58.715728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bfaa443-29f8-4bd0-9df9-2791d6e0ca83 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.485367 Oct 19 01:00:58.729049 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:58.730256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1814/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:58 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:58.740348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:58.741302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:58.745717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3843269e-07d5-48f3-add6-0cc9f1bd2485 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1308 microversion: 2.1 time: 0.343879 Oct 19 01:00:58.746584 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1703/3517] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:58 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:00:58.748721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.749386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.750284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.751227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:58.751908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:58.752562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:58.905646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:58.917696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:58.919147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:00:58.921805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84348d37-d593-4e32-b11a-275df907bd71 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.189934 Oct 19 01:00:58.937719 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1815/3518] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:00:58 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:00:59.754898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:59.754898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:59.768844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:59.769962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:59.771620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:59.772809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:59.773540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:59.775406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:00:59.776039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:00:59.778283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:59.800385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:59.800925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:59.805880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:00:59.808256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:00:59.811689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:00:59.812446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:00.232007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:00.240275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0c4d5e6-e764-4330-9408-571a25e8a993 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.500199 Oct 19 01:01:00.243879 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1704/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:59 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:00.251714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:00.255612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:00.268349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:00.299386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:00.300277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:00.302888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:00.304276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:00.304817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:00.360650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:00.371443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-120e4b0d-9ce9-4051-a47f-65add2a979d7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1488 microversion: 2.1 time: 0.601097 Oct 19 01:01:00.385700 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1816/3520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:00:59 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1488 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:00.411588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:00.420416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:00.421577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:00.422258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:00.452330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:00.469451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:00.472886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:00.476386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8aec4882-abd1-4ef8-ac0c-4d530a321659 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.227923 Oct 19 01:01:00.477972 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1705/3521] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:00 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:00.523210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Going to try to stop instance {{(pid=131449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:01:00.584472 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44c97f71-5441-4323-a0b3-706ccd2bba32 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7/action" status: 202 len: 0 microversion: 2.1 time: 0.185715 Oct 19 01:01:00.585924 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1817/3522] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:01:00 2022] POST /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:01:00.595377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:00.596937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:00.612908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:00.615286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:00.616582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:00.617765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:00.618891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:00.622930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:01.137257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:01.147880 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4218160d-b109-456a-b4c8-06cb6719f99b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.557302 Oct 19 01:01:01.157383 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1706/3523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:00 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:01.274541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:01.280686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:01.294275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:01.300890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:01.302280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:01.311418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:01.312202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:01.313074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:01.510026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:01.511140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:01.526801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:01.528408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:01.529542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:01.531168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:01.532118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:01.534429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:01.634074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:01.649626 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94d63e3e-7a73-4093-a6e5-9ec4d3e2f650 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.379773 Oct 19 01:01:01.664647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1818/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:01 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:01.685573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:01.702310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:01.703923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:01.710423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3475383c-5aec-47d5-8610-0c1b89a0b808 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.201385 Oct 19 01:01:01.724645 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1707/3525] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:01 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:01:01.778874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1566857207", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "dd8f1344-1b15-4224-970c-8443f03ec456"}, {"uuid": "f4eecf40-fac9-4093-9c45-5e601f32a13e"}, {"uuid": "dd8f1344-1b15-4224-970c-8443f03ec456"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:01.885834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] validate_networks() for [('dd8f1344-1b15-4224-970c-8443f03ec456', None, None, None, None, None), ('f4eecf40-fac9-4093-9c45-5e601f32a13e', None, None, None, None, None), ('dd8f1344-1b15-4224-970c-8443f03ec456', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:01:02.182168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:02.182820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:02.213116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:02.213625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:02.214082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:02.214806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:02.216678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:02.237774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:02.780302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:02.794766 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-14946240-8a03-41cd-9f96-e54d518f6e97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.623254 Oct 19 01:01:02.795679 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1708/3526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:02 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:02.807886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:02.810568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:02.825205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:02.825702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:02.838013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:02.839203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:02.840894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:02.841347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:03.808167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:03.822974 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2947a385-6dfb-4d38-942e-0b55d9b3a017 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 1.025890 Oct 19 01:01:03.843959 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1709/3527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:02 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:03.860682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:03.869475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:03.909732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:03.910283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:03.910867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:03.911910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:03.912398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:03.912886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.125834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:04.139551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:04.141981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:04.147817 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-129402ad-de9b-4f75-83bb-a223c52d86f8 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.302503 Oct 19 01:01:04.148687 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1710/3528] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:03 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:04.182921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:04.184101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:04.198765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.199842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.200502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.201450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.202173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.202791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.620393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:04.628712 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57cb269b-f233-4016-a818-0d95d99f5963 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.450205 Oct 19 01:01:04.629834 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1711/3529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:04 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:04.637703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:01:04.638766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:01:04.639243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:01:04.639658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:01:04.640090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:01:04.647128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:04.651096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:04.660575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.661181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.661713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.663098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.663916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.665693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.669707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.670609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.670747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:04.671107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:04.671574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.671722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:04.802143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Getting quotas for project 18b6ea2fe5ee4fc8a9b1f143ac95fcef. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:04.837498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Getting quotas for user 9ddb45b2dcf14263887a3718e23eb937 and project 18b6ea2fe5ee4fc8a9b1f143ac95fcef. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:01:04.857191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:01:04.860272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:01:04.966508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lazy-loading 'services' on Instance uuid 58c66c11-a25f-4e38-9147-4488c81b7f65 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:01:04.995568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a953540d-e554-4275-a8ab-08ff4350fa6d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.220533 Oct 19 01:01:05.002261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1819/3530] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 3224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:01:05.018790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:05.025251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:05.053982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.071452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.071865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.072732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.109980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.110771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.193574 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cee61673-108e-4588-89a9-744f41a2b7bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments/49542454-0d35-43b4-8505-baccd6992d5d" status: 202 len: 0 microversion: 2.1 time: 0.542644 Oct 19 01:01:05.197597 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1712/3531] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:01:04 2022] DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments/49542454-0d35-43b4-8505-baccd6992d5d => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:01:05.213280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aecd7789-2021-4096-9f18-46ebb16150c1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:05.214009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aecd7789-2021-4096-9f18-46ebb16150c1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:05.550019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aecd7789-2021-4096-9f18-46ebb16150c1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:05.563957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aecd7789-2021-4096-9f18-46ebb16150c1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1213 microversion: 2.1 time: 0.365014 Oct 19 01:01:05.565232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1713/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:05 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1213 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:05.575894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:05.579031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:05.602390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.616146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.617066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.618051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.618695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.619341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.631802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:05.640803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3765717-ac47-4736-bab2-08b2ccd4cd36 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.640831 Oct 19 01:01:05.641404 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1820/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:04 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:05.671731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:05.675960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:05.712965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.713566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.714072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.719094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:05.719662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:05.722603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:05.762069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:05.779007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:05.783695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:05.792023 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0aede60d-a155-436f-8d3b-468c8ffe70fe tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1407 microversion: 2.54 time: 0.222405 Oct 19 01:01:05.797106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1714/3534] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:05 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:06.243204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:06.257369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aab84b3e-ba12-472c-8911-9f2f5fe20107 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.598318 Oct 19 01:01:06.260738 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1821/3535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:05 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:06.592204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:06.593536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:06.613412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.614621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.615273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:06.616009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.616481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.617011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:06.664570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:06.666345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:06.697363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.699255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.701307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:06.702728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.703390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.705033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:06.718474 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:06.773180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:06.791811 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66e5f4e5-4c75-4440-baf4-15ed0b710548 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1209 microversion: 2.1 time: 0.199976 Oct 19 01:01:06.804649 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1715/3536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:06 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:06.823696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:06.824788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:06.836420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.836964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.837417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:06.846868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:06.847409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:06.855336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:07.050058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:07.058160 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:07.092992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:07.094640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:07.095890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ddc885eb-0a0d-43c8-a6ca-ed12af11a547 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1413 microversion: 2.54 time: 0.277014 Oct 19 01:01:07.106463 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1716/3537] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:06 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1413 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:07.289855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:07.290934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:07.319365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:07.326004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:07.327219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:07.329639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:07.334590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:07.335365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:08.619581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:08.631242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-333fa062-612a-4a59-8d27-fb94d4fed565 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 1.346680 Oct 19 01:01:08.641955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1717/3538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:07 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:08.648031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:08.648996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:08.666932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:08.681190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:08.681664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:08.682464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:08.682939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:08.683369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:08.822256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:08.836335 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-90421a70-5065-40a7-abad-a0c8c46341fb tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 2.176847 Oct 19 01:01:08.851462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1822/3539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:06 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 2193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:08.872736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:08.882562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:08.923479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:08.925445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:08.928335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:08.930197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:08.931365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:08.933177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:09.059328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:09.073735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4634b73-1ebe-4449-98fc-66cfba9f9c56 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1271 microversion: 2.1 time: 0.430079 Oct 19 01:01:09.074595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1718/3540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:08 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1271 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:09.209696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:09.229296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:09.231090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:09.232444 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-59f5d8b5-cd99-460f-9789-19881c84f060 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1413 microversion: 2.54 time: 0.377620 Oct 19 01:01:09.238118 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1823/3541] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:08 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1413 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:09.666042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:09.667278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:09.679413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:09.683261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:09.684047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:09.685097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:09.687306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:09.689201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:09.879370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:09.880320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:09.885153 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:09.908524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:09.914456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:09.915284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:09.916326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:09.917100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:09.917789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.380951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:11.391420 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8f89f22-5d2b-45da-a2fa-12f8fc40f28c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 1.729483 Oct 19 01:01:11.392377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1719/3542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:09 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:11.401622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:11.418950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd77c943-729e-440e-9944-3fc0a42bcd98 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 1.537220 Oct 19 01:01:11.419953 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1824/3543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:09 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:11.429758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:11.431892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:11.461969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:11.467133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.467648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.468113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.468498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:11.468862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.475798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.483573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.485248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.485937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.487917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.492695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.493335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.501208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.779115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:11.810369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:11.812292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:11.813557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3703c1c2-6e3f-4261-8d0a-b7480376efe5 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1398 microversion: 2.54 time: 0.389590 Oct 19 01:01:11.820693 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1825/3544] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:11 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1398 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:11.843057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f4ca7c4-d280-482d-a0af-b6b6a0fe18fc tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '.version_select at 0x7f2af42924c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:11.907607 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f4ca7c4-d280-482d-a0af-b6b6a0fe18fc tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-208441862" status: 204 len: 0 microversion: 2.54 time: 0.068378 Oct 19 01:01:11.909224 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1826/3545] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-208441862 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:01:11.920845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:11.921355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:11.946026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.947649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.949294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:11.950803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:11.952860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:11.954139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:12.079124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:01:12.210581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:12.256086 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83895fcc-37c8-4c8a-a434-dc73b62b05d4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1334 microversion: 2.1 time: 0.856966 Oct 19 01:01:12.259762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1720/3546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:11 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1334 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:12.422088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:12.423822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:12.439933 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:12.447717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:12.450701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:12.453651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:12.455937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:12.457957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:12.460943 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14ea11e3-e45c-444e-95f6-29a5a484bc9f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "DELETE /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 204 len: 0 microversion: 2.54 time: 0.529058 Oct 19 01:01:12.462004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:12.465335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1827/3547] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:01:11 2022] DELETE /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:01:12.470934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:12.485281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:12.503581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:12.509797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:12.510483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:12.515432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:12.516855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:12.518781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:12.996233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:13.004261 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f42d62ff-f1b8-415a-9ec7-5a2f7edf3684 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.537475 Oct 19 01:01:13.014194 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1828/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:12 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:13.019134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:13.020311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:13.043438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:13.044139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:13.044857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:13.045754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:13.046389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:13.046986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:13.440915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:13.461837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:13.470570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:13.476291 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-075ee2fb-5b26-47eb-84ea-e1b7c1d9c046 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1404 microversion: 2.54 time: 0.460845 Oct 19 01:01:13.479957 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1829/3549] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:13 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:13.501746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:13.506437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:13.538675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:13.540156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:13.543227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:13.547859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:13.550322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:13.552794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:13.561202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:13.574687 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2fe3a872-d7ce-4b3d-b341-f0cf5d465ce8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 1.157454 Oct 19 01:01:13.577446 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1721/3550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:12 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:14.040720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:14.041719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:14.059066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.062553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.063308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.064276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.065165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.066707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.420202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:14.435022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2efabaf-f079-46ed-8679-f724969e95f1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.399973 Oct 19 01:01:14.435629 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1722/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:14 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:14.465316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:14.477353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0fcf0fb-54ee-4bc5-8114-98b87f9e1e7a tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.988836 Oct 19 01:01:14.478568 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1830/3552] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:13 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:14.532466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:14.555715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:14.579469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.580934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.583817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.588551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.589804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.592467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.609935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:14.611009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:14.624607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.625546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.626228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.629232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:14.631112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:14.632595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:14.772218 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:14.848121 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:14.873176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:14.892075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:14.899515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:14.900954 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c06728a-5e79-4169-b743-dfda64eea2d1 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1404 microversion: 2.54 time: 0.375818 Oct 19 01:01:14.911616 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1723/3553] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:14 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1404 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:15.151740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:15.160922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5badc85-3ffc-40aa-9f83-4d3aa2462027 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.554544 Oct 19 01:01:15.161518 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1831/3554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:14 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:15.385532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "tag": "136100a6-e6d1-401b-bc50-86cd3f1d7b4b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:15.396581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:15.397494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:15.398102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:15.411457 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] Creating event network-changed:136100a6-e6d1-401b-bc50-86cd3f1d7b4b for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:15.418794 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bf807f99-0c4f-442d-a425-bfd06554a737 req-72e93c48-0b5d-4672-b49a-cebc74a7e575 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040518 Oct 19 01:01:15.420014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1832/3555] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:15.464258 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:15.465829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:15.499820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:15.503508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:15.504335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:15.507528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:15.509991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:15.512235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:15.556873 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:15.663204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d5d71da-1967-407f-8e75-49f0646000ce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: .version_select at 0x7f2af4a34af0>, body: {"keypair": {"name": "tempest-keypair-1687956963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcxZohsy2+A/l1f4SB//LlPq9KFFt4C8gdmXSWxwSxkgJU81i6PEcTa8WcX/UoH/0Pueb0rzJJpbblQHrkY9AFh1PnOsKTDJrQFTUBDyaTyP1tmb0kubk4mFXh4l4tQCQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:15.714467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-3d5d71da-1967-407f-8e75-49f0646000ce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:15.726867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-3d5d71da-1967-407f-8e75-49f0646000ce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for user e3d4cc70eeca421585fabdb682af7caf and project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:01:15.783842 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d5d71da-1967-407f-8e75-49f0646000ce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.412470 Oct 19 01:01:15.786941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1724/3556] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 01:01:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 417 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 19 01:01:15.799539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:15.800701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:15.809458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:15.810208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:15.810842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:15.812015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:15.813559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:15.814187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.487472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.503627 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-190d4c88-ca8b-4d2d-b318-fd613d9f12c1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 1.042451 Oct 19 01:01:16.508310 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1833/3557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:15 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:16.526554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.529334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:16.531492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:16.536956 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9eaee880-42d8-4d7b-aa4c-10afcca4d892 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.748158 Oct 19 01:01:16.543034 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1725/3558] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:15 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:16.548060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:16.551089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:16.552607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:16.553097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:16.553731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.557057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:16.562548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:16.563829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.576533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:16.579631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:16.580278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.581273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:16.582869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:16.586877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.703999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:16.715746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:16.720226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:16.723434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lazy-loading 'fault' on Instance uuid 31ff4379-6429-4581-8cff-a8ecd76f4e4e {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:01:16.854447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.869916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.871666 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8de036391d4f91865e6810c91937b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d9e3bc97b04b3da34be56965ef38fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.887887 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8c578b1-a147-437b-a975-8fcdf6a0d78f tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 200 len: 1409 microversion: 2.54 time: 0.376585 Oct 19 01:01:16.888499 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1834/3559] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:16 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 1409 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:16.969186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:16.986403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49f3adf7-6b18-4237-97d2-4fdbb5160b95 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.438424 Oct 19 01:01:17.007047 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1726/3560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:16 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:17.537096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:17.538644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:17.560945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:17.561544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:17.562619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:17.564543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:17.565054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:17.567464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:17.573399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:17.574297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:17.589994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:17.590498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:17.590947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:17.599134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:17.601291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:17.603278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:18.101427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:18.132193 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07dc9d10-acc2-4cac-a374-4138da984bd1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.562845 Oct 19 01:01:18.139228 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1727/3561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:17 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:18.154060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "tag": "9405a692-e53c-49b0-9bde-cacc6ee9c8bb"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:18.168414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:18.177764 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8011a29f-8b9b-40c4-92e7-bea89925d011 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1508 microversion: 2.1 time: 0.646392 Oct 19 01:01:18.178792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1835/3562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:17 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:18.188585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:18.189539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] [instance: 31ff4379-6429-4581-8cff-a8ecd76f4e4e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:18.208755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:18.209463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:18.209992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:18.210258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:18.212858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:18.213354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:18.214021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:18.226072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:18.226072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:18.252061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] HTTP exception thrown: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. Oct 19 01:01:18.256413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] Creating event network-changed:9405a692-e53c-49b0-9bde-cacc6ee9c8bb for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Request method failure captured: Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e HTTP/1.1 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0wsB0uoh8sMX_bA2pHp2apIqfD79Gal-1h5oBfm_3wP7dF48sGJKt5LjtUsEzELGOP4pZUMFWs-4zdgQqfnJTRiExjmWGQpmBcrbJdkjRks7E-EvJDRNKs8s0IzET-nM8mZGvqy1u37QW8mYJU1kBmY4924y3uHe7EabM7m4stBe5s Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.54 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 77d9e3bc97b04b3da34be56965ef38fe Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerShowV254Test-113509550 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77d9e3bc97b04b3da34be56965ef38fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77d9e3bc97b04b3da34be56965ef38fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77d9e3bc97b04b3da34be56965ef38fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77d9e3bc97b04b3da34be56965ef38fe"}]}] Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerShowV254Test-113509550 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 77d9e3bc97b04b3da34be56965ef38fe Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerShowV254Test-113509550 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerShowV254Test-113509550-project Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 6d8de036391d4f91865e6810c91937b3 Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerShowV254Test-113509550-project Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '31ff4379-6429-4581-8cff-a8ecd76f4e4e'} Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:18.257299 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] Returning 404 to user: Instance 31ff4379-6429-4581-8cff-a8ecd76f4e4e could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:01:18.262774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a853674-1708-4234-8be5-acfe9b5462d3 tempest-ServerShowV254Test-113509550 tempest-ServerShowV254Test-113509550-project] 10.222.0.27 "GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e" status: 404 len: 111 microversion: 2.54 time: 0.076267 Oct 19 01:01:18.263799 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-13d2049d-89d8-4688-ad7b-9c1fad2bf6cc req-ac86882a-b103-4a77-be91-5a7822345610 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121916 Oct 19 01:01:18.263799 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1728/3563] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:18.268974 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1836/3564] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:18 2022] GET /compute/v2.1/servers/31ff4379-6429-4581-8cff-a8ecd76f4e4e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:01:18.270580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:18.271764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:18.309263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:18.309778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:18.319141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:18.323659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:18.324811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:18.325274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.072970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:19.100043 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-208fbfa7-b48f-4cf5-b3f3-a347c69ac390 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.835245 Oct 19 01:01:19.101931 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1729/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:18 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:19.164048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:19.168058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:19.177304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:19.178279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:19.179104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.180107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:19.180816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:19.181454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.210396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:19.210953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:19.229637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:19.230149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:19.230602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.232003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:19.232541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:19.233251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.701606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:19.731386 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9aa8611d-7f8b-427c-accf-136c1d3399b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.574097 Oct 19 01:01:19.732647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1837/3566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:19 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:19.748934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:19.756311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:19.756854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:19.757309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:19.793428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Going to try to stop instance {{(pid=131449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:01:19.794858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:19.820022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-566319f6-6d40-48cc-8da4-2e935067ea28 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1529 microversion: 2.1 time: 0.614418 Oct 19 01:01:19.821942 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:19.839418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1730/3567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:19 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1529 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:19.846168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1616071549", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:19.943415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e8abe82-6551-4762-acc3-ae98c928abd6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action" status: 202 len: 0 microversion: 2.1 time: 0.197182 Oct 19 01:01:19.947009 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1838/3568] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:01:19 2022] POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:01:19.952425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:01:19.985680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:19.986425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:20.005687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.006459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.007116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.013195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.014059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.016379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.446320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:20.455499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29f6aab3-4eb0-4831-a0f5-92ade2634864 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1674 microversion: 2.1 time: 0.503412 Oct 19 01:01:20.462366 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1839/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:19 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1674 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:20.477643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:20.478573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:20.490286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.490791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.491237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.491969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.492429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.492893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.781351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:01:20.781865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:01:20.782251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:01:20.782662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:01:20.783072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:01:20.800076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.800657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.806116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.806937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.807417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.807850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.829209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:20.843879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03f904cb-2ae6-4068-a6d0-ba86571d32a9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.379942 Oct 19 01:01:20.844288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Getting quotas for project ac2546ccf89145aa87a9fc9231a2a7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:20.844471 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1840/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:20 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:20.850858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Getting quotas for user b67c81c105654dac996312942d5f9ce5 and project ac2546ccf89145aa87a9fc9231a2a7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:01:20.863540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "tag": "1e03b748-59bd-4f7a-95ff-835fb8069759"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:20.882276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:01:20.886339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:01:20.891472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.891961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:20.894380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:20.931353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] Creating event network-changed:1e03b748-59bd-4f7a-95ff-835fb8069759 for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:20.939371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-82dbf84d-ea1d-45fd-9d1a-c93af68de10b req-13f2b241-7d8c-4f56-ba73-13daf6f97242 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089375 Oct 19 01:01:20.943430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1841/3571] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:20.960086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:20.960853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:20.975616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:20.976570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:21.001170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:21.002857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:21.006911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:21.007650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:21.038528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d9d3547b-be37-4ca5-8a42-878c6069d757 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193778 Oct 19 01:01:21.040152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1731/3572] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:01:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:01:21.048706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1679572932", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15781cc1-f605-410c-8b0d-091017a02b70"}], "security_groups": [{"name": "tempest-securitygroup--1032381944"}], "key_name": "tempest-keypair-1687956963", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:21.327903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] validate_networks() for [('15781cc1-f605-410c-8b0d-091017a02b70', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:01:22.016979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:22.058759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42441226-0709-4593-9ac2-f3dc6338dd71 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 1.113784 Oct 19 01:01:22.063423 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1842/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:20 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:22.076191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:22.084392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:22.112847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.130283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.130987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.133141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.145503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.146262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.446428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:22.458621 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f62dce6-50e2-428d-8387-fbbee73e7845 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.393604 Oct 19 01:01:22.460230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1843/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:22 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:22.465250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:22.466099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:22.472261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.473769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.474395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.475290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.475932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.476565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.679274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:22.710975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-855ddb46-7495-4ee4-b7f8-4c7e3d12a132 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1266 microversion: 2.1 time: 0.249398 Oct 19 01:01:22.715883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1844/3575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:22 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:22.741681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:01:22.742206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:01:22.742418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:01:22.743061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:01:22.744281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:22.745316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:22.745838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:01:22.752867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.754646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.755418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.756317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.756984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.757586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.763034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.763536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.764175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.774088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.774693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.775261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.801381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:22.809039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for user e3d4cc70eeca421585fabdb682af7caf and project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:01:22.824077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:01:22.826321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:01:22.889732 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f25d475-bc4f-4be7-a89b-0e1cccc4a21e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.848265 Oct 19 01:01:22.890916 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1732/3576] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 01:01:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:01:22.896397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:22.897276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:22.904984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.905715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.906353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:22.907254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:22.907986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:22.908804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.029174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.042609 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1674 microversion: 2.1 time: 0.310971 Oct 19 01:01:23.046535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1845/3577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:22 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1674 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:23.051387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:23.052551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85b61a4b-e732-4907-bc0a-fb0bc9e5d0c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002365 Oct 19 01:01:23.055594 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1846/3578] 10.222.0.27 () {56 vars in 886 bytes} [Wed Oct 19 01:01:23 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 01:01:23.080755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:23.081971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:23.305956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.320692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.329199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.333049 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33db02b9-dfb5-469f-9f2d-36a4090a294a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1282 microversion: 2.20 time: 0.275029 Oct 19 01:01:23.336359 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1847/3579] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:23 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1282 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:23.350317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:23.351192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:23.368391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.369251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.370044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.371046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.371876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.372989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.421460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.436358 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-159f0914-74a0-4369-846d-67b3585141e5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.543407 Oct 19 01:01:23.438137 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1733/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:22 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:23.516957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:23.518291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:23.534890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.536444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.537181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.538477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.539170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.539846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.836382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:23.845747 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dcd98cd4-2f2a-4ce5-9819-86171f4cb71e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.507945 Oct 19 01:01:23.852193 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1848/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:23 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:23.864752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:23.868410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:23.903966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.906262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.906947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:23.907926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:23.908581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:23.909233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.081406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:24.083729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:24.099490 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22b5cbaf-1380-4751-8219-ecb9ed553f52 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1266 microversion: 2.1 time: 0.244824 Oct 19 01:01:24.101562 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03fde84f-240e-4d85-b6f9-4101894594da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.622349 Oct 19 01:01:24.101867 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1849/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:23 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:24.103684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1734/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:23 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:24.110131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:24.110966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:24.120021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.120890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.121817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.122712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.123345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.124103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.361568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:24.363729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:24.373011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.377361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.378288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.379377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.386578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.389747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.837033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:24.862630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:24.864944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:24.866136 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3d35e06-4832-4fd9-8791-8883ded0568c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1278 microversion: 2.20 time: 0.508966 Oct 19 01:01:24.889835 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1735/3584] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:24 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1278 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:24.895472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:24.896366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:24.931896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.932400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.933077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:24.933977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:24.934442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:24.934876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.040314 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:25.108977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:25.129485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0fa7c64-c74e-45e7-a603-e48e99d5895b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1674 microversion: 2.1 time: 1.021847 Oct 19 01:01:25.130740 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1850/3585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:24 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1674 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:25.143017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc832ba5-2475-4b09-ab86-e7e2adc1694b", "name": "network-vif-plugged", "status": "completed", "tag": "07783e2f-b58a-490c-964c-e21d100b472c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:25.167682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:25.169323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:25.173228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.198476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] Creating event network-vif-plugged:07783e2f-b58a-490c-964c-e21d100b472c for instance dc832ba5-2475-4b09-ab86-e7e2adc1694b on n-h2-master-1 Oct 19 01:01:25.229705 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-64f35037-9311-4cdb-8a9f-89af3cbeaaca req-1b35f317-c839-4d4b-b1de-1e7872480c59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096675 Oct 19 01:01:25.236833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1851/3586] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:25.243981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:25.245667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:25.258901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:25.259467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:25.259995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.260894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:25.261370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:25.262079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.869311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:25.886318 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7ccf464f-7f60-4f7c-85f1-4a984c928800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.994683 Oct 19 01:01:25.887421 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1736/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:24 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:25.899978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:25.901534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:25.914491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:25.915637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:25.916312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.917337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:25.918035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:25.918687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:25.959432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:25.967758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0fd4b47f-48ff-495f-a8bd-0ce57863e4a1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.729060 Oct 19 01:01:25.973908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1852/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:25 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:25.993653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:25.994326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:26.000599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.001363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.002022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.002898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.003548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.004148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.282847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:26.300809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9621ef40-918b-4d10-8561-1868825bd736 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1272 microversion: 2.1 time: 0.325190 Oct 19 01:01:26.314817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1853/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:25 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1272 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:26.326264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:26.327233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:26.335666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.336574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.337472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.338962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.340467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.341157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.624327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:26.640328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:26.642191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:26.643578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-988c7b07-c19d-4b27-a127-9c8438030b0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1340 microversion: 2.20 time: 0.327422 Oct 19 01:01:26.649614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1854/3590] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:26 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1340 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:26.659298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:26.661744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:26.676476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.679771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.680418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.681382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.682687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.687678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.852938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:26.868432 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-741a2301-7f0e-4bc5-8f7c-aae58f50a3b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.979493 Oct 19 01:01:26.869385 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1737/3591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:25 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:26.917086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:26.918066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:26.928780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.930133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.930837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:26.932157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:26.933258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:26.934193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.216063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:27.224143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e856a614-e19a-413f-aeba-4acb09701e2b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1674 microversion: 2.1 time: 0.568618 Oct 19 01:01:27.236384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1855/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:26 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1674 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:27.241910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:27.242516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:27.270821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.271317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.271756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.272474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.272958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.273398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.499109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:27.513050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c03bfe1d-22d2-4aca-9bc7-555243a07751 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.603963 Oct 19 01:01:27.517572 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1738/3593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:26 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:27.525727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:27.531718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:27.550544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.551395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.551988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.552913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.553521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.554100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.794597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:27.803575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e04bcef6-4238-4972-b4e6-1525783e2c4c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1272 microversion: 2.1 time: 0.284678 Oct 19 01:01:27.809466 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1739/3594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:27 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1272 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:27.823243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:27.824443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:27.836261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.843493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.844232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.845254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:27.845928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:27.850422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:27.995855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:28.016038 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c1e87a2-321b-4987-b64a-ba3f701b7cf3 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.767060 Oct 19 01:01:28.018205 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1856/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:27 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:28.023375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:28.024271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:28.030179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:28.047175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.048037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.048731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.049615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:28.049877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.051147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.051790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.051889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:28.067908 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad29de8d-085f-48e8-aae5-eec194951b1b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1340 microversion: 2.20 time: 0.242316 Oct 19 01:01:28.068602 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1740/3596] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:27 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1340 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:28.263055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:28.263820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:28.285909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.286694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.291165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.292270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.295281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.309322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.547938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:28.565576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06cd9077-a249-4ac6-a4f7-aa45bffd80a9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.545907 Oct 19 01:01:28.583620 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1857/3597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:28 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:28.583620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:28.583620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:28.590317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.590803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.591252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.604103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:28.605437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:28.609527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:28.650257 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:29.088239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:29.117956 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-092c237c-0dc9-461b-b787-6b2657d3a0bf tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1674 microversion: 2.1 time: 0.861032 Oct 19 01:01:29.124493 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1741/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:28 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1674 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:29.140487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:29.141525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:29.148834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.149644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.150615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:29.152282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.153173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.153805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:29.518530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:29.526681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ed6cbbb-add8-4a47-92f6-0a7891ca8807 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.957751 Oct 19 01:01:29.527485 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1858/3599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:28 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:29.549099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:29.549929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:29.556766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.557462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.558066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:29.558922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.559518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.560081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:29.598993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:29.608899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-986112ed-d4de-49ce-bc83-d639abc0f42f tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.478938 Oct 19 01:01:29.609692 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1742/3600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:29 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:29.629323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:29.630159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:29.636235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.636946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.637550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:29.638399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:29.638995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:29.639562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:30.012302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:30.020937 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-755ee1ee-33bf-4be9-974f-e83a048fbf05 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.478278 Oct 19 01:01:30.021543 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1859/3601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:29 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:30.033774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:30.043098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:30.063187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:30.068162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:30.069919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:30.073131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:30.076536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:30.077015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:30.621007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:30.633286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:30.637995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:30.639317 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e915b4cd-c64c-4eac-87b2-bb8b14c01160 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 1.014148 Oct 19 01:01:30.657183 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1743/3602] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:29 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:30.666525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:30.667386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:30.673724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:30.680925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:30.681595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:30.682475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:30.683087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:30.683679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:30.961727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:30.976127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e75b1d5-1b08-4962-a035-3b824fc57146 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.945932 Oct 19 01:01:30.977379 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1860/3603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:30 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:30.982189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:30.986382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:30.998051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.005800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.006680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.007862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.008538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.009212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.138465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:31.149824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0234d38-9f87-4e9f-8630-352d96458e28 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1651 microversion: 2.1 time: 0.491118 Oct 19 01:01:31.154076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1744/3604] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:30 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1651 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:31.172311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:31.173309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:31.179964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.183878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.184834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.185831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.186547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.187207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.796288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:31.835875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a73da027-5bee-4894-aec3-e7340af86ed3 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.656971 Oct 19 01:01:31.845298 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1745/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:31 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:31.862575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:31.863688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:31.868657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:31.887863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.888557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.888768 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb0b39bc-bcd5-4109-8264-e600f7077616 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1498 microversion: 2.1 time: 0.902342 Oct 19 01:01:31.890062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1861/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:30 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1498 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:31.896118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:31.901849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.903859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.912579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.914010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.915142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:31.915645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:31.916097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:31.968070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Going to try to start instance {{(pid=131449) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:01:32.071446 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a39c3f96-f137-4f52-9567-d7bf80c45f87 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action" status: 202 len: 0 microversion: 2.1 time: 0.179762 Oct 19 01:01:32.074153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1862/3607] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:01:31 2022] POST /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:01:32.097432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-plugged", "status": "completed", "tag": "9405a692-e53c-49b0-9bde-cacc6ee9c8bb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:32.127099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.129231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.130451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.162866 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] Creating event network-vif-plugged:9405a692-e53c-49b0-9bde-cacc6ee9c8bb for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:32.179800 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c1f07043-b6d3-4b21-9806-4f281af639e4 req-7942e96b-7a38-41e5-befe-07a62fbd50e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100840 Oct 19 01:01:32.181882 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1863/3608] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:32.201652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:32.205377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:32.225772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.227542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.228241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.229698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.232163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.234505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.396083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:32.409213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d4f3082-ed4e-429b-bbf3-63588a434c14 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.558131 Oct 19 01:01:32.409948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1746/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:31 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:32.415384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:32.421161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:32.446416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.449887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.450497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.451634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.452322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.452946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.786165 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:32.815538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:32.825241 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:32.832188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39f30047-dc76-4ff5-b439-6f3183a87459 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.418959 Oct 19 01:01:32.833104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1747/3610] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:32 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:32.842742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:32.848895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:32.864481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.865026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.867419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:32.872000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:32.872545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:32.873040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.155600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:33.167854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:33.174431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:33.176339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8949d231-b3e9-4f9d-8fcd-637a76a7619f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.992730 Oct 19 01:01:33.191607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1864/3611] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:32 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:33.207957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6e1832-c42d-4f89-9b62-e34dfdf583b4", "tag": "3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:33.225996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.231116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.231740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.254399 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] Creating event network-changed:3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d for instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 on n-h2-master-1 Oct 19 01:01:33.263355 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4acbeffc-6eff-4468-9806-847fa18affef req-55c9d039-3e89-4055-a934-f64c61d4bc9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070112 Oct 19 01:01:33.264347 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1865/3612] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:33.284795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:33.285692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:33.302123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.302866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.303513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.304428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.305151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.305751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.311724 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:33.727970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:33.738287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ea7f5a2-722f-498c-ba86-ef8b36cea67c tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1660 microversion: 2.1 time: 0.901187 Oct 19 01:01:33.738917 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1748/3613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:32 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1660 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:33.754945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:33.755590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:33.780545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.781093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.787912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.788751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.789255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.789707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.826959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:33.838974 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8bc2012-8b57-4f2d-94a1-2cb51e993415 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.573094 Oct 19 01:01:33.839597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1866/3614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:33 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:33.861168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:33.869325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:33.877800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.888961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.889670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:33.890583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:33.891201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:33.891782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.295420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:34.324247 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4428aee4-8893-436b-95c5-7f4f6503201b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 200 len: 1475 microversion: 2.1 time: 0.576988 Oct 19 01:01:34.325128 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1749/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:33 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 1475 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:34.334748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:34.335380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:34.358472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.362304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.362877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.369857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.370581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.371297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.410574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:34.425039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64b4ad7a-c3bb-4585-bbbf-c9c7b2a96627 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.567001 Oct 19 01:01:34.425954 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1867/3616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:33 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:34.440478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-plugged", "status": "completed", "tag": "1e03b748-59bd-4f7a-95ff-835fb8069759"}, {"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-plugged", "status": "completed", "tag": "136100a6-e6d1-401b-bc50-86cd3f1d7b4b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:34.482426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.482922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.483365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.513637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Creating event network-vif-plugged:1e03b748-59bd-4f7a-95ff-835fb8069759 for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:34.514168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] Creating event network-vif-plugged:136100a6-e6d1-401b-bc50-86cd3f1d7b4b for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:34.523034 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-abf9c885-2f75-4d30-b137-7f3635c80a97 req-189a2528-e593-4eeb-b559-b7b5cfb41372 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094634 Oct 19 01:01:34.523676 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1868/3617] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:34.544218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:34.544218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:34.561796 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:34.563882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.564591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.565113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.565950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.566441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.567031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.804671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:34.820980 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-acab89f2-7ef6-44f3-b76c-4f8f048080df tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.494719 Oct 19 01:01:34.823113 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1750/3618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:34 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:34.828278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1665654187"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:34.835624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:34.850215 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:34.852526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.853203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.853803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:34.854695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:34.855305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:34.855898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.168203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:35.182194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:35.183880 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:35.191201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:35.199128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-155070fa-ee96-4531-b150-a3a4f72a4c92 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.660964 Oct 19 01:01:35.200250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1869/3619] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:34 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:35.205317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:35.208722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:35.215166 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-525d0f85-e90b-4d8a-b47a-7a909c6dcdb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7/action" status: 202 len: 0 microversion: 2.1 time: 0.390208 Oct 19 01:01:35.218928 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1751/3620] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:01:34 2022] POST /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:01:35.222503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.223092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.227849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.228831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.229451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.230037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.234482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:35.235827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:35.247412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.248111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.248795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.249965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.250588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.251176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.683198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:35.698344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7eb632b2-b50f-475e-8303-817ceeb8479c tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.477938 Oct 19 01:01:35.699199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1752/3621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:35 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:35.711335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99b44ac6-e326-4890-8934-5f913347c5d0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af49864c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:35.728818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:35.778736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22029b91-92fb-4e51-9599-9854f31880fe tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1664 microversion: 2.1 time: 0.577068 Oct 19 01:01:35.783442 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1870/3622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:35 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1664 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:35.793736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:35.835799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.837402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.838731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.839703 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99b44ac6-e326-4890-8934-5f913347c5d0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.137658 Oct 19 01:01:35.840578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1753/3623] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:35 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:35.848856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:35.849487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:35.856592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.857133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.857584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.858307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.858938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.859386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.871347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] Creating event network-changed:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h1-master-1 Oct 19 01:01:35.885450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2717db9b-7420-4685-ab92-4d2f3ee42a52 req-b6a0b5b9-145d-49a5-a6e0-eae3afc34904 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096725 Oct 19 01:01:35.887286 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1871/3624] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:35.892951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:35.893675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:35.900910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.901598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.902191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:35.903370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:35.903986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:35.904570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:36.214766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:36.231229 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-988660f7-cca7-4fc3-8aa3-828844f76e81 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.342670 Oct 19 01:01:36.231832 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1872/3625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:35 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:36.243311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:36.247440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:36.260137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:36.261102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:36.261761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:36.262696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:36.272330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:36.274733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:36.305815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:36.320337 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3e2c604-1fca-43f2-8ea9-665429ad3220 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1355 microversion: 2.1 time: 0.476891 Oct 19 01:01:36.344491 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1754/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:35 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1355 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:36.616670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:36.630614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:36.635929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:36.641359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0cf67264-ec44-4c0b-bddb-53ef3f68ff7d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.406424 Oct 19 01:01:36.643245 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1873/3627] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:36 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:36.727118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:36.728943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:36.755086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:36.756469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:36.757314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:36.758581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:36.759791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:36.761037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:36.858903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b3e5adeb-dc2a-4d42-ab07-1d17f2dd28f6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4346dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:36.930679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b3e5adeb-dc2a-4d42-ab07-1d17f2dd28f6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.075929 Oct 19 01:01:36.931218 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1874/3628] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:36 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:37.259129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:37.260805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:37.274246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.275104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.278614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.280060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.281447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.282262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.294052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:37.305175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fcbda844-cd2b-4fb8-ac73-f1f6e2c7dbad tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.583453 Oct 19 01:01:37.307018 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1755/3629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:36 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:37.354580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:37.355565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:37.365474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.370807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.372633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.375023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.375771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.377662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.699328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:37.712320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:37.713521 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b820ee98-866e-4804-aed6-446ade8f2d49 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1806 microversion: 2.1 time: 0.363870 Oct 19 01:01:37.714813 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1756/3630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:37 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1806 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:37.720777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:37.721564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:37.728430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.729577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.730722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.731614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.732113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.732749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.738249 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f93776b9-67ee-4f91-a25e-b817c62d7607 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.484113 Oct 19 01:01:37.738995 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1875/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:37 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:37.763268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:37.763775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:37.794420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.795146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.795726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.796582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.797247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.797819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.859069 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-50601bda-d6b1-4799-a6b4-9fee5cd091f6 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042/ips" status: 200 len: 219 microversion: 2.1 time: 0.102452 Oct 19 01:01:37.866149 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1876/3632] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:01:37 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042/ips => generated 219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:37.874464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:37.875291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:37.891449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.892220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.892879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.893836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:37.894516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:37.895193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:37.965716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:01:37.982645 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:38.014867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:38.023731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:38.025229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:38.033050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-280b89e6-c1ce-49f7-9ae9-2dddeecd74ef tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.316732 Oct 19 01:01:38.033956 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1757/3633] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:37 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:38.047754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-681c81d9-b017-457c-997f-f50d355660c1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af457e160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:38.138287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-681c81d9-b017-457c-997f-f50d355660c1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.102474 Oct 19 01:01:38.139184 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1758/3634] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:38 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:38.169269 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d9130a8-dfb6-4339-93e2-7cf31490b984 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 204 len: 0 microversion: 2.1 time: 0.300051 Oct 19 01:01:38.174170 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1877/3635] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:01:37 2022] DELETE /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:01:38.179549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:38.180428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:38.186819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.187590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.188255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:38.189209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.189857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.190475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:38.336474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:38.338015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:38.350740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.352721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.354119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:38.354868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.357243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.358515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:38.895443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:38.910890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-48d8b95e-b248-4412-bce7-cbf9975dafe5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1812 microversion: 2.1 time: 0.735840 Oct 19 01:01:38.932084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1759/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:38 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1812 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:38.945810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:38.952732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:38.955323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:38.956714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-991c7ca8-9ecc-4405-bc73-f5c09c5a6e98 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.624108 Oct 19 01:01:38.974933 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1878/3637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:38 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:38.983301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.983896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.984422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:38.985803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:38.986413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:38.987002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.064949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:39.066608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:39.080677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:39.083623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:39.086087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.088277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:39.090319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:39.091082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.415120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:39.427543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3ca7088-4ecf-4bbe-b474-3398db208d4e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.493903 Oct 19 01:01:39.428575 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1760/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:38 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:39.435810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57090143-442d-495f-9e80-fc664daf933e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4967ee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:39.459365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:39.473465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:39.476435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:39.479466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20270476-aadb-41db-9649-9bc70fcdccd0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.418714 Oct 19 01:01:39.481375 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1879/3639] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:39 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:01:39.489065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6e1832-c42d-4f89-9b62-e34dfdf583b4", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:39.500046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:39.500839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:39.501688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.529724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] Creating event network-vif-plugged:3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d for instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 on n-h2-master-1 Oct 19 01:01:39.558704 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8a07267c-1591-4c64-a746-f585a41cf8bb req-1bf57953-b118-47be-b8c7-4adda47f1802 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070750 Oct 19 01:01:39.559533 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1880/3640] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:39.700910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57090143-442d-495f-9e80-fc664daf933e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.270989 Oct 19 01:01:39.701512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1761/3641] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:39 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:39.942617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:39.943353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:39.960712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:39.966645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:39.967138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.970707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:39.971216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:39.972895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:39.982777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:39.984164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:40.012961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.013832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.015564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:40.018043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.021550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.022760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:40.584298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:40.592935 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf8cac94-0afe-4298-afa9-1a74037076aa tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1314 microversion: 2.1 time: 0.614952 Oct 19 01:01:40.611072 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1762/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:39 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1314 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:40.612582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:40.627621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:40.631060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:40.642294 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2187a0cc-22a4-46b4-a638-3217f7a20075 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1812 microversion: 2.1 time: 0.705982 Oct 19 01:01:40.644604 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1881/3643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:39 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1812 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:40.649990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:40.650860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:40.656232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.656770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.657222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:40.661962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.666642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.667699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.668376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:40.671105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:40.671898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.676480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:40.677413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:40.682602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:41.118254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:41.136584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:41.138462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:41.142028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-47723625-82df-43ee-a989-f2b2a9efcf0f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.496080 Oct 19 01:01:41.146197 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1882/3644] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:40 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:41.164236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-744d0e63-de08-433c-9c2f-4c26a8bdb52f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af9370160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:41.253839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:41.285690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1a7862f-1565-4c4b-80f2-57a0ee5047f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.683722 Oct 19 01:01:41.294093 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1763/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:40 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:41.473163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-deleted", "tag": "9405a692-e53c-49b0-9bde-cacc6ee9c8bb"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:41.586251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:41.588993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:41.596844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:41.695032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] Creating event network-vif-deleted:9405a692-e53c-49b0-9bde-cacc6ee9c8bb for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:41.737197 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-25c90ade-ef5f-4589-966d-485529d28528 req-36a0674c-b12d-4238-8b9d-a86149f97317 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267761 Oct 19 01:01:41.739449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1764/3646] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:01:41.823501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:41.824730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:41.833506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:41.834285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:41.834892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:41.836006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:41.836882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:41.837587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:42.209455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:42.226667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf94d669-5c48-4ad2-b728-5988ec333ac8 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1464 microversion: 2.1 time: 0.469134 Oct 19 01:01:42.231779 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1765/3647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:41 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1464 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:42.254005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:42.260355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:42.285061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:42.291017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:42.296276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:42.297326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:42.301040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:42.301713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:42.823280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:42.843265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e04db687-e63f-4cdb-8bea-135736e58c52 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1633 microversion: 2.1 time: 0.606461 Oct 19 01:01:42.859001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1766/3648] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:42 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1633 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:42.871161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:42.872040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:42.880452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:42.881228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:42.881857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:42.882870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:42.883489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:42.884077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.148507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:43.164645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:43.167103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:43.170128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58437f59-81c7-41d7-9e8f-d82b08e64f6f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.307876 Oct 19 01:01:43.171072 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1767/3649] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:42 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:43.203448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37611834-538c-4397-9177-389cda55181f", "device": "/dev/sdb"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:43.213851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:43.230626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:43.233406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:43.234011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.238523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:43.239226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:43.240054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.367628 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-744d0e63-de08-433c-9c2f-4c26a8bdb52f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 2.217918 Oct 19 01:01:43.375559 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1883/3650] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:41 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:43.403982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:43.409028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:43.445814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:43.447743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:43.448212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.453140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:43.458722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:43.459706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.885652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:43.895921 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e9f448b-b931-4c14-8ffd-676417c4f0ef tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1524 microversion: 2.1 time: 0.519002 Oct 19 01:01:43.897233 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1884/3651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:43 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1524 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:43.917855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-unplugged", "status": "completed", "tag": "136100a6-e6d1-401b-bc50-86cd3f1d7b4b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:43.934100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:43.946872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:43.948409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:43.997143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] Creating event network-vif-unplugged:136100a6-e6d1-401b-bc50-86cd3f1d7b4b for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:44.017135 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-70092d73-4cee-4522-81f1-7d81b0430526 req-91983d43-e720-411a-ad63-68f849f0c350 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108473 Oct 19 01:01:44.021647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1885/3652] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:44.022208 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a999840b-a174-4f51-a89e-51a5c3e67227 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "POST /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833940 Oct 19 01:01:44.028861 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1768/3653] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:01:43 2022] POST /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4/os-volume_attachments => generated 194 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:44.045299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:44.053220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-deleted", "tag": "1e03b748-59bd-4f7a-95ff-835fb8069759"}, {"server_uuid": "84d562d0-1929-45fe-9e6a-43dd35f22042", "name": "network-vif-deleted", "tag": "136100a6-e6d1-401b-bc50-86cd3f1d7b4b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:44.060254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:44.075582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.079372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.080055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.104019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.111421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.119890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.120073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Creating event network-vif-deleted:1e03b748-59bd-4f7a-95ff-835fb8069759 for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:44.120578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] Creating event network-vif-deleted:136100a6-e6d1-401b-bc50-86cd3f1d7b4b for instance 84d562d0-1929-45fe-9e6a-43dd35f22042 on n-h2-master-1 Oct 19 01:01:44.123369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.124971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.128091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9b2afaca-5d32-4fa5-ba33-d101bf055b75 req-6a493a34-d256-410f-a7db-5d3960942541 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104145 Oct 19 01:01:44.129139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1886/3654] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:44.141785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.204170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:44.205244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:44.214426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.215257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.215908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.217607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.218433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.219078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.377659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:44.399632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35479bda-b417-4bb7-8cc3-f4d62199c61c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 200 len: 1570 microversion: 2.1 time: 0.374741 Oct 19 01:01:44.401711 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1769/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:44 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 1570 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:44.407312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a14bab4a-5da5-40c3-bfba-3fada5705887 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af48efc10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:44.528004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a14bab4a-5da5-40c3-bfba-3fada5705887 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.124806 Oct 19 01:01:44.540089 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1770/3656] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:44 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:44.643544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:44.655593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:44.657092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:44.662867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55fb7bda-8861-4324-9a24-bcdc3d8c67da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.463105 Oct 19 01:01:44.664218 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1887/3657] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:44 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:44.920922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:44.922014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:44.945948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.948109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.950086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:44.954159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:44.955586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:44.960437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:45.338900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:45.361366 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:45.382336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-61698af9-2bd0-4dc0-a86c-9228f04f1251 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1506 microversion: 2.1 time: 0.466399 Oct 19 01:01:45.389484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1771/3658] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:44 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1506 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:45.428382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:45.430169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:45.450771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:45.451841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:45.453272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:45.456558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:45.457329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:45.457967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:45.494322 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 HTTP/1.1 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '84d562d0-1929-45fe-9e6a-43dd35f22042'} Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:45.498934 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:01:45.503176 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:01:45.509826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:01:45.512415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2aab3daf-023c-4a27-a465-085961dbe913 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 404 len: 111 microversion: 2.1 time: 0.089179 Oct 19 01:01:45.530540 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1888/3659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:45 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:01:45.548179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f38f06a-d2bb-44ea-ba82-5803ba71a48f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af43b5700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:45.637957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f38f06a-d2bb-44ea-ba82-5803ba71a48f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.095153 Oct 19 01:01:45.649352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1772/3660] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:45 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:45.694500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:45.695812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:45.709369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:45.710109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:45.711176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:45.713174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:45.716571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:45.717225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:46.069886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:46.072986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-plugged", "status": "completed", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}, {"server_uuid": "d1d418aa-2e73-4d69-a123-af4b9941aaf7", "name": "network-vif-plugged", "status": "completed", "tag": "f91180b1-af91-411b-bab5-7bf6e464db2a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:46.083251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:46.088348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:46.090047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:46.090710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:46.091328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:46.094417 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4e661a1-610b-449f-aa1d-0eb5a83593b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.402347 Oct 19 01:01:46.117609 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1889/3661] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:45 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:01:46.123329 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Creating event network-vif-plugged:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h1-master-1 Oct 19 01:01:46.124656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] Creating event network-vif-plugged:f91180b1-af91-411b-bab5-7bf6e464db2a for instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 on n-h1-master-1 Oct 19 01:01:46.134905 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-17bcacd0-bfc2-4778-8abd-6b0b5d9ad968 req-f5f67480-b738-4286-aa72-31cb58fb7a76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065216 Oct 19 01:01:46.140349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1773/3662] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:01:46.416367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:46.417302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:46.428696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:46.437207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:46.439031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:46.439992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:46.444886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:46.449335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:46.659075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbe4ab17-78b7-4c0b-a281-00e46a644ec9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af49db790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:46.749690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbe4ab17-78b7-4c0b-a281-00e46a644ec9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.095301 Oct 19 01:01:46.750281 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1774/3663] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:46 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:46.896372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:46.908336 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d577835a-e391-4f4c-ba83-8e5cb823d800 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1506 microversion: 2.1 time: 0.495653 Oct 19 01:01:46.910717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1890/3664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:46 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1506 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:47.132896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:47.133632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:47.154392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:47.154895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:47.155350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:47.156073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:47.156532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:47.162118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:47.510414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:47.529330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:47.538963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:47.543234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85c427ca-42b8-4ec2-bc36-cd9f41dd6ebc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1408 microversion: 2.20 time: 0.414233 Oct 19 01:01:47.545246 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1775/3665] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:47 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1408 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:47.768200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-521853e7-85e2-4d41-8b91-17bcd32713a4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4261ee0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:47.859754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-521853e7-85e2-4d41-8b91-17bcd32713a4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.096018 Oct 19 01:01:47.861441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1891/3666] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:47 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:47.931902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:47.933929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:47.946740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:47.949236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:47.950198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:47.973979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:47.975369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:47.977928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.182313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc832ba5-2475-4b09-ab86-e7e2adc1694b", "name": "network-vif-unplugged", "status": "completed", "tag": "07783e2f-b58a-490c-964c-e21d100b472c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:48.227464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:48.228998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:48.229621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.298410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.compute.server_external_events [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] Unable to find a host for instance dc832ba5-2475-4b09-ab86-e7e2adc1694b. Dropping event network-vif-unplugged {{(pid=131449) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 01:01:48.299771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c8621b5e-003e-4462-90c6-628606017de6 req-3c2dee14-d93f-423f-a5bf-57dae2a6036e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.127482 Oct 19 01:01:48.303409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1892/3667] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 131 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 01:01:48.455667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:48.466882 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57980624-572b-4b76-92b8-cc79e55b5ef3 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 200 len: 1509 microversion: 2.1 time: 0.539261 Oct 19 01:01:48.477058 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1776/3668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:47 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 1509 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:48.498834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:48.499702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:48.508762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:48.511634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:48.513074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.514676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:48.515408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:48.516331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.572116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:48.572770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:48.586518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:48.587054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:48.590918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.602338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:48.603023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:48.603666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:48.605959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:01:48.631494 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.api [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Working on deleting snapshot 044dcf97-8499-4a4f-87bd-e33c0a71a83f from shelved instance... Oct 19 01:01:49.300444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:49.321794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:49.326454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:49.329324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a6dbeba-9515-4e7b-99c9-6f3aadf75976 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1599 microversion: 2.20 time: 0.761231 Oct 19 01:01:49.347485 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1777/3669] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:01:48 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1599 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:01:49.376402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f7c6e72-8285-4554-91b2-0a9ecde3ac8b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af497f8b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:50.191543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f7c6e72-8285-4554-91b2-0a9ecde3ac8b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.835066 Oct 19 01:01:50.200020 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1778/3670] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:49 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:50.226059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:50.226562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:50.253359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:50.254206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:50.254853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:50.256955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:50.258993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:50.260954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:50.275313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Doing local delete in cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131449) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 01:01:50.276071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:50.276566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:50.277042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:50.277478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.api [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 01:01:50.293644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] deallocate_for_instance() {{(pid=131449) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 01:01:50.611127 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9218daba-52ad-4058-9529-b2b86c11e9b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.411227 Oct 19 01:01:50.612202 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1779/3671] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:01:50 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-interface => generated 284 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:01:51.209225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-014ae592-216a-4a99-ad35-9622171effc4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af45a3f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:51.286184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-014ae592-216a-4a99-ad35-9622171effc4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.081986 Oct 19 01:01:51.287428 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1780/3672] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:51 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:51.495298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Updating instance_info_cache with network_info: [] {{(pid=131449) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 01:01:51.495841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc832ba5-2475-4b09-ab86-e7e2adc1694b", "name": "network-vif-deleted", "tag": "07783e2f-b58a-490c-964c-e21d100b472c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:51.545391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:51.545985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:51.548761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:51.587020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_external_events [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] Unable to find a host for instance dc832ba5-2475-4b09-ab86-e7e2adc1694b. Dropping event network-vif-deleted {{(pid=131450) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 01:01:51.588045 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-59413e9c-35da-416f-9e8e-2060b0d6e293 req-ed9bf276-4b3b-4da8-9c2b-1a26600adac7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.099954 Oct 19 01:01:51.592595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1781/3673] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 01:01:51.850900 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:01:51.953908 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40945fae-4bb9-4f98-bdd6-c3e653096e85 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 204 len: 0 microversion: 2.1 time: 3.455760 Oct 19 01:01:51.965335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1893/3674] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:01:48 2022] DELETE /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 0 bytes in 3471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:01:51.980181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:51.981673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:51.995757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:51.998449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:51.999143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:52.000266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:52.002397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:52.003782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:52.030576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b HTTP/1.1 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dc832ba5-2475-4b09-ab86-e7e2adc1694b'} Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:01:52.033037 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:01:52.036534 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:01:52.038368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:01:52.039267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3424190-53ad-47fe-8cdb-1ae7fcb14bd9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 404 len: 111 microversion: 2.1 time: 0.069854 Oct 19 01:01:52.040102 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1782/3675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:51 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:01:52.264844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1136567979", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:52.311039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-461ae024-b196-4774-841f-c030f8c95cc1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af457ec10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:52.439320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-461ae024-b196-4774-841f-c030f8c95cc1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.140937 Oct 19 01:01:52.445341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:01:52.458528 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1783/3676] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:52 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:53.339823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:01:53.341411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:01:53.342419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:01:53.344126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:01:53.345169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:01:53.363198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:53.365031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:53.365836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:53.367657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:53.368470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:53.369103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:53.399113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:53.407897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:01:53.425869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:01:53.429908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:01:53.464737 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7db16cd6-0c41-4052-a9d2-b3f999e9ca62 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af497fe50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:53.609289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7db16cd6-0c41-4052-a9d2-b3f999e9ca62 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.151717 Oct 19 01:01:53.611807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1784/3677] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:53 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:53.626438 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b2ec118-9eeb-4b6c-9316-4c601f931ba9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.365648 Oct 19 01:01:53.632084 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1894/3678] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:01:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:01:53.633666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:53.652931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6ba2d62-17ba-4ba3-870e-5010b8bfe8c5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:53.653602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6ba2d62-17ba-4ba3-870e-5010b8bfe8c5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:53.688962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:53.691482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:53.692651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:53.730948 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] Creating event network-changed:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h1-master-1 Oct 19 01:01:53.762126 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-810126ff-95e2-468a-8343-9e9f636bc8c9 req-44a8b539-afda-4264-8a60-c52b8dcef372 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128916 Oct 19 01:01:53.765902 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1785/3679] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:01:53.866352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6ba2d62-17ba-4ba3-870e-5010b8bfe8c5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:53.878655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6ba2d62-17ba-4ba3-870e-5010b8bfe8c5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1215 microversion: 2.1 time: 0.240847 Oct 19 01:01:53.900271 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1895/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:53 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1215 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:54.628666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0be124ab-186b-45f2-9621-8e6bd1411160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af43b5940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:54.726400 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0be124ab-186b-45f2-9621-8e6bd1411160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.102627 Oct 19 01:01:54.738801 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1786/3681] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:54 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:54.908805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:54.911075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:54.941929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:54.944338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:54.949244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:54.950560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:54.951422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:54.953920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:55.334466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:55.352771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-adc34ff6-f08c-4cb2-a2ac-4bbe4eee41da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1219 microversion: 2.1 time: 0.449136 Oct 19 01:01:55.360371 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1896/3682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:54 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1219 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:55.757526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5abf496e-cc92-49f6-a168-3abd41ba01d9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af434a160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:55.882593 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5abf496e-cc92-49f6-a168-3abd41ba01d9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.129428 Oct 19 01:01:55.884089 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1787/3683] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:55 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:56.380347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:56.381710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:56.399423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:56.403074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:56.404700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:56.406618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:56.407289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:56.410711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:56.633598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:56.647664 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d684ff09-3ae0-4711-875c-ffaf7bd1471a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1275 microversion: 2.1 time: 0.268221 Oct 19 01:01:56.649930 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1897/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:56 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:56.902244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-74cc51c1-1403-4ec0-aba6-7356b38e3023 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af43b5940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:56.943172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1732448105", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "ffea8e5e-f97c-4a82-abfd-d9d3f13f3666"}, {"uuid": "195fe5e7-64b7-4abc-8db7-d18828dc4935"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:01:57.021304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-74cc51c1-1403-4ec0-aba6-7356b38e3023 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.125170 Oct 19 01:01:57.022503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1788/3685] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:56 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:57.098004 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] validate_networks() for [('ffea8e5e-f97c-4a82-abfd-d9d3f13f3666', None, None, None, None, None), ('195fe5e7-64b7-4abc-8db7-d18828dc4935', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:01:57.685748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:57.686479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:57.706856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:57.709158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:57.714402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:57.717501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:57.719446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:57.723187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:58.139388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:01:58.150417 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fe8ea28-866c-4fb5-9826-a70be1df283b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1273 microversion: 2.1 time: 0.468430 Oct 19 01:01:58.170638 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1789/3686] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:57 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1273 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:01:58.182166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e92c0fe5-f099-4425-ae12-1bfe53d79724 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af434a4c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:58.266070 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e92c0fe5-f099-4425-ae12-1bfe53d79724 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.093849 Oct 19 01:01:58.266697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1790/3687] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:01:58 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:01:59.178770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:01:59.180052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:01:59.200737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:59.206581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:59.207236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:59.208151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:59.208803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:59.209444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:59.826882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:01:59.828756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:01:59.830866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:01:59.831702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:01:59.832310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:01:59.869770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:59.874366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:59.879229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:59.881382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:01:59.885768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:01:59.889704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:01:59.977786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Getting quotas for project 18b6ea2fe5ee4fc8a9b1f143ac95fcef. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:01:59.993208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Getting quotas for user 9ddb45b2dcf14263887a3718e23eb937 and project 18b6ea2fe5ee4fc8a9b1f143ac95fcef. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:02:00.069319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:02:00.097495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:02:00.245430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:00.269461 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5b1e39b-f56a-4ca2-a345-2315bced18ee tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 1.090631 Oct 19 01:02:00.284696 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1791/3688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:01:59 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:00.289861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5835890b-5dac-459f-9681-51e75ee859ec tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.351993 Oct 19 01:02:00.300554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1898/3689] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:02:00.324178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e292d78c-5b79-49e5-9e1e-1ecb49f454cf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4967280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:00.324392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58c26bec-643a-4bda-aa34-be67a0b4bb9e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:00.330085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58c26bec-643a-4bda-aa34-be67a0b4bb9e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:00.373686 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:00.446989 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e292d78c-5b79-49e5-9e1e-1ecb49f454cf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.161118 Oct 19 01:02:00.450664 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1792/3690] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:00 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:00.532914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1e0ca8-54fb-4d11-84d8-3bcaba81e481", "tag": "72c2ec40-6a42-494d-bbcf-c6e04e799b0b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:00.586466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:00.587408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:00.589228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:00.614014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] Creating event network-changed:72c2ec40-6a42-494d-bbcf-c6e04e799b0b for instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 on n-h2-master-1 Oct 19 01:02:00.724107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-39d7af3f-3406-4a96-a639-62d38d589321 req-bcfbed4c-172d-4db5-b24f-4b1502837db2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194773 Oct 19 01:02:00.745154 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1793/3691] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:00.768113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-58c26bec-643a-4bda-aa34-be67a0b4bb9e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:00.778642 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58c26bec-643a-4bda-aa34-be67a0b4bb9e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1213 microversion: 2.1 time: 0.467279 Oct 19 01:02:00.780512 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1899/3692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:00 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1213 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:01.310741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:01.311661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:01.342126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:01.343054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:01.345225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:01.347783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:01.351013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:01.352470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:01.466517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ebf9eee-bbc1-4838-ae04-278af336260a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af55e7a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:01.634412 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ebf9eee-bbc1-4838-ae04-278af336260a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.153894 Oct 19 01:02:01.634412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1900/3693] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:01 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:01.808145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:01.809227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:01.824177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:01.824965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:01.826449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:01.831975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:01.836150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:01.839216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:01.966798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:01.985673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25577af1-6c4f-4085-b8de-70d7d069fdf9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 0.679187 Oct 19 01:02:02.007602 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1794/3694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:01 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:02.164437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:02.173507 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f442c33-da48-49ed-8e8a-a40258f92ed1 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1217 microversion: 2.1 time: 0.369597 Oct 19 01:02:02.200663 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1901/3695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:01 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1217 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:02.635485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-447e2ea3-4584-4fda-9a40-d250c5b10bb4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4a34310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:02.739191 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-447e2ea3-4584-4fda-9a40-d250c5b10bb4 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.108729 Oct 19 01:02:02.739903 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1795/3696] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:02 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:03.014307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:03.015302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:03.038392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:03.045572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:03.053409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:03.054477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:03.055159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:03.055762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:03.216934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:03.217798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:03.235129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:03.237355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:03.247394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:03.249420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:03.255121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:03.256019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:03.589862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:03.589862 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b80092e-33ef-4bc0-8921-bf5604b5cc6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 0.561970 Oct 19 01:02:03.589862 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1902/3697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:03 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:03.703963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:03.719218 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2ea5125-7346-46fc-9dcc-f2f3a71bbd42 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1209 microversion: 2.1 time: 0.504894 Oct 19 01:02:03.720996 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1796/3698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:03 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1209 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:03.756643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-574e6e6f-d347-4cf8-8d65-429fe92cac03 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42e5c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:03.846432 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-574e6e6f-d347-4cf8-8d65-429fe92cac03 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.095055 Oct 19 01:02:03.851955 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1903/3699] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:03 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:04.599961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:04.601317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:04.609697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:04.615310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:04.615991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:04.620208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:04.621812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:04.622271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:04.746000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:04.746618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:04.767140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:04.773823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:04.775688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:04.776361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:04.776866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:04.777861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:04.912137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:04.949186 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc54bf45-5c51-42e1-ac9c-017b9064a8b7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1273 microversion: 2.1 time: 0.208884 Oct 19 01:02:04.950123 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1904/3700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:04 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:04.962178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36ef4a1b-d02f-4722-9704-a9e1e90dabae tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af453be50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:05.032872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:05.046806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f964bd8-4053-46f6-bb7b-705be1fd8a6e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 0.451358 Oct 19 01:02:05.047397 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1797/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:04 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:05.117716 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36ef4a1b-d02f-4722-9704-a9e1e90dabae tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.166210 Oct 19 01:02:05.118617 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1905/3702] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:04 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:05.977830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:05.978461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:05.989604 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=62 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:05.991102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:05.991614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:05.992042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:05.992790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:06.001671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:06.002766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:06.079460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:06.080092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:06.105685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:06.106454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:06.107049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:06.107932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:06.108554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:06.109810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:06.433496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:06.442025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:06.447665 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c72e594-fa95-4f64-929f-bab92a355f5c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 0.370354 Oct 19 01:02:06.464466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1906/3703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:06 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:06.464970 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b055cb9-0496-46d4-8975-6c0f3da421e2 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1313 microversion: 2.1 time: 0.485834 Oct 19 01:02:06.472689 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1798/3704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:05 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:06.480638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c037a451-eb0f-4f54-aebe-dfbd079ae34c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4871940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:06.568988 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c037a451-eb0f-4f54-aebe-dfbd079ae34c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.104144 Oct 19 01:02:06.569597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1907/3705] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:06 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:07.223984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1e0ca8-54fb-4d11-84d8-3bcaba81e481", "name": "network-vif-plugged", "status": "completed", "tag": "72c2ec40-6a42-494d-bbcf-c6e04e799b0b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:07.312837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:07.322625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:07.325300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:07.363009 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] Creating event network-vif-plugged:72c2ec40-6a42-494d-bbcf-c6e04e799b0b for instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 on n-h2-master-1 Oct 19 01:02:07.386947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f07aa90d-0f1a-40ca-85f6-ef611f37630e req-55e60fb6-d455-4159-8017-5d8277b674fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170584 Oct 19 01:02:07.387578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1799/3706] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:07.474947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:07.476156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:07.489310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:07.490811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:07.495199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:07.496001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:07.496858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:07.498452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:07.499351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:07.500063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:07.507604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:07.510271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:07.511009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:07.511944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:07.526886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:07.527718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:08.013101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:08.032799 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-19babc36-8008-4904-a6f8-1ee6e5d338e6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1315 microversion: 2.1 time: 0.563076 Oct 19 01:02:08.048945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:08.057975 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1908/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:07 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:08.063424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06001e96-48d1-484e-825a-1f90236de22c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af9390d30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:08.065824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-586c0cfa-37b3-4b5a-bd05-86f4c056dee4 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1313 microversion: 2.1 time: 0.581718 Oct 19 01:02:08.066452 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1800/3708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:07 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:08.154648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06001e96-48d1-484e-825a-1f90236de22c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1412 microversion: 2.1 time: 0.095307 Oct 19 01:02:08.155255 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1909/3709] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:08 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:09.064511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.066053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:09.078064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.078784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.079229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.079934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.082657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "tag": "6abbec63-612c-4450-b7a2-960ee198a9f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:09.083676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.084266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.109669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.111346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.111882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.126299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] Creating event network-changed:6abbec63-612c-4450-b7a2-960ee198a9f6 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:09.158616 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a434ab21-56cb-4651-b8fe-cffa4ef7b4c3 req-fe4eb871-b9a8-4c45-ba3a-adc52aa71ede service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080038 Oct 19 01:02:09.159669 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1910/3710] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:02:09.177572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.178721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:09.188399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.190453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.191087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.192532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.193251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.194227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.478304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:09.487531 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86ff92f0-7bab-403e-a1a9-1b6133ff0759 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1502 microversion: 2.1 time: 0.427082 Oct 19 01:02:09.488919 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1801/3711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:09 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1502 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:09.495227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8059509-1b6a-406e-b3a3-ce7bc907568f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4bc30d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.575860 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8059509-1b6a-406e-b3a3-ce7bc907568f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1421 microversion: 2.1 time: 0.084692 Oct 19 01:02:09.576536 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1802/3712] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:09 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:09.585348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.587907 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:09.598384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.599100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.599733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.600736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.605857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.606534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.622398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:09.638071 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d5f262f-96c0-44b5-bc1b-100c598bd594 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.475747 Oct 19 01:02:09.639080 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1911/3713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:09 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:09.650994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:09.673516 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ac83d3c-b0e6-4ade-aabe-0ac3a549cfc3 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095623 Oct 19 01:02:09.676130 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1803/3714] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:02:09 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:02:09.681293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82de54c2-2bd2-4afd-b089-d88ecafa6584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4a34310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.696418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.697501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.698158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.776528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82de54c2-2bd2-4afd-b089-d88ecafa6584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 200 len: 1421 microversion: 2.1 time: 0.088970 Oct 19 01:02:09.777630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1804/3715] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:09 2022] GET /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 1421 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:09.788730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Going to try to stop instance {{(pid=131449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:02:09.792699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.792699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:09.820270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.820910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.821483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.822209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:09.822729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:09.825206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:09.905237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:02:09.915135 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae464b22-81b4-46b2-a864-04910aedba9c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481/action" status: 202 len: 0 microversion: 2.1 time: 0.274240 Oct 19 01:02:09.915973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1912/3716] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:02:09 2022] POST /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:02:09.922426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0796b2d1-dc30-4f6b-9e39-926da221ac77 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42e5f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:09.962230 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:09.975148 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:10.082932 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85d3f04e-2e2e-4840-a387-ff1c8610ca0e tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 204 len: 0 microversion: 2.1 time: 0.292057 Oct 19 01:02:10.087454 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1805/3717] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:09 2022] DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:02:10.096863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:10.097993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:10.105934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.106947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.108565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.109821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.110559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.112079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.358251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:10.369570 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-073c5e1e-9b8b-40ad-a29e-f4ac9572b128 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.278606 Oct 19 01:02:10.381144 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1806/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:10 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:10.392939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:10.393778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:10.401161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.401894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.402496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.403535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.404345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.404998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.605526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:10.616349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2225ac97-9a21-4157-847c-341837efc993 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1670 microversion: 2.1 time: 0.233665 Oct 19 01:02:10.628669 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1807/3719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:10 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1670 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:10.670841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:10.672102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:10.687471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.687712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.691568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.693947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:10.694692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:10.695395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:10.772534 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:10.975424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:10.984436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e9ea709-c4ff-46c9-bcf7-c58f34dc1835 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.319265 Oct 19 01:02:10.985593 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1808/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:10 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:11.162870 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0796b2d1-dc30-4f6b-9e39-926da221ac77 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 204 len: 0 microversion: 2.1 time: 1.245347 Oct 19 01:02:11.163481 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1913/3721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:09 2022] DELETE /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 0 bytes in 1247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:02:11.187253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:11.187796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:11.195599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "tag": "f22c6c76-f841-441d-80b8-5b3fc8df1828"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:11.198842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.199861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.201938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.203827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.206096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.207592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.224104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.224603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.225068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.261959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:02:11.271759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] Creating event network-changed:f22c6c76-f841-441d-80b8-5b3fc8df1828 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:11.290615 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a766d90b-44d3-4b6e-8e49-8b838d37a5c4 req-17c036c3-806e-4d8c-a8a2-8a526f3a2bf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101012 Oct 19 01:02:11.291248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1914/3722] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:11.371067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8bf6a648-7f50-4733-ac9a-f449207fc510 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 204 len: 0 microversion: 2.1 time: 0.202931 Oct 19 01:02:11.371982 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1809/3723] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:11 2022] DELETE /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:02:11.397654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:11.399066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:11.412378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.412903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.413352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.414075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.414546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.415013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.552342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1966098559", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:11.635285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:11.659172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:02:11.661946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ef38eae-c00d-4f6a-a8fb-034d73d0351b tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.270332 Oct 19 01:02:11.662554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1915/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:11 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:11.670516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:11.671145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:11.677699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.678384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.678827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.679546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:11.680002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:11.680606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:11.964443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:11.980813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b7bebe7c-df82-48e0-aa41-e7d6e8170213 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1670 microversion: 2.1 time: 0.311680 Oct 19 01:02:11.981781 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1916/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:11 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:12.011623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:12.012328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:12.023901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.025868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.026444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.027994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.029123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.032437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.343785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:12.358178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b2dae70-5218-4f0c-ab90-ca05cce7180f tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.350626 Oct 19 01:02:12.358838 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1917/3726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:12 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:12.462954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:02:12.463919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:02:12.464556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:02:12.465380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:02:12.465800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:02:12.477444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.478194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.479067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.480041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.480751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.481394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.503600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:02:12.510156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:02:12.526388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:02:12.529565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:02:12.599211 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39144817-f94b-4207-8ad2-fd727fb87968 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052742 Oct 19 01:02:12.603837 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1810/3727] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:02:12.618828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-778946e9-69ee-455b-b92d-bdd7aa15264c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:12.619436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-778946e9-69ee-455b-b92d-bdd7aa15264c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:12.685947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:12.686511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:12.698361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.699599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.701059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.701610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:12.702093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:12.702923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:12.767987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-778946e9-69ee-455b-b92d-bdd7aa15264c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:12.776803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-778946e9-69ee-455b-b92d-bdd7aa15264c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1208 microversion: 2.1 time: 0.163394 Oct 19 01:02:12.792783 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1918/3728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:12 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:12.940499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:12.954563 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8ebbe8e-9ac0-4aad-a934-4d81a63221ec tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.272657 Oct 19 01:02:12.968884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1811/3729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:12 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:13.009593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:13.011584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:13.023166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.023974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.024604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.025575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.026194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.037430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.052928 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:13.364203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:13.377486 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-763da4a6-21f0-41db-ae28-4e51d98fcc26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1670 microversion: 2.1 time: 0.368905 Oct 19 01:02:13.381401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1919/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:13 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1670 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:13.388421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:13.389087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:13.409387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.409803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.410596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.414684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.419849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.420539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.686698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:13.697032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f06987c-f7f3-44b0-81cf-9c5907401d8c tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.319082 Oct 19 01:02:13.697940 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1812/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:13 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:13.802784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:13.803726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:13.823365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.831025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.832912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.840519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.841088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.841529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.977995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:13.978627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:13.985944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:13.986757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:13.986921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:13.993605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.003531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.004233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:14.348383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:14.363815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2cfd3af4-88fc-46d2-852d-32dc8a1a9ffe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1212 microversion: 2.1 time: 0.565678 Oct 19 01:02:14.366934 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1920/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:13 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1212 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:14.398293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d418aa-2e73-4d69-a123-af4b9941aaf7", "name": "network-vif-unplugged", "status": "completed", "tag": "f91180b1-af91-411b-bab5-7bf6e464db2a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:14.458263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.463628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.465642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:14.498585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:14.512534 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3efce2bc-2bf9-4e45-b0f0-69b07b5ffabe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.536916 Oct 19 01:02:14.514379 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1813/3733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:13 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:14.525846 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] Creating event network-vif-unplugged:f91180b1-af91-411b-bab5-7bf6e464db2a for instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 on n-h1-master-1 Oct 19 01:02:14.530050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:14.534518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:14.550270 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-380c8703-3bab-4869-8401-518137449e96 req-128587f6-94d0-48c4-973b-f47fe32ffffa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155382 Oct 19 01:02:14.553005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.553544 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1921/3734] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:14.554263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.555014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:14.563202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.564102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.568245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:14.731205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:14.733176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:14.748849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.749053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.788241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:14.792210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:14.792939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:14.794481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:15.215997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:15.228050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f39e08b5-9d80-4593-b856-4d4e07a5b2ea tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1670 microversion: 2.1 time: 0.710771 Oct 19 01:02:15.246050 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1814/3735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:14 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1670 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:15.254285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:15.269729 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bdb00158-1fdd-40a8-be7d-36b4c0fd446b tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.552268 Oct 19 01:02:15.272844 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1922/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:14 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:15.389146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:15.390055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:15.407356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:15.410557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:15.416292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:15.417718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:15.418473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:15.419649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:15.544734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:15.546718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:15.557293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:15.559079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:15.560951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:15.561912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:15.566704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:15.567537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:15.603366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:15.612950 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-367c366e-6743-470f-8491-1f8977e8d160 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1268 microversion: 2.1 time: 0.228074 Oct 19 01:02:15.616892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1815/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:15 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:16.016915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1d418aa-2e73-4d69-a123-af4b9941aaf7", "name": "network-vif-deleted", "tag": "f91180b1-af91-411b-bab5-7bf6e464db2a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:16.032218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.044879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.045527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.107863 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] Creating event network-vif-deleted:f91180b1-af91-411b-bab5-7bf6e464db2a for instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 on n-h1-master-1 Oct 19 01:02:16.126325 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f16473dc-e28a-462e-94d9-9c9b6edf544f req-71d6145a-9316-4b28-abef-489563b48013 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112577 Oct 19 01:02:16.128941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1816/3738] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:02:16.182996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:16.197286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8df2cd0c-73d2-4909-ad02-f94c47f9c1d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.655821 Oct 19 01:02:16.201997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1923/3739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:15 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:16.254594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:16.255422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:16.271541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.274645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.276903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.277759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.278325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.278671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.297173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:16.299137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:16.319901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.320410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.320884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.326911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.327460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.327911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.521917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:16.541989 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41c32ea3-6e5f-40a2-881a-cb76a9f2e742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1604 microversion: 2.1 time: 0.292459 Oct 19 01:02:16.550774 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1817/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:16 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:16.643428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:16.645200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:16.654045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.656921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.658762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.659785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.660506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.661249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.849527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:16.860879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cccc686a-5a6d-490b-99de-cbe4fca94976 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1266 microversion: 2.1 time: 0.221866 Oct 19 01:02:16.864596 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1818/3741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:16 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:16.875713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "name": "network-vif-plugged", "status": "completed", "tag": "6abbec63-612c-4450-b7a2-960ee198a9f6"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:16.878608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:16.888950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:16.889678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:16.890320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:16.893909 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6fed9a08-7f21-4e5b-9d1b-ac36d9bd21ab tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.600374 Oct 19 01:02:16.895073 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1924/3742] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:16 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:16.914715 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] Creating event network-vif-plugged:6abbec63-612c-4450-b7a2-960ee198a9f6 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:16.932383 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a9a8de7a-f257-4de3-995b-69515a3411bb req-3088aa67-e711-4f2e-8d94-6ab50393d8c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066028 Oct 19 01:02:16.937010 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1819/3743] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:16.980125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c66c11-a25f-4e38-9147-4488c81b7f65", "name": "network-vif-deleted", "tag": "31bdd485-52d8-47a9-9b0a-51bb32242328"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:17.008766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.010737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.011355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.043471 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] Creating event network-vif-deleted:31bdd485-52d8-47a9-9b0a-51bb32242328 for instance 58c66c11-a25f-4e38-9147-4488c81b7f65 on n-h1-master-1 Oct 19 01:02:17.054469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2cb6c9a3-112c-46be-aa6f-5d642adec90c req-6caad82d-ca8b-42bd-8d12-e863b3a9d89b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082799 Oct 19 01:02:17.058320 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1925/3744] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:17.230848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:17.231847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:17.243643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.244372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.245098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.246100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.246699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.247278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.562602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:17.575057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-708a5dca-972c-453b-b750-491474014628 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.350284 Oct 19 01:02:17.576322 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1820/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:17 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:17.576874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:17.580401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:17.587997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.588712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.591551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.596520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.597330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.603973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.668361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.669383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.669959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.670503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lazy-loading 'fault' on Instance uuid 58c66c11-a25f-4e38-9147-4488c81b7f65 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:02:17.753721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:17.763632 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7889586c-5513-463d-b7e4-b29e772354c7 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 200 len: 1326 microversion: 2.1 time: 0.193003 Oct 19 01:02:17.766993 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1926/3746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:17 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 1326 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:17.890031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:17.890880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:17.905182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.905891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.906346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.907075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.907536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.908526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.922523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:17.923152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:17.931489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.932059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.932442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:17.933196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:17.933663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:17.934130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:18.108143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:18.120044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77738a16-21e6-454e-a42a-fcfc9ae3e499 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1266 microversion: 2.1 time: 0.234594 Oct 19 01:02:18.121027 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1821/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:17 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:18.267174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:18.276324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6250602-7040-440c-b984-ae11a892e696 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.357771 Oct 19 01:02:18.276833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1927/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:17 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:18.599868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:18.600475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:18.617699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:18.618192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:18.618805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:18.621389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:18.622060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:18.622655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:18.634616 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:18.792387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:18.793480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:18.810529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:18.814550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:18.815259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:18.816202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:18.817277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:18.817887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:18.885529 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 HTTP/1.1 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '58c66c11-a25f-4e38-9147-4488c81b7f65'} Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:18.904457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:18.910030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:18.913189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1a977cdb-a6fb-497e-9b5f-a721968dba49 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 404 len: 111 microversion: 2.1 time: 0.124357 Oct 19 01:02:18.914017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1928/3749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:18 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:02:18.934868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a130cd2-fd5e-4b72-9748-e9a9066d98b8 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '.version_select at 0x7f2af42921f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:18.988685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1a130cd2-fd5e-4b72-9748-e9a9066d98b8 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822258600" status: 202 len: 0 microversion: 2.1 time: 0.062579 Oct 19 01:02:18.989388 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1929/3750] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822258600 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:02:19.077838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:19.116756 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0d0d8c1-1862-46ca-aa9f-5df1822320a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.512230 Oct 19 01:02:19.127631 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1822/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:18 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:19.144604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:19.145248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:19.154087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:19.154547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:19.157144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:19.159934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:19.162880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:19.163522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:19.304170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:19.305152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:19.313367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:19.314847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:19.315742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:19.316915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:19.317591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:19.319018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:19.563705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:19.573861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6648040-f2a0-44dc-9414-e9f0e3e61022 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.433950 Oct 19 01:02:19.585415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1930/3752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:19 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:19.648384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:19.668238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1989d585-f6cc-4dc6-96de-054fab0065b9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.363878 Oct 19 01:02:19.669808 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1823/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:19 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:19.758900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "name": "network-vif-plugged", "status": "completed", "tag": "f22c6c76-f841-441d-80b8-5b3fc8df1828"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:19.781767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:19.782259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:19.782715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:19.805384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] Creating event network-vif-plugged:f22c6c76-f841-441d-80b8-5b3fc8df1828 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:19.822516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a0bc7b8a-7617-4b73-8aec-b169dec8bb1f req-46e16c7b-19b4-428a-8ab7-f4f82173c989 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067741 Oct 19 01:02:19.823971 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1931/3754] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:20.155612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:20.156688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:20.174937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.175679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.176301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.177050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.177504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.177934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.477891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:20.491318 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e32a3795-e48c-48b5-b6d6-879c6b739f74 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.339743 Oct 19 01:02:20.492168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1824/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:20 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:20.613659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:20.615154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:20.636571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.637318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.644168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.662894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.663991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.665156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.697953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:20.699407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:20.710995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.716855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.717540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.718959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.719752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.720545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:20.918763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:20.929361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b88bdecb-ca2a-48f3-8a79-306691e851c8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.322493 Oct 19 01:02:20.929990 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1932/3756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:20 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:20.934775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a584ee5c-6aa5-4946-b367-3914667196c5", "tag": "6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:20.969440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:20.969934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:20.970527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:21.002265 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] Creating event network-changed:6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c for instance a584ee5c-6aa5-4946-b367-3914667196c5 on n-h1-master-1 Oct 19 01:02:21.024588 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d255b89c-8364-4326-96ae-ca37a7426be4 req-c81f9990-fe9a-4619-8c07-07623c8289a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093138 Oct 19 01:02:21.028345 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1933/3757] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:21.040823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:21.041192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af453f59-0b2d-42a3-b9b3-9d48b8046a68 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: .version_select at 0x7f2af4871310>, body: {"keypair": {"name": "tempest-keypair-526048289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ9udx26FSm6yfZ3WrUh77r9feFNXzzq5XprmrC7iXWJOGH2Q+zh9z2Kb1p/e50wi9o7ilxDSzMIoVixLJ3eeEzupDqK+hYhRhgZfOL5Ilo27fGJZGP3LLjQZKjMNAMIA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:21.051343 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd8ad7cc-a112-421e-8fc9-83a38c8c379d tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1334 microversion: 2.1 time: 0.362216 Oct 19 01:02:21.054713 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1825/3758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:20 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1334 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:21.084754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-af453f59-0b2d-42a3-b9b3-9d48b8046a68 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for project daa2d47392564feabc36c67f7382cddf. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:02:21.091690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-af453f59-0b2d-42a3-b9b3-9d48b8046a68 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for user 098f448796ff4635ac6b4b7262bf6ff1 and project daa2d47392564feabc36c67f7382cddf. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:02:21.147600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af453f59-0b2d-42a3-b9b3-9d48b8046a68 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117303 Oct 19 01:02:21.148240 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1934/3759] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:02:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:21.518944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:21.519702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:21.530281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:21.531986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:21.534291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:21.535724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:21.538754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:21.540187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:21.881026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:21.902205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d06b7664-4c4c-436a-9d28-2f064e4aa116 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.379174 Oct 19 01:02:21.931409 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1826/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:21 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:21.956351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:21.957981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:21.972516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:21.975051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:21.976870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:21.977996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:21.978745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:21.979736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.076186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:22.076761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:22.083214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.084599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.085329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.086277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.086946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.087581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.275195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:22.299377 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1891dc47-14df-46ff-9941-ba1c18d92d4f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.347913 Oct 19 01:02:22.300520 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1935/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:21 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:22.369007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:22.379299 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cc01f786-15a0-4ff7-a88c-dbd49f4ffbee tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1667 microversion: 2.1 time: 0.307216 Oct 19 01:02:22.382762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1827/3762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:22 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1667 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:22.426912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:22.428164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:22.436275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.437087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.439288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.440241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.440936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.441594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.475732 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62e9d5b5-8b20-46f2-a0d4-bf8aecda5bb7 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794/ips" status: 200 len: 177 microversion: 2.1 time: 0.064316 Oct 19 01:02:22.477037 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1936/3763] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:02:22 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794/ips => generated 177 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:22.491631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:22.492516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:22.500809 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:22.504444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.505269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.505924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.506856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.507566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.509470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.542001 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:22.548080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:02:22.711774 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ad73cb3-56c3-4476-8c7b-d362c222af20 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 204 len: 0 microversion: 2.1 time: 0.221482 Oct 19 01:02:22.725051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:22.725685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:22.730551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1828/3764] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:22 2022] DELETE /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:02:22.735572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.737527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.738207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.739564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.740601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.741332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.932062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:22.936131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:22.951331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.953933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.958675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:22.959464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:22.959949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:22.960392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:23.039907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:23.056669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6cd088f-ddd9-42d7-925a-7427f13012c9 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1673 microversion: 2.1 time: 0.336917 Oct 19 01:02:23.059619 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1937/3765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:22 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1673 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:23.315118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:23.322325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:23.322962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:23.326417 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-23d01564-afc2-45ac-b6d3-12156bdcc669 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.398749 Oct 19 01:02:23.332126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:23.332655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:23.335714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:23.336461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:23.336968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:23.337412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:23.343720 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1829/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:22 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:23.730159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:23.754558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f5bbee1-8a57-4793-99e6-7b6467ac0d08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.427210 Oct 19 01:02:23.755440 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1938/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:23 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:24.113920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:24.114887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:24.141375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.142751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.144223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:24.145950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.146938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.147761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:24.332310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1366363199", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acc26b34-be56-4bde-8cdb-e3ebe9327553"}], "security_groups": [{"name": "tempest-securitygroup--1001083538"}], "key_name": "tempest-keypair-526048289", "user_data": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:24.396981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:24.431641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf16c545-e459-4c5d-a87b-4d1d3c03bbdb tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1673 microversion: 2.1 time: 0.348397 Oct 19 01:02:24.434898 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1830/3768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:24 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1673 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:24.486757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:24.488731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:24.509751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.510729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.511535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:24.512648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.519378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.520882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:24.554883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] validate_networks() for [('acc26b34-be56-4bde-8cdb-e3ebe9327553', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:02:24.949600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:24.965151 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91528ff9-2c2b-469b-b359-995df99ed141 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.527889 Oct 19 01:02:24.966434 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1831/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:24 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:24.972525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:24.973456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:24.981179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.984352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.986907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:24.987963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:24.988701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:24.992499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:25.368071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:25.385141 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d24c81ca-889a-4db1-98f6-cdc34fb1a369 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.416794 Oct 19 01:02:25.385902 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1832/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:24 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:25.467138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:25.468227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:25.478573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:25.479438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:25.481052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:25.481899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:25.484275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:25.485012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:25.649417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:02:25.650442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:02:25.651074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:02:25.651631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:02:25.652285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:02:25.675295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:25.676164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:25.677032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:25.679717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:25.681522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:25.685134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:25.759601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for project daa2d47392564feabc36c67f7382cddf. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:02:25.777905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Getting quotas for user 098f448796ff4635ac6b4b7262bf6ff1 and project daa2d47392564feabc36c67f7382cddf. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:02:25.868200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:02:25.877747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:02:25.957015 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:26.061374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e296d8ea-953e-4ab0-8afa-4693e0b266a2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.733325 Oct 19 01:02:26.066303 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1939/3771] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:02:26.089365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "name": "network-vif-deleted", "tag": "f22c6c76-f841-441d-80b8-5b3fc8df1828"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:26.113831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:26.124279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.125172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.128552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.130213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-59b98c4b-519a-4e43-958c-3609e43d4150 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1652 microversion: 2.1 time: 0.666890 Oct 19 01:02:26.132422 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1833/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:25 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1652 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:26.141555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:26.146571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:26.151648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] Creating event network-vif-deleted:f22c6c76-f841-441d-80b8-5b3fc8df1828 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:26.162454 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:26.166489 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3f8778cf-57e5-4143-b485-0a8e5419f6b4 req-9210adc5-6ee3-4de5-8e32-1795e2187508 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097419 Oct 19 01:02:26.167324 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1940/3773] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:26.178019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e51a1a70-ed3a-4de2-b8ff-d6e4c1e81125 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:26.181946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e51a1a70-ed3a-4de2-b8ff-d6e4c1e81125 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:26.207558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.223884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.224364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.233323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.233941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.234413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.347312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e51a1a70-ed3a-4de2-b8ff-d6e4c1e81125 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:26.370246 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e51a1a70-ed3a-4de2-b8ff-d6e4c1e81125 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1237 microversion: 2.1 time: 0.201400 Oct 19 01:02:26.388455 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1941/3774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:26 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1237 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:26.388455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:26.388455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:26.449110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.449802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.452066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.456221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.461216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.462791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.592279 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb554735-18bb-496a-b80b-fc95f7c98a14 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/ips" status: 200 len: 151 microversion: 2.20 time: 0.210843 Oct 19 01:02:26.597030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1942/3775] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Oct 19 01:02:26 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/ips => generated 151 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:02:26.630159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:26.637157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:26.654755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.661412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.665831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:26.666866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:26.667586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:26.672313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.785456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:27.793277 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:27.812350 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d8fdb5c-670f-434a-b161-d1ea333ced98 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 1.212142 Oct 19 01:02:27.818849 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1943/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:26 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:27.828537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:27.835545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:27.856120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:27.856348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:27.862273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:27.863029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.864127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:27.864910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:27.865736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.867198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e0e1d1d-6bee-41b2-b798-6d8791c3e1b2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 1.733472 Oct 19 01:02:27.896707 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1834/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:26 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:27.914362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:27.915093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:27.931235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:27.931758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:27.936037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.937072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:27.937555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:27.938004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.958232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:27.959986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:27.962169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:27.963053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lazy-loading 'fault' on Instance uuid 4461f5ff-c7c2-4ea2-9cc9-34483a260794 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:02:28.071202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ddb45b2dcf14263887a3718e23eb937', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18b6ea2fe5ee4fc8a9b1f143ac95fcef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:28.103234 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c0b07aa-7b96-4466-ab5b-4a7f2f8e0a51 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 200 len: 1303 microversion: 2.1 time: 0.281988 Oct 19 01:02:28.103843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1944/3778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:27 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:28.158447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:28.170455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4589711e-0f81-484d-ad4a-587cfbb55fb1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1233 microversion: 2.1 time: 0.272259 Oct 19 01:02:28.171332 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1835/3779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:27 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1233 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:28.184665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4461f5ff-c7c2-4ea2-9cc9-34483a260794", "name": "network-vif-deleted", "tag": "6abbec63-612c-4450-b7a2-960ee198a9f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:28.221649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:28.222800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:28.228298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:28.294504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] Creating event network-vif-deleted:6abbec63-612c-4450-b7a2-960ee198a9f6 for instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 on n-h2-master-1 Oct 19 01:02:28.304987 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3160879b-9ffa-4835-98c8-f8502d02770c req-7aa892bd-fb27-40f4-b4c3-b16cbecc4643 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124598 Oct 19 01:02:28.321225 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1945/3780] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:28.879247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:28.879867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:28.903925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:28.904650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:28.908551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:28.909084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:28.909525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:28.917168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:28.917660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:28.918109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:28.927290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:28.927796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:28.928230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:28.934891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:28.935390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:28.936924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:29.372444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:29.381978 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cffddbd3-e70b-45e7-8920-139db3e2e49b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 0.508158 Oct 19 01:02:29.398287 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1836/3781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:28 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:29.405961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:29.406811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:29.414486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:29.415276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:29.415990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:29.416900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:29.417518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:29.418523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:29.420157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:29.428374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c84086a3-671d-49e7-b7b8-1bd098c11961 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.531569 Oct 19 01:02:29.429836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1946/3782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:28 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:29.434727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:29.436232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:29.436507 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:29.437966 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 HTTP/1.1 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4461f5ff-c7c2-4ea2-9cc9-34483a260794'} Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:29.440671 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:29.444221 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:29.445322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:29.446334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5853e162-4dc5-4eea-939f-09c9c2efd03e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 404 len: 111 microversion: 2.1 time: 0.046717 Oct 19 01:02:29.447074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1837/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:29 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:29.462773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:29.463302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:29.463757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:29.464494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:29.467592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:29.468061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:29.586848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:29.596081 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68faf88d-20a9-439f-9a08-4d0aa055b981 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1295 microversion: 2.1 time: 0.165014 Oct 19 01:02:29.612901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1947/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:29 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1295 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:30.299052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584ee5c-6aa5-4946-b367-3914667196c5", "name": "network-vif-plugged", "status": "completed", "tag": "6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:30.332556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:30.335405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:30.335910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:30.382000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] Creating event network-vif-plugged:6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c for instance a584ee5c-6aa5-4946-b367-3914667196c5 on n-h1-master-1 Oct 19 01:02:30.399462 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-22f8a15c-8caa-44a2-8c55-20c65e40dad4 req-dfbc7f6e-9537-4221-a555-15a2b7af2888 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104950 Oct 19 01:02:30.406231 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1838/3785] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:02:30.411934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:30.412563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:30.435613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:30.436475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:30.437111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:30.438021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:30.438817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:30.439921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:30.457155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:30.457155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:30.463626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:30.480257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:30.482548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:30.483455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:30.484826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:30.485383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.195662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:31.209483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1c168d3f-f1b0-4b2f-a623-5090786e24b0 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.757734 Oct 19 01:02:31.229221 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1839/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:30 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:31.239332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:31.243593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:31.259456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.261349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.275645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.276600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.277392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.278971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.340578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lazy-loading 'flavor' on Instance uuid 0d3db501-5534-43da-a1da-262169ee3c87 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:02:31.498006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:31.544141 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00ca7e48-78ac-4823-b4e7-eb8dbb1471b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1308 microversion: 2.1 time: 1.133536 Oct 19 01:02:31.545669 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1948/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:30 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1308 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:31.563070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:31.565147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:31.610687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.617318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.618197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.620330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.623048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.623847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.777760 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19221321-95e8-49bd-b943-250e7ed03908 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/action" status: 202 len: 0 microversion: 2.20 time: 0.547028 Oct 19 01:02:31.778728 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1840/3788] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 01:02:31 2022] POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:02:31.800142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:31.801139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:31.825872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.826468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.826935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.831370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:31.831874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:31.834111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:31.916530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:31.945561 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52662ab2-f20d-4a25-b26b-8f508f4a2e26 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.397817 Oct 19 01:02:31.969974 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1949/3789] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:31 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:32.109759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:32.130251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:32.134379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:32.135636 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d516ae2d-c2e0-4d38-8668-094548d16625 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.348721 Oct 19 01:02:32.139432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1841/3790] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:31 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:32.233875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:32.234845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:32.242835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.243585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.244225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.245180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.245833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.246471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.445177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:32.455848 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3595b373-4f62-461c-99a0-70466fa31302 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.225962 Oct 19 01:02:32.456852 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1950/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:32 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:32.593438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:32.593886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:32.602227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.603050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.603733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.604729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.605409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.606126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.810788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:32.823813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb801267-b082-46a3-aaf6-bdc0b52f0c40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1489 microversion: 2.1 time: 0.234061 Oct 19 01:02:32.833335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1842/3792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:32 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1489 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:32.848681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:32.849742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:32.856840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.857681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.858288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.859670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.860561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.861282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.893240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248ef2fa-d5e2-4fb1-92b2-bf483ae86b16", "tag": "004a82f9-5338-45ac-ab2f-e93f21a99e4f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:32.916129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lazy-loading 'flavor' on Instance uuid a584ee5c-6aa5-4946-b367-3914667196c5 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:02:32.918340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.918825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:32.919257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:32.945348 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] Creating event network-changed:004a82f9-5338-45ac-ab2f-e93f21a99e4f for instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 on n-h1-master-1 Oct 19 01:02:32.961329 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5d6079b6-30cd-45fd-bc67-fb81527c5816 req-ae1f54ac-939c-4705-b4bc-1de792925141 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074162 Oct 19 01:02:32.962041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1843/3793] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:02:32.983255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:32.984021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:32.994905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:32.995404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.007457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.008831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.009369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.009866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.148524 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0df6346-3d94-449d-8d3f-98eecec1d508 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5/action" status: 202 len: 0 microversion: 2.1 time: 0.302827 Oct 19 01:02:33.152657 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1951/3794] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:02:32 2022] POST /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:02:33.178040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:33.179082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.205211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.658746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:33.674742 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e2ac7f1-b8cf-4e86-b619-2d1263d33772 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.695807 Oct 19 01:02:33.675578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1844/3795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:32 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:33.692925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:33.693630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:33.713482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.715760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.716426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.718180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.722165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.722839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.784549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:33.796179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-01ba9abc-4c47-49fe-a896-c8acb43b8736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1497 microversion: 2.1 time: 0.639765 Oct 19 01:02:33.805750 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1952/3796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:33 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1497 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:33.817309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:33.831036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:33.849350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.851406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.852234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:33.854768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:33.856482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:33.859608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.227261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:34.234181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:34.244026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:34.248780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:34.251473 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c766b0e-3cbb-4ae9-ab36-7096e3fe25ba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.574765 Oct 19 01:02:34.253173 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1845/3797] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:33 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:34.256551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c409f093-852c-469c-b9c5-dbe2094971b4 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1512 microversion: 2.1 time: 0.443706 Oct 19 01:02:34.262572 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1953/3798] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:33 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:34.693437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:34.693965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:34.708540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:34.709366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:34.716872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.717531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.718114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.718934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.719754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.720958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.731904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.732420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.732929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.733662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.734209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.734555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.766395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 HTTP/1.1 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4461f5ff-c7c2-4ea2-9cc9-34483a260794'} Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:34.768603 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.772880 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.773942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:34.776275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-946983df-cad7-41ce-a4ba-be15b73a565e tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 404 len: 111 microversion: 2.1 time: 0.087406 Oct 19 01:02:34.787918 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1846/3799] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:34 2022] DELETE /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:34.794350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:34.795006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 4461f5ff-c7c2-4ea2-9cc9-34483a260794] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:34.804615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.806457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.806913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.807646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.808116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.808562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.846635 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 HTTP/1.1 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4461f5ff-c7c2-4ea2-9cc9-34483a260794'} Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:34.850157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 4461f5ff-c7c2-4ea2-9cc9-34483a260794 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e5236ab-107f-47cc-9203-8c922b83fe94 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794" status: 404 len: 111 microversion: 2.1 time: 0.062615 Oct 19 01:02:34.854085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1847/3800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:34 2022] GET /compute/v2.1/servers/4461f5ff-c7c2-4ea2-9cc9-34483a260794 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:34.864301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:34.864961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:34.898644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.899115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.899569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.900291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.901357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.901821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.910638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:34.934189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b7d9fbc6-2a87-41b3-be97-89ba4e6d0e17 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.232566 Oct 19 01:02:34.937076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1954/3801] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:34 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:34.965078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:34.966587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:34.983818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.984549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:34.987048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:34.996554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:34.999818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.000420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.045209 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 HTTP/1.1 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '84d562d0-1929-45fe-9e6a-43dd35f22042'} Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:35.054648 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.059039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.065432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:35.066727 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33ae6d1c-37be-4a1a-9b8b-b682bd219168 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "DELETE /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 404 len: 111 microversion: 2.1 time: 0.114325 Oct 19 01:02:35.067871 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1955/3802] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:34 2022] DELETE /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:35.083021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:35.083875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] [instance: 84d562d0-1929-45fe-9e6a-43dd35f22042] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:35.100577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.101463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.102051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.102972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.103578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.104153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.105239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:35.115565 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fcacd4ee-e031-4a21-a613-6f8bc48fe492 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 200 len: 1480 microversion: 2.1 time: 0.262357 Oct 19 01:02:35.119554 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1848/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:34 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 1480 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:35.145093 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] HTTP exception thrown: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.149965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2096361332"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:35.153139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Request method failure captured: Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 HTTP/1.1 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xJdNE-tRQDFwZnWWrdOU-0D5aDmYI8MMdDrKVn4KNcy3VtL2M23pQOJAomCJHmd3bLlha7p4Z3xFksV-hwBo82i1OXAmvmblUPgtbKXEwSPBlSmSnrQbbk0vdNhCk6SzqLCAu-7AZa9yXyenjDDAAoGIf2B2Jg8HKCwP83wsTBlS4 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_18b6ea2fe5ee4fc8a9b1f143ac95fcef", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/18b6ea2fe5ee4fc8a9b1f143ac95fcef"}]}] Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 18b6ea2fe5ee4fc8a9b1f143ac95fcef Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersTestMultiNic-845605399 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9ddb45b2dcf14263887a3718e23eb937 Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersTestMultiNic-845605399-project Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '84d562d0-1929-45fe-9e6a-43dd35f22042'} Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:35.154668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] Returning 404 to user: Instance 84d562d0-1929-45fe-9e6a-43dd35f22042 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:35.159058 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e03689f-0782-4378-9ada-a50cfbff88d5 tempest-ServersTestMultiNic-845605399 tempest-ServersTestMultiNic-845605399-project] 10.222.0.27 "GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042" status: 404 len: 111 microversion: 2.1 time: 0.084032 Oct 19 01:02:35.168050 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1956/3804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:35 2022] GET /compute/v2.1/servers/84d562d0-1929-45fe-9e6a-43dd35f22042 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:35.179267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.182424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.182877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.183939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.187507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.188031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.289355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:35.291815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:35.320324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.321162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.321836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.325879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.326587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.330027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.695013 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26d13a4e-d6cd-4cf7-85ac-7934e2c1fd2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5/action" status: 202 len: 0 microversion: 2.1 time: 0.548768 Oct 19 01:02:35.702269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1849/3805] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:02:35 2022] POST /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:02:35.720495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:35.721853 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:35.722525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:35.751108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.752384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.753345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.754841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.755472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.755979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.804475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:35.815555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:35.822137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:35.826594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b30afc6-ccf9-4690-858f-87cacf0da1ee tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.549144 Oct 19 01:02:35.828867 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1957/3806] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:35 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:35.836432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d09d216-d6e0-4860-9363-d2c6bfd8897f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4fcd700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:35.908425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d09d216-d6e0-4860-9363-d2c6bfd8897f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.075638 Oct 19 01:02:35.909796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1958/3807] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:35 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:35.970039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:35.971079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:35.989361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.990409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.991019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:35.991906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:35.993173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:35.996198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.367595 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:36.384273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:36.393286 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25372c1a-585c-4b5b-8830-c92dfa6bce0e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1489 microversion: 2.1 time: 0.688020 Oct 19 01:02:36.397256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1850/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:35 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1489 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:36.404545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:36.424066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:36.430404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:36.440137 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9f46129-180d-49e8-bbc7-7923b2e14040 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.482489 Oct 19 01:02:36.442957 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1959/3809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:35 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:36.464486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.465090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.467706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.468648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.469273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.470601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.529497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:02:36.678756 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7024256-1848-402e-80f9-4cef45e07694 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 204 len: 0 microversion: 2.1 time: 0.260669 Oct 19 01:02:36.684457 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1851/3810] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:02:36 2022] DELETE /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:02:36.691276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:36.692041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:36.702599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.703266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.703954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.704956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.705635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.706068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.860371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:36.861183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:36.873523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.874213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.874667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.875377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:36.876346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:36.876826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:36.929597 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:37.131538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:37.143955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-53773d02-b248-4494-8622-07a0ec1bce99 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1495 microversion: 2.1 time: 0.456832 Oct 19 01:02:37.161090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1960/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:36 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1495 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:37.166344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-daf7a2dc-c9e0-4277-ad99-d9bf68a6a61c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af54e2430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:37.227412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:37.233597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-daf7a2dc-c9e0-4277-ad99-d9bf68a6a61c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.071037 Oct 19 01:02:37.234190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1961/3812] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:37 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:37.242439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:37.246805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:37.249375 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-897a75a2-d960-4bc6-92c0-a8aa80ad44a0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.393445 Oct 19 01:02:37.249964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1852/3813] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:36 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:02:37.473347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:37.474036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:37.483575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:37.484086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:37.484566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:37.485854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:37.486414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:37.486914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:37.583451 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:37.867370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:37.878528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b00a37f8-80d9-47ad-98ac-bc820a2f0109 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.413100 Oct 19 01:02:37.902612 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1962/3814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:37 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:38.168030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:38.168787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:38.179652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.182631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.184141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.187739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.188527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.191757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.250344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6bd8515-d0cd-4b76-9a70-b1021670b388 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4fcd310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:38.337019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6bd8515-d0cd-4b76-9a70-b1021670b388 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.090405 Oct 19 01:02:38.338069 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1963/3815] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:38 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:38.352536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:38.353562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:38.368310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.369608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.371718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.372613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.373945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.376709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.862159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:38.879080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-edba6f9f-589f-49db-9ccd-0f40bd8f8836 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1495 microversion: 2.1 time: 0.715591 Oct 19 01:02:38.893127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1853/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:38 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1495 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:38.916661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:38.916938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:38.941365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.941881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.942334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.945348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:38.946581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:38.949430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:38.949915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:38.961891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:38.963575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:38.969584 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17c080c2-11bb-4ed4-87ef-2a05b14ffba7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.629926 Oct 19 01:02:38.970680 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1964/3817] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:38 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:39.356036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-786357c5-65ee-4f54-8081-07833c998117 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4261280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:39.458609 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-786357c5-65ee-4f54-8081-07833c998117 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.106479 Oct 19 01:02:39.459195 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1965/3818] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:39 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:39.479219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1e0ca8-54fb-4d11-84d8-3bcaba81e481", "name": "network-vif-deleted", "tag": "72c2ec40-6a42-494d-bbcf-c6e04e799b0b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:39.518950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:39.519448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:39.519890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:39.559207 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] Creating event network-vif-deleted:72c2ec40-6a42-494d-bbcf-c6e04e799b0b for instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 on n-h2-master-1 Oct 19 01:02:39.582690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-570f8af9-6a57-4e8c-8a79-824a175e0be5 req-de8f26d4-77a1-4d11-804e-8b158a2b6ba4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121766 Oct 19 01:02:39.590651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1966/3819] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:39.905202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:39.906225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:39.918290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:39.921464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:39.924526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:39.926619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:39.935527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:39.946287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:40.080858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:40.081787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:40.082409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:40.083871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'fault' on Instance uuid df1e0ca8-54fb-4d11-84d8-3bcaba81e481 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:02:40.317497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:40.327463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f4327b9-ea68-4de6-b4e6-20fb38bb647e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 200 len: 1305 microversion: 2.1 time: 0.427797 Oct 19 01:02:40.352246 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1967/3820] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:39 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 1305 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:40.384172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:40.385582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:40.407693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:40.408414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:40.418788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:40.420117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:40.424734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:40.429586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:40.432201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:40.450884 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-877c707a-1930-4124-9ddd-72a0ccb1d2c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 1.544839 Oct 19 01:02:40.473152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1854/3821] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:38 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:40.497192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e3bec6b-42ec-4078-ad7d-4be0abff365f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4341700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:40.924102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:40.941672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:40.946748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:40.949428 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df6a9cab-3e54-49ff-baaa-c7c3f91ea36d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.595977 Oct 19 01:02:40.964882 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1968/3822] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:40 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:41.242037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e3bec6b-42ec-4078-ad7d-4be0abff365f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.767002 Oct 19 01:02:41.242745 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1855/3823] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:40 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:41.365954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:41.366632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:41.378456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:41.386913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:41.387493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:41.388156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:41.388661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:41.400166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:41.462989 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 HTTP/1.1 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: exception: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'df1e0ca8-54fb-4d11-84d8-3bcaba81e481'} Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:02:41.470808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:02:41.475456 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:02:41.478306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:02:41.485560 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd138f80-c8cf-4fa2-a634-2842be095375 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 404 len: 111 microversion: 2.1 time: 0.120945 Oct 19 01:02:41.489366 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1969/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:41 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:02:41.508189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:41.509474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:41.537964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:41.542293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:41.542829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:41.543615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:41.544107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:41.544556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:41.623687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248ef2fa-d5e2-4fb1-92b2-bf483ae86b16", "name": "network-vif-plugged", "status": "completed", "tag": "004a82f9-5338-45ac-ab2f-e93f21a99e4f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:41.649953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:41.650450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:41.653089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:41.702404 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] Creating event network-vif-plugged:004a82f9-5338-45ac-ab2f-e93f21a99e4f for instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 on n-h1-master-1 Oct 19 01:02:41.758642 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f34ee711-d22d-4d8c-92d7-871cbe0baa78 req-94a4587e-1862-4fd9-9aff-a129f3f89a67 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136282 Oct 19 01:02:41.761493 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1970/3825] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:41.854835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-457588585", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "173c1eae-6eba-4e34-8bd7-0767ede65543"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:42.097321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:42.114718 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67124d0b-c8b1-439b-b564-241a22712aa5 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.611190 Oct 19 01:02:42.123048 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1856/3826] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:41 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:42.130955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:42.143549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:42.160652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:42.175269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:42.176594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:42.179293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:42.182339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:42.185328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:42.221127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] validate_networks() for [('173c1eae-6eba-4e34-8bd7-0767ede65543', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:02:43.620515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:02:43.622214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:02:43.622918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:02:43.623626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:02:43.624311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:02:43.647642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:43.649759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:43.650513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:43.651173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:43.652193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:43.653298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:43.653955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:43.658080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:43.675359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:43.681032 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-72e03c7c-2981-4317-b91e-0814f8b87017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 1.552567 Oct 19 01:02:43.683149 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1857/3827] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:42 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:43.687193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:02:43.693900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Getting quotas for user 2190bd30671b47048aed416f9c14a545 and project 4a4820802e0a4a2b9de754ee1268c060. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:02:43.699926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb42fade-1d3f-4f3b-b1ac-1fe33f5a1833 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af431c550>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:43.757400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:02:43.760116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:02:43.800323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb42fade-1d3f-4f3b-b1ac-1fe33f5a1833 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.105851 Oct 19 01:02:43.801154 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1858/3828] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:43 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:43.829634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:43.830632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:43.850532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:43.851198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:43.852001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:43.852803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:43.854504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:43.854504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:43.909879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84087b53-114c-4fe0-b41d-a547a6ecda73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055014 Oct 19 01:02:43.911786 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1971/3829] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:02:43.939791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f2829ae-1d75-4cc0-be76-7870d50b0263 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:43.940758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f2829ae-1d75-4cc0-be76-7870d50b0263 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:44.480791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f2829ae-1d75-4cc0-be76-7870d50b0263 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:44.509392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f2829ae-1d75-4cc0-be76-7870d50b0263 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1214 microversion: 2.1 time: 0.589881 Oct 19 01:02:44.515739 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1972/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:43 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1214 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:44.647292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:44.660499 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbf12af6-f8c4-4079-9e84-e4e8ee6a21c1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1363 microversion: 2.1 time: 0.842242 Oct 19 01:02:44.677184 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1859/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:43 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1363 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:44.714703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:44.716409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:44.731238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:44.731895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:44.733975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:44.735518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:44.738319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:44.740394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:44.817272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-034e4150-8794-499f-bb87-87371db4f884 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af431c940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:44.940547 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-034e4150-8794-499f-bb87-87371db4f884 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.128736 Oct 19 01:02:44.941254 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1860/3832] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:44 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:45.539973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:45.540878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:45.556536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:45.576395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:45.577427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:45.581260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:45.583760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:45.585753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:45.646260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:45.655554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:45.657125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:45.658361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25eb9248-ff65-4c91-9b48-2b67c3430e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.949850 Oct 19 01:02:45.658939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1973/3833] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:44 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:45.699056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:45.699964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:45.733761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:45.735042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:45.741717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:45.743050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:45.744337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:45.745440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:45.991917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:46.010481 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d111a2f-f3d2-4cdb-9d7c-4958b3e95e73 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1210 microversion: 2.1 time: 0.472035 Oct 19 01:02:46.012767 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1861/3834] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:45 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1210 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:46.037441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584ee5c-6aa5-4946-b367-3914667196c5", "name": "network-vif-plugged", "status": "completed", "tag": "6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:46.078108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:46.084987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:46.086090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:46.113864 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] Creating event network-vif-plugged:6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c for instance a584ee5c-6aa5-4946-b367-3914667196c5 on n-h1-master-1 Oct 19 01:02:46.130613 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cecc305c-b36c-46ef-b535-bf2b7d62e57f req-6db331c2-1014-49a4-83ee-d02377f5f3c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116027 Oct 19 01:02:46.131901 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1862/3835] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:46.139006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8c2167a-993a-483c-a6f1-a022f7b61cfe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af431cd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:46.231445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8c2167a-993a-483c-a6f1-a022f7b61cfe tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.093427 Oct 19 01:02:46.234748 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1863/3836] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:46 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:46.302067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:46.324383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7681e5cd-3cc6-4355-9eb7-78d320ddb6c6 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1548 microversion: 2.1 time: 0.630606 Oct 19 01:02:46.338176 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1974/3837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:45 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1548 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:46.356188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:46.357239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:46.373230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:46.374293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:46.375001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:46.376152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:46.378196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:46.378963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:46.568846 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e37a9f0-977d-4715-80e1-a75a17f8d384 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217173 Oct 19 01:02:46.569608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1864/3838] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:02:46 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:46.684723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:46.686214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:46.694550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:46.695221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:46.696006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:46.697233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:46.697855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:46.698697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:47.056557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:47.064593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:47.065444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:47.078226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:47.084409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:47.089074 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5a8dba55-a077-433e-bf3d-5c20d584b297 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.408584 Oct 19 01:02:47.090373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1975/3839] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:46 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:47.099958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:47.100862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:47.101521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:47.102470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:47.105284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:47.105974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:47.253593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a29363f9-3255-4892-b6a6-10f1c95d1b57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af5556160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:47.272306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:47.282876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9b9853c-3b46-4e7b-9892-6397a2546296 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1272 microversion: 2.1 time: 0.246461 Oct 19 01:02:47.284114 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1865/3840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:47 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:47.358056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a29363f9-3255-4892-b6a6-10f1c95d1b57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.108925 Oct 19 01:02:47.369334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1976/3841] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:47 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:48.118649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:48.120823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:48.147273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:48.147735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:48.148168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:48.153167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:48.157723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:48.158374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:48.310637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:48.312154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:48.338321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:48.340708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:48.341511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:48.345846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:48.347034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:48.349110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:48.670534 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:48.678967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5264cc28-aa83-4fa4-84f7-e5538c5c832e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1272 microversion: 2.1 time: 0.372452 Oct 19 01:02:48.679567 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1977/3842] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:48 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1272 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:48.714015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd3d563e-702e-4e78-991b-34d5b62fc67c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4da6310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:48.801856 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd3d563e-702e-4e78-991b-34d5b62fc67c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.111825 Oct 19 01:02:48.802869 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1978/3843] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:48 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:49.020659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:49.032034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:49.036085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:49.041633 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-61c44911-a4e4-4c3d-a1f9-1ba5be122739 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1745 microversion: 2.20 time: 0.927703 Oct 19 01:02:49.051011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1866/3844] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:48 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1745 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:49.707992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:49.708795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:49.732020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:49.732532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:49.754768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:49.755552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:49.756039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:49.756478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:49.817893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73eb86a6-8953-4968-a470-d9fa427326d8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af43b2790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:50.004107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:50.018266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41d52106-1e64-4077-999b-12114c239fa9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1272 microversion: 2.1 time: 0.315336 Oct 19 01:02:50.047170 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1979/3845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:49 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:50.099924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:50.100828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:50.112407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:50.115420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:50.115909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:50.116710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:50.117204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:50.126328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73eb86a6-8953-4968-a470-d9fa427326d8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.311877 Oct 19 01:02:50.127151 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1867/3846] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:49 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:50.133075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:50.977152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:50.993202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:50.998983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:51.001157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-104412bd-ccaf-475b-a330-1009ca45ac9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1745 microversion: 2.20 time: 0.907488 Oct 19 01:02:51.023400 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1980/3847] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:50 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1745 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:51.040985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:51.048792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:51.066821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:51.069190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:51.069804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:51.070719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:51.075611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:51.076250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:51.142562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-693169a2-e303-40a0-9049-403be2b5b254 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af584d3a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:51.344114 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-693169a2-e303-40a0-9049-403be2b5b254 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1438 microversion: 2.1 time: 0.206004 Oct 19 01:02:51.351460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1981/3848] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:51 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1438 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:52.014529 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "248ef2fa-d5e2-4fb1-92b2-bf483ae86b16", "tag": "004a82f9-5338-45ac-ab2f-e93f21a99e4f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:02:52.046006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:52.049304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:52.052011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:52.087522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] Creating event network-changed:004a82f9-5338-45ac-ab2f-e93f21a99e4f for instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 on n-h1-master-1 Oct 19 01:02:52.105501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-de9aecaa-46e6-4b01-aac1-4dca7ec0b306 req-c214889d-8420-4fa9-9f7e-09fcb15469b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096564 Oct 19 01:02:52.111756 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1982/3849] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:02:52.124164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:52.126584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:52.143949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:52.146157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:52.147156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:52.149888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:52.150836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:52.153227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:52.246969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:52.259084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8326d311-43ba-43cd-b6d4-e19d36cefa66 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1314 microversion: 2.1 time: 1.221869 Oct 19 01:02:52.259750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1868/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:51 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1314 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:02:52.360406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396d4a9c-ec06-474a-bd96-17f03830c443 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af433a9d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:52.873854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:52.891309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:52.902482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:52.904048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dee2b460-7ab7-451d-8e13-ae3306052e44 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1740 microversion: 2.20 time: 0.788375 Oct 19 01:02:52.905244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1983/3851] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:52 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1740 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:53.285259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:53.286050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:53.315755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:53.316451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:53.318646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:53.323990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:53.339514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:53.339514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:53.667690 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:53.802197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:53.814885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f11c436-9430-4101-bcfe-666eb9d2ffdd tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1314 microversion: 2.1 time: 0.534641 Oct 19 01:02:53.832702 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1984/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:02:53 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:02:53.935347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:02:53.936089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:02:53.959037 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:53.966278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:53.978306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:53.992006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:53.996362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:02:53.998510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:02:53.999074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:02:54.494403 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:02:54.508192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:54.518756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:54.542591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:02:54.543840 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e426478-6a8c-4278-ae96-a325adf55c5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1740 microversion: 2.20 time: 0.613005 Oct 19 01:02:54.571075 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1985/3853] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:02:53 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1740 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:02:55.535261 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1649677332", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "b79432aa-bba4-49de-826b-f9fbed6fc2de"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:01.066716 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:02.251482 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=65 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:04.517235 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=87 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:05.153532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-396d4a9c-ec06-474a-bd96-17f03830c443 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1447 microversion: 2.1 time: 12.796833 Oct 19 01:03:05.158134 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1869/3854] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:02:52 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1447 bytes in 12802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:05.167211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] validate_networks() for [('b79432aa-bba4-49de-826b-f9fbed6fc2de', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:03:05.171242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:05.172473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:05.193817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:05.195201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:05.195931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:05.196922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:05.197636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:05.200306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:05.557270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:05.577060 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc6e6529-dd4a-4d8b-b943-df3194ea38f7 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1314 microversion: 2.1 time: 0.414320 Oct 19 01:03:05.578017 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1870/3855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:05 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:05.583558 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:05.590960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1083e659-a8ab-4b91-ac9f-ca90bc7ffec9", "tag": "c8a751d2-2d17-453c-aa4d-6c26080f6118"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:05.650349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:05.650924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:05.651384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:05.678116 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] Creating event network-changed:c8a751d2-2d17-453c-aa4d-6c26080f6118 for instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 on n-h2-master-1 Oct 19 01:03:05.684535 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-19e191d2-b032-42f5-baaf-803a96da9cea req-7d2b281f-25e1-4c91-8b21-612fe90b77da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102422 Oct 19 01:03:05.685561 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1871/3856] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:05.692991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:05.694246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:05.706837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:05.707654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:05.708813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:05.709788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:05.710560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:05.711301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:05.988807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:06.006910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:06.008441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:06.012194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7ee29d93-9b30-4352-a445-22364a599da3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1740 microversion: 2.20 time: 0.325292 Oct 19 01:03:06.014684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1872/3857] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:05 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:06.024168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-plugged", "status": "completed", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:06.038966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.056048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.058439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.071129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:03:06.071875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:03:06.072511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:03:06.073137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:03:06.073993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:03:06.119175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] Creating event network-vif-plugged:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h1-master-1 Oct 19 01:03:06.124795 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-82031b2f-cca4-4f13-8fbd-9c976de7c676 req-cb5467f2-1cf8-42ef-894e-671f74dff82e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108067 Oct 19 01:03:06.131016 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1873/3858] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:06.144763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.145478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.145924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.146772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.148995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.151657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.172118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:03:06.178618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for user f6f439f0db774d4c9691083e208cbaaa and project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:03:06.195270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:03:06.198636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:03:06.275003 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20e42262-fb83-4e0a-97a0-c114ecce3d0c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.575098 Oct 19 01:03:06.277879 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1986/3859] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:02:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 11578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:03:06.290939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf665fd4-4b2d-43f4-bd24-4a4bab0e91ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4871280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:06.359586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Calling method '.version_select at 0x7f2af4629430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:06.361530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.362220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.362933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.375692 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf665fd4-4b2d-43f4-bd24-4a4bab0e91ce tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 200 len: 1447 microversion: 2.1 time: 0.091985 Oct 19 01:03:06.376997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1987/3860] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:06 2022] GET /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 1447 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:06.392801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6dfb7c06-7e08-44ce-9251-04ceb7e70c48 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af581ee50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:06.400065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.400896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.401793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.451744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:06.452248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:06.452727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:06.473344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e73da219-99b8-4713-a7c5-6cef5d6641c0 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2090078962-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.340612 Oct 19 01:03:06.473950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1874/3861] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:03:06 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:06.498181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-281117179", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "b79432aa-bba4-49de-826b-f9fbed6fc2de"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:07.834649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6dfb7c06-7e08-44ce-9251-04ceb7e70c48 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 204 len: 0 microversion: 2.1 time: 1.447213 Oct 19 01:03:07.835546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1988/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:06 2022] DELETE /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 0 bytes in 1449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:03:07.840562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:07.841196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:07.858052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:07.858551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:07.859006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:07.861004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:07.861479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:07.864909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:07.967644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] validate_networks() for [('b79432aa-bba4-49de-826b-f9fbed6fc2de', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:03:08.437280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:08.488880 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-51d816e3-d59d-4cab-abda-82b85e0916e9 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1314 microversion: 2.1 time: 0.652134 Oct 19 01:03:08.505283 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1989/3863] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:07 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:08.512119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:08.513045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:08.535655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:08.536366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:08.537007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:08.537874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:08.538495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:08.539077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.112705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:03:09.113634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:03:09.114150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:03:09.114577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:03:09.114998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:03:09.153258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.154146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.154777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.155605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.156971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.157885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.231290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:03:09.240355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for user f6f439f0db774d4c9691083e208cbaaa and project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:03:09.247078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:09.306224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:09.318523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:09.320495 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-002bec8e-263a-422c-85a5-84503eef38e5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1740 microversion: 2.20 time: 0.813762 Oct 19 01:03:09.322220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:03:09.325255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:03:09.334828 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1990/3864] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:08 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1740 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:09.345479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:09.346226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:09.361390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.369889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.370658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.371622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.372252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.372887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.425983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:03:09.430155 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b41870fd-9c10-482b-ba34-72508132a44f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.936202 Oct 19 01:03:09.441921 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1875/3865] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:03:09.453971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1083e659-a8ab-4b91-ac9f-ca90bc7ffec9", "name": "network-vif-plugged", "status": "completed", "tag": "c8a751d2-2d17-453c-aa4d-6c26080f6118"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:09.467946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.469467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.470131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.492838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] Creating event network-vif-plugged:c8a751d2-2d17-453c-aa4d-6c26080f6118 for instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 on n-h2-master-1 Oct 19 01:03:09.501936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b03a2060-75a6-4b97-a3f5-24529f4f6e07 req-fc8f4444-f15f-4a01-b868-c059e8f55bc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058040 Oct 19 01:03:09.510398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1876/3866] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:09.523165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:09.524560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:09.532646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.533336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.533953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.535830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:09.536904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:09.537510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:09.650807 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15c8f05d-1f1f-4e21-8d87-d98734ec88c9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 204 len: 0 microversion: 2.1 time: 0.314627 Oct 19 01:03:09.651631 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1991/3867] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:09 2022] DELETE /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:03:09.686554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-223404579", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "451", "networks": [{"uuid": "b79432aa-bba4-49de-826b-f9fbed6fc2de"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:09.826324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:09.834925 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66feb5f5-dca1-4244-90d1-f39c02cde55d tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1314 microversion: 2.1 time: 0.320452 Oct 19 01:03:09.850419 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1877/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:09 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:09.947448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] validate_networks() for [('b79432aa-bba4-49de-826b-f9fbed6fc2de', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:03:10.090621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-145646449", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:10.230102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:03:12.014638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:03:12.015853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:03:12.016497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:03:12.017107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:03:12.017695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:03:12.039070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.039876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.040559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.045793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.047180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.047854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.107248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:03:12.114268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Getting quotas for user f6f439f0db774d4c9691083e208cbaaa and project a42977a7c9aa4831a041b3f1472b52d0. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:03:12.144791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:03:12.147459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:03:12.243296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:03:12.244314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:03:12.245029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:03:12.245801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:03:12.248226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:03:12.262084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.263063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.263907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.264884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.265808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.266458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.295630 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2049f9a4-358a-45c5-985a-0fbe025a1089 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.640224 Oct 19 01:03:12.302243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1992/3869] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:03:12.307185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:12.308008 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:12.313472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:03:12.315101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.315770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.316372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.317275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.317901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.318492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.326495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:03:12.358279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:03:12.368332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:03:12.465072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d47e93de-a2b3-47b5-996b-1898668045ac tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.373965 Oct 19 01:03:12.467544 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1878/3870] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:03:12.480342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:12.485999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:12.499377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.500172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.505258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.507318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.508538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.509692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:12.904057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:12.918494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:12.923051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:12.926430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ba5e3ce-ecbd-46ee-b544-0c894bcae99e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1740 microversion: 2.20 time: 0.620970 Oct 19 01:03:12.927091 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1993/3871] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:12 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1740 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:12.954409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584ee5c-6aa5-4946-b367-3914667196c5", "name": "network-vif-unplugged", "status": "completed", "tag": "6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:12.985153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:12.985922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:12.986705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.058761 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] Creating event network-vif-unplugged:6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c for instance a584ee5c-6aa5-4946-b367-3914667196c5 on n-h1-master-1 Oct 19 01:03:13.076067 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9529162f-7753-4225-911b-685d759c994f req-345e9a27-64b8-49b2-83dc-87b62b9bc32b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145706 Oct 19 01:03:13.101787 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1994/3872] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:13.121872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5fd08c03-bc60-42f8-b5b3-9420e0a90d2a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:13.126070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5fd08c03-bc60-42f8-b5b3-9420e0a90d2a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:13.386843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fd08c03-bc60-42f8-b5b3-9420e0a90d2a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:13.390500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:13.399097 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5fd08c03-bc60-42f8-b5b3-9420e0a90d2a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1220 microversion: 2.1 time: 0.295981 Oct 19 01:03:13.401945 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24020098-934e-428f-bb3a-1597201b6f96 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1502 microversion: 2.1 time: 0.932017 Oct 19 01:03:13.403656 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1879/3873] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:12 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1502 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:13.424559 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1995/3874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:13 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1220 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:13.430898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:13.433239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:13.434141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:13.441282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:13.464603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.469227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.471119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.473630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.475750 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.476766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.481464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.482167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.486935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.488002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.489133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.490228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.573108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lazy-loading 'flavor' on Instance uuid 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:03:13.710718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:13.731823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f704c18-ef4d-452c-be68-3c98f504c49f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1211 microversion: 2.1 time: 0.316927 Oct 19 01:03:13.733045 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1880/3875] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:13 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1211 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:13.758036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1e3cafa-0756-4623-82dc-17c49b835dc6 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "POST /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9/action" status: 202 len: 0 microversion: 2.1 time: 0.330967 Oct 19 01:03:13.759266 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1996/3876] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:03:13 2022] POST /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:03:13.768130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:13.768813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:13.777900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.778411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.778865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.783209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.783724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.784221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.958102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:13.959796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:13.969594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.973584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.989533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:13.993667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:13.994389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:13.995160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.482622 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:14.493018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:14.495556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:14.496977 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e62947ac-3c31-4d42-abe6-3ceb74db6fb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1722 microversion: 2.20 time: 0.547012 Oct 19 01:03:14.510873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1997/3877] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:13 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1722 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:14.523802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a584ee5c-6aa5-4946-b367-3914667196c5", "name": "network-vif-deleted", "tag": "6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:14.547285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:14.554881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:14.555565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:14.556156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.563459 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d1130f26-35b7-4572-a811-7bd3fa31fe37 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1510 microversion: 2.1 time: 0.800008 Oct 19 01:03:14.570193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] Creating event network-vif-deleted:6ade1ddf-b1d7-4b4a-81ea-7e2f52e01a0c for instance a584ee5c-6aa5-4946-b367-3914667196c5 on n-h1-master-1 Oct 19 01:03:14.572961 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1881/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:13 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1510 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:14.579360 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-44275b0f-af47-4b75-8870-bea6f21e8317 req-1756c911-07de-43dd-804d-c3389bb67a8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067008 Oct 19 01:03:14.580133 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1998/3879] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:14.601741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:14.602315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:14.624553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:14.629296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:14.630047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.631000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:14.633074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:14.633742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.757311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:14.759023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:14.775520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:14.776238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:14.776859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.778747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:14.779400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:14.780262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:14.904805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:14.983663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6745931b-ac8f-4e46-ab0e-4ae5fda76964 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1216 microversion: 2.1 time: 0.408105 Oct 19 01:03:15.005544 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1882/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:14 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1216 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:15.066119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:15.081533 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6da38dd4-db23-415f-8661-b8be5dbe5de5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1267 microversion: 2.1 time: 0.328232 Oct 19 01:03:15.086876 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 1999/3881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:14 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:15.527780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:15.535093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:15.547535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:15.550719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:15.570102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:15.570815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:15.571308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:15.571761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:15.592398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:15.593058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:15.600035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:15.601210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:15.601901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:15.602902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:15.603576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:15.604240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:15.918421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:15.948552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:15.963402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:15.965207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:15.966675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9ad812f-72d2-432e-bbfe-97f5f2dcc99f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1722 microversion: 2.20 time: 0.442825 Oct 19 01:03:15.967251 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1883/3882] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:15 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:15.969637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4459104f-46de-456d-afb1-c39a71314300 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1493 microversion: 2.1 time: 0.381796 Oct 19 01:03:15.985292 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2000/3883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:15 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1493 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:15.997412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:15.998034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:16.005050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.006301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.008088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.009036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.009659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.010310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.011015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:16.011659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:16.025060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.025624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.027162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.032536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.033061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.033497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.069564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:03:16.151429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:16.164673 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8713f953-6264-4a20-9b1d-784b43f589a9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1272 microversion: 2.1 time: 0.156799 Oct 19 01:03:16.182649 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2001/3884] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:16 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:16.189313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:16.190210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:16.196852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.197591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.198502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.199418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.200079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.200792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.208792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38c18952-0089-48fc-b9b9-79bb1b4712a8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 204 len: 0 microversion: 2.1 time: 0.217265 Oct 19 01:03:16.227392 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1884/3885] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:15 2022] DELETE /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:03:16.270240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:16.270972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:16.294809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.297062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.299717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.300554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.301092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.301339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:16.301763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.310469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc19698f-9911-4871-9b97-916b84c688ee tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1265 microversion: 2.1 time: 0.126507 Oct 19 01:03:16.311065 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2002/3886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:16 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:16.501879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:16.512887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-610207f4-79e6-4fc1-ae84-539999ecf8d5 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1499 microversion: 2.1 time: 0.261497 Oct 19 01:03:16.516675 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1885/3887] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:16 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:16.776369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-unplugged", "status": "completed", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:16.792970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.805402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.806126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:16.836983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] Creating event network-vif-unplugged:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h1-master-1 Oct 19 01:03:16.842983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7988d8d1-b117-423e-a466-d500e0eb945d req-57e8de81-004d-40d5-a1de-60861c0da70e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070230 Oct 19 01:03:16.844521 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2003/3888] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:16.950662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0468d6-0728-4c64-8a8a-9b5bca391918", "tag": "5d77ffd4-a4b7-44b6-a127-c13798b8a83e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:16.979724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:16.980248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:16.984873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.001542 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] Creating event network-changed:5d77ffd4-a4b7-44b6-a127-c13798b8a83e for instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 on n-h1-master-1 Oct 19 01:03:17.002682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:17.004606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:17.007463 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-be652a44-3194-4bed-a63b-a231da418962 req-c26478ef-66f0-47e5-a602-85ded70cafde service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066529 Oct 19 01:03:17.008512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1886/3889] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:17.030095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.031118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.031753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.032465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.041387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.042136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.197474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:17.198531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:17.212553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.213092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.214441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.217811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.220352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.221141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.393395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:17.404218 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d5e3b22-21b0-4acc-94e9-8bbbb6eb1c02 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1272 microversion: 2.1 time: 0.212291 Oct 19 01:03:17.405274 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1887/3890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:17 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:17.411843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:17.412469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:17.423084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.438777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.439002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.439834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.440368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.440871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.473130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:17.484307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:17.486035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:17.487285 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09c11765-9362-43f8-a59d-a1bdc2d0a644 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1722 microversion: 2.20 time: 0.493183 Oct 19 01:03:17.487869 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2004/3891] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:16 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:17.537469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:17.538649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:17.560674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.563184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.563833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.564802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:17.565423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:17.566015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:17.581160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:17.585001 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:17.591093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-757e9980-3575-40e2-99d0-9ff992f56b28 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1265 microversion: 2.1 time: 0.184447 Oct 19 01:03:17.610168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1888/3892] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:17 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:17.615693 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:18.056032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:18.065130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-da58a355-8229-4651-95a4-b16f725b2b88 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1499 microversion: 2.1 time: 0.531728 Oct 19 01:03:18.066204 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2005/3893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:17 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1499 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:18.429524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:18.431840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:18.464526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.469046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.474720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.476548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.477299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.477959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.516849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:18.517898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:18.549675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.550447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.551046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.560864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.562261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.568827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.622876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:18.644579 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3dcbd70-48f3-4d43-b260-4591a41467af tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1278 microversion: 2.1 time: 0.218311 Oct 19 01:03:18.647789 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1889/3894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:18 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:18.657704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:18.658663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:18.666546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.667319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.667974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.669067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:18.669739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:18.670387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:18.876993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:18.907613 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d414ba6-4540-49ae-8110-16a553761093 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1265 microversion: 2.1 time: 0.254871 Oct 19 01:03:18.909361 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1890/3895] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:18 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:19.000511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:19.032043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:19.033554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:19.034802 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77f6161f-bdd7-46de-9d50-ab24385dee08 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1725 microversion: 2.20 time: 0.522272 Oct 19 01:03:19.063101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2006/3896] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:18 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1725 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:19.070324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f505426e-1994-48aa-9263-e4b5022ca7ac"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:19.073576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:19.087690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.090963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:19.091592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:19.096845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.097484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.099768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.100042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.100412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.100553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.100999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.101279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.110380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.110947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.111472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.319158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2190bd30671b47048aed416f9c14a545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a4820802e0a4a2b9de754ee1268c060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:19.337492 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74af784a-e461-4b2d-972e-36aa4ffe8ad2 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 200 len: 1457 microversion: 2.1 time: 0.250268 Oct 19 01:03:19.340014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2007/3897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:19 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 1457 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:19.365156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1083e659-a8ab-4b91-ac9f-ca90bc7ffec9", "name": "network-vif-deleted", "tag": "c8a751d2-2d17-453c-aa4d-6c26080f6118"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:19.408634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.409229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.409668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.447643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] Creating event network-vif-deleted:c8a751d2-2d17-453c-aa4d-6c26080f6118 for instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 on n-h2-master-1 Oct 19 01:03:19.466813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8ee4e826-fc6a-4686-aa3c-9243a8265391 req-5df43c2b-feef-4128-9838-386d81ad407c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125038 Oct 19 01:03:19.467435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2008/3898] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:19.564774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa82a6ee-fb32-4cea-897a-c72336514275", "tag": "eba51701-7d4d-4736-bbcc-748ce84c8ddb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:19.596061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.598276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.613058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.679178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] Creating event network-changed:eba51701-7d4d-4736-bbcc-748ce84c8ddb for instance fa82a6ee-fb32-4cea-897a-c72336514275 on n-h2-master-1 Oct 19 01:03:19.692475 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d6de6b2f-8135-4e44-add8-fcae191cf1f0 req-bf3efd90-abdd-4fca-9dc6-1e488e6313d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133323 Oct 19 01:03:19.695087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2009/3899] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:03:19.706326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:19.707045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:19.725685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.726456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.727054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.727914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.728522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.729319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.787525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5960297f-1334-4f5a-b3fc-33acaf98df29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.719531 Oct 19 01:03:19.789259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1891/3900] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Oct 19 01:03:19 2022] POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 188 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:03:19.933551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:19.934434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:19.950481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.951054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.951181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:19.951449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.952174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:19.952939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:19.953402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:19.964251 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-75a8825e-d3b3-48db-9f19-e3b46f4a323e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1278 microversion: 2.1 time: 0.267868 Oct 19 01:03:19.964889 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2010/3901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:19 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:20.089920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:20.091476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.098917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.099664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.100257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.101145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.102941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.103527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.184776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:20.201018 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f31da62c-1c44-4189-af6a-3e9ba5e5ed60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1265 microversion: 2.1 time: 0.271763 Oct 19 01:03:20.246643 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1892/3902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:19 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:20.293521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131449) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 01:03:20.371610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.372328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.402380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.404349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.405033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.406333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.406795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.407242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.456716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 HTTP/1.1 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1083e659-a8ab-4b91-ac9f-ca90bc7ffec9'} Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.460265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.465019 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.468034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.473681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d072a908-d87b-4e08-871b-e9ae3c4b6b34 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 404 len: 111 microversion: 2.1 time: 0.110686 Oct 19 01:03:20.474822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1893/3903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:20 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.494580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.506575 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65b3b427-cfad-416c-a631-673f39d67062 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/action" status: 202 len: 0 microversion: 2.20 time: 0.419476 Oct 19 01:03:20.508093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2011/3904] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 01:03:20 2022] POST /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:03:20.518462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.519383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.519747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.528226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.528930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.529525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.531525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.532020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.532614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.541541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.542062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.545250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.548639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.549307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.550910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.592182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 HTTP/1.1 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1083e659-a8ab-4b91-ac9f-ca90bc7ffec9'} Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.594193 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.598646 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.600772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.602019 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9044ab83-1fa6-4708-9bd8-51319d9db8ea tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 404 len: 111 microversion: 2.1 time: 0.115001 Oct 19 01:03:20.603094 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1894/3905] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:20 2022] DELETE /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.613222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.616410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.631540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.632042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.635266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.636143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.639373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.640012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.675285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 HTTP/1.1 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1083e659-a8ab-4b91-ac9f-ca90bc7ffec9'} Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.677067 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. Oct 19 01:03:20.681265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.682617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.683515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91035adc-1e79-4fb9-a36d-8333f66ec0be tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9" status: 404 len: 111 microversion: 2.1 time: 0.076414 Oct 19 01:03:20.689466 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1895/3906] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:20 2022] GET /compute/v2.1/servers/1083e659-a8ab-4b91-ac9f-ca90bc7ffec9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.699246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.703024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.716515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.717442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.718187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.722457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.723109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.723938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.747861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 HTTP/1.1 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: exception: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'df1e0ca8-54fb-4d11-84d8-3bcaba81e481'} Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.750440 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.754849 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.756400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.757466 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4a1d4dd-f0a7-4cb3-8ff0-038d326f69e8 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 404 len: 111 microversion: 2.1 time: 0.065536 Oct 19 01:03:20.760371 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1896/3907] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:20 2022] DELETE /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.782322 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.783902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: df1e0ca8-54fb-4d11-84d8-3bcaba81e481] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.792165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.793373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.794036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.794908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.795549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.796226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.822669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 HTTP/1.1 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: exception: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'df1e0ca8-54fb-4d11-84d8-3bcaba81e481'} Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.825000 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance df1e0ca8-54fb-4d11-84d8-3bcaba81e481 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.830967 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2dfdd4b4-b39a-4782-bd61-2afee5cba13a tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481" status: 404 len: 111 microversion: 2.1 time: 0.062258 Oct 19 01:03:20.831545 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1897/3908] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:20 2022] GET /compute/v2.1/servers/df1e0ca8-54fb-4d11-84d8-3bcaba81e481 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.837664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.838705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.846094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.846625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.847206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.847929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.851355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.853479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.883953 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b HTTP/1.1 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dc832ba5-2475-4b09-ab86-e7e2adc1694b'} Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.889018 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.893714 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.899070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.913805 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8011c17c-61a6-48df-a985-389a48a9dffe tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 404 len: 111 microversion: 2.1 time: 0.079951 Oct 19 01:03:20.916670 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1898/3909] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:20 2022] DELETE /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:20.927652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.928655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: dc832ba5-2475-4b09-ab86-e7e2adc1694b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.939628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.940688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.941371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.942451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.943156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.943838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.964600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b HTTP/1.1 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dc832ba5-2475-4b09-ab86-e7e2adc1694b'} Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:20.966909 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance dc832ba5-2475-4b09-ab86-e7e2adc1694b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:20.976313 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4987e14-9c9c-40a7-a5a9-9bd18313ea08 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b" status: 404 len: 111 microversion: 2.1 time: 0.054855 Oct 19 01:03:20.979703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1899/3910] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:20 2022] GET /compute/v2.1/servers/dc832ba5-2475-4b09-ab86-e7e2adc1694b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:03:20.986385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:20.986897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:20.995046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.995549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.995990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:20.996765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:20.997231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:20.997668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.018995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 HTTP/1.1 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e77d1863-1d71-49e1-95ff-948460a41aa7'} Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:21.021244 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.025545 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.029295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:21.029295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d9a5cb21-6c48-4287-aa87-d72044fb9ded tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 404 len: 111 microversion: 2.1 time: 0.048388 Oct 19 01:03:21.036043 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1900/3911] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:20 2022] DELETE /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:21.055225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:21.055876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:21.065409 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:21.069889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.070400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.070850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.071578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.072038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.072470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.091078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:21.124837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:21.130649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:21.132219 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ed7bbd89-3ae3-4494-a7e0-e90f1def2eb3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1751 microversion: 2.20 time: 0.620414 Oct 19 01:03:21.136570 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2012/3912] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:20 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1751 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:21.149689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:21.150691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e77d1863-1d71-49e1-95ff-948460a41aa7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:21.165535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.166043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.166480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.168404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.169064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.169647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.185663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 HTTP/1.1 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e77d1863-1d71-49e1-95ff-948460a41aa7'} Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:21.213980 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. Oct 19 01:03:21.224344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:21.242764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e77d1863-1d71-49e1-95ff-948460a41aa7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:21.245130 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e62ca42-2073-40f6-a61b-f540cc709265 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7" status: 404 len: 111 microversion: 2.1 time: 0.107109 Oct 19 01:03:21.247711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2013/3913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:21 2022] GET /compute/v2.1/servers/e77d1863-1d71-49e1-95ff-948460a41aa7 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:21.258902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:21.262747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:21.275977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.277209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.277814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:21.279037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:21.279649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:21.280234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.083027 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:22.259506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:22.268714 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-144839e9-dc2a-4d6d-8ffa-a02bcadb0c56 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 1.229455 Oct 19 01:03:22.269495 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1901/3914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:21 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:22.274441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:22.275104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:22.282890 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:22.287339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.289554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.290006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.293096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.293583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.294023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.317568 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 HTTP/1.1 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '0af2a74f-2c50-42f5-a7cf-750b826e0179'} Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:22.319838 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.324423 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.326063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:22.327165 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18112846-18f2-48a5-9477-2c64c423207e tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179" status: 404 len: 111 microversion: 2.1 time: 0.056432 Oct 19 01:03:22.328873 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1902/3915] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:22 2022] DELETE /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:22.334284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:22.335186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:22.346349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.347207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.347896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.348788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.349443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.350299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.350916 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:22.845124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:22.857569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e529a7f7-6248-47ff-8869-d1d528039088 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 1.608552 Oct 19 01:03:22.858164 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2014/3916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:21 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:22.868705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:22.872199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 0af2a74f-2c50-42f5-a7cf-750b826e0179] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:22.886952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.887820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.896809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.897583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:22.898695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:22.899144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:22.953708 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 HTTP/1.1 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0af2a74f-2c50-42f5-a7cf-750b826e0179'} Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:22.956183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. Oct 19 01:03:22.960746 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:22.963521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 0af2a74f-2c50-42f5-a7cf-750b826e0179 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:22.964520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ac1e95a8-7ab4-4380-9f3a-c0f622cb590c tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179" status: 404 len: 111 microversion: 2.1 time: 0.103329 Oct 19 01:03:22.969610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2015/3917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:22 2022] GET /compute/v2.1/servers/0af2a74f-2c50-42f5-a7cf-750b826e0179 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:22.982332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c88bb725-a093-4084-a90e-3b9a1f27e4ca", "tag": "89fd1642-8e5c-4280-9f1d-0194c1c82dd0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:23.022499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.027692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.030432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.058426 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] Creating event network-changed:89fd1642-8e5c-4280-9f1d-0194c1c82dd0 for instance c88bb725-a093-4084-a90e-3b9a1f27e4ca on n-h1-master-1 Oct 19 01:03:23.071882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7d7cdb6f-da3c-432f-94b4-1ff534bfcd31 req-e6e4eb12-9ad1-4ab7-afb7-99775ac026ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098205 Oct 19 01:03:23.072720 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2016/3918] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:23.281890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:23.294750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:23.295064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:23.295891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:23.302347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:23.303580 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ab36f90-2a51-41db-a550-f3cb74d7a017 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1751 microversion: 2.20 time: 0.973365 Oct 19 01:03:23.304155 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1903/3919] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:22 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1751 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:23.313878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.313878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.313878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.313878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.323682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.323682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.395866 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:23.600340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adb5f9f-c757-4514-aa73-c885b65a2bb3", "tag": "2058f5da-14a5-4682-9ef1-7a263aff5297"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:23.629802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.630319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.630735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.671755 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] Creating event network-changed:2058f5da-14a5-4682-9ef1-7a263aff5297 for instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 on n-h1-master-1 Oct 19 01:03:23.696864 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c5ec096c-fafe-4566-850c-545e05068d17 req-b9bdadd7-28c5-4d20-b76a-dbbbc6fe3aa6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100014 Oct 19 01:03:23.697478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1904/3920] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:03:23.834558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:23.868814 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e42e00c-dd79-4247-8bed-4334776a0eaa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.558519 Oct 19 01:03:23.879989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:23.880972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:23.887683 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2017/3921] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:23 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:23.898872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.899589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.900193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.901133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.901744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.902329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.918758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:23.925349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:23.937939 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:23.949874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.957604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.958299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:23.961398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:23.962105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:23.962909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:24.071765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef0828bd-8f09-4ab8-9a53-fcaf1cf6cc94 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/ips" status: 200 len: 145 microversion: 2.1 time: 0.156611 Oct 19 01:03:24.080265 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2018/3922] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:03:23 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/ips => generated 145 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:24.334814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:24.335730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:24.350747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:24.361412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:24.362299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:24.363406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:24.363990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:24.364743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:24.476307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:24.520050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbd7d5bd-6eb5-4334-8c1e-593e21ad7695 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.625198 Oct 19 01:03:24.528833 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1905/3923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:23 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:24.915405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:24.916997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:24.933303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:24.933572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:24.934327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:24.935761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:24.965047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:24.993287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.056s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:25.057520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:25.069805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:25.081068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:25.082572 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3b854f8-6056-460d-a0e7-7016793e6165 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.752576 Oct 19 01:03:25.083683 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2019/3924] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:24 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:25.555129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:25.555749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:25.565657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:25.566129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:25.567220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:25.571504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:25.572288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:25.573026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:25.670294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:25.704938 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a22ee99e-48f4-470e-a565-15e1758e723d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.783004 Oct 19 01:03:25.706277 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1906/3925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:24 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:26.113835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:26.114731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:26.133295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:26.137069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:26.137526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:26.138257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:26.138727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:26.145205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:26.620353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:26.634538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e93dcb54-5882-4ff2-a80c-617825cee0ed tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 1.081191 Oct 19 01:03:26.653139 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2020/3926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:25 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:26.661293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa82a6ee-fb32-4cea-897a-c72336514275", "name": "network-vif-plugged", "status": "completed", "tag": "eba51701-7d4d-4736-bbcc-748ce84c8ddb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:26.688678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:26.689412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:26.690026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:26.704751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] Creating event network-vif-plugged:eba51701-7d4d-4736-bbcc-748ce84c8ddb for instance fa82a6ee-fb32-4cea-897a-c72336514275 on n-h2-master-1 Oct 19 01:03:26.711785 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0adf04ff-063f-49d6-9975-0cb58f5cafd9 req-358d30f8-5471-41e9-96c0-ef4172ce0dfe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057343 Oct 19 01:03:26.713417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2021/3927] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:26.739299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:26.741038 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:26.760578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:26.761122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:26.761573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:26.762431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:26.762765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:26.763184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:26.769900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:26.793448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:26.797840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:26.803014 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ed5c5f9-9ea8-4b2a-b42d-4e370a26e366 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.694766 Oct 19 01:03:26.820985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1907/3928] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:26 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:27.117547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5524eea-eea0-4f26-96e2-9b4836b78809"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:27.133413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:27.150866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:27.151375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:27.151824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:27.152549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:27.153096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:27.153472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:27.225553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:27.234517 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9198d767-5901-4697-b620-c86d0f2951ff tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.501194 Oct 19 01:03:27.235647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2022/3929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:26 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:27.665993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:27.666525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:27.677458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:27.678317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:27.680215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:27.701316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:27.702267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:27.702943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:27.944026 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:28.023942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51ba0140-2283-4827-b19f-b7b5fe9aea5d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.913220 Oct 19 01:03:28.033911 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1908/3930] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:03:27 2022] POST /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:03:28.080864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:28.081776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:28.118016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:28.118522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:28.119009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:28.119821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:28.120403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:28.120967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:28.398808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:28.419501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13c300eb-0d5f-4610-91b2-40bf18ebe91b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.745671 Oct 19 01:03:28.420396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2023/3931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:27 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:28.433652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:28.436254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:28.448895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:28.449577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:28.450177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:28.451078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:28.451697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:28.452510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:29.460453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:29.477719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:29.481244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:29.482853 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50d3ae7b-8837-4413-9f3e-b5ea48e99712 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 1.444379 Oct 19 01:03:29.486071 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1909/3932] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:28 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:29.499665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0468d6-0728-4c64-8a8a-9b5bca391918", "name": "network-vif-plugged", "status": "completed", "tag": "5d77ffd4-a4b7-44b6-a127-c13798b8a83e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:29.523925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:29.524753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:29.525917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:29.552198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] Creating event network-vif-plugged:5d77ffd4-a4b7-44b6-a127-c13798b8a83e for instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 on n-h1-master-1 Oct 19 01:03:29.569340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ebddb45e-8a18-4bac-bc6e-5c5057c4ca20 req-7a13eab9-bc68-419f-9e6e-7efdfd954554 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078822 Oct 19 01:03:29.575264 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1910/3933] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:29.589260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:29.589844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:29.604465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:29.604991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:29.605436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:29.611780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:29.612295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:29.612766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:29.659881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:29.675717 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f864ded4-b862-4b5f-910d-6560f8826767 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 1.253441 Oct 19 01:03:29.676956 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2024/3934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:28 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:30.113312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:30.122205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d43ceaa-d3a2-4563-9f8e-361f78a48703 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.545577 Oct 19 01:03:30.122802 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1911/3935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:29 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:30.516348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:30.517087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:30.532063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:30.532572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:30.533046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:30.537063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:30.537557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:30.538008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:30.613180 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:30.705504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:30.706131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:30.713595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:30.714098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:30.714545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:30.715263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:30.719729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:30.720302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:30.977283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:30.985722 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f1cf093-774c-4faa-8b29-a337571056f7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.284276 Oct 19 01:03:30.992964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1912/3936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:30 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:30.994022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:31.009402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:31.019837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:31.021596 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b54b0494-48b8-4294-9fe4-22c641f649b9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.510298 Oct 19 01:03:31.035023 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2025/3937] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:30 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:31.150211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:31.151136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:31.169437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:31.170139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:31.170887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:31.172307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:31.173038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:31.174014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:31.533175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:31.544236 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70e3a91d-3d94-415a-9bf2-441b6b664e40 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.399538 Oct 19 01:03:31.545989 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1913/3938] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:31 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:32.014204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:32.015742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:32.026314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.026984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.027974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.029245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.029928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.031989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.055157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:32.055932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:32.069079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.071634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.072212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.075017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.075641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.076933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.346776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:32.357391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1fc64cf5-9606-4c46-9a52-addae8fb3f4f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.351276 Oct 19 01:03:32.358002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2026/3939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:32 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:32.409679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:32.420077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:32.422759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:32.424263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2dd38919-6b64-40c6-b756-a333f297c578 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.374876 Oct 19 01:03:32.425380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1914/3940] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:32 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:32.571762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:32.572423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:32.588465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.590207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.590954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.592431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:32.593315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:32.594004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:32.757734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:32.785152 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b28a3f7f-744e-4042-9654-929bfb824e60 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.213781 Oct 19 01:03:32.785832 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2027/3941] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:32 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:33.185127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88bb725-a093-4084-a90e-3b9a1f27e4ca", "name": "network-vif-plugged", "status": "completed", "tag": "89fd1642-8e5c-4280-9f1d-0194c1c82dd0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:33.250276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.250972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.044s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.251435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.282079 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] Creating event network-vif-plugged:89fd1642-8e5c-4280-9f1d-0194c1c82dd0 for instance c88bb725-a093-4084-a90e-3b9a1f27e4ca on n-h1-master-1 Oct 19 01:03:33.293094 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ba2ea18c-6140-4787-a6d6-9c10c282749d req-1b0fdbfa-b566-412c-9704-8f4fd549889c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112126 Oct 19 01:03:33.295585 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1915/3942] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:33.385046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:33.400766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:33.442644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.443557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.444200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.445154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.445775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.446432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.462571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:33.463282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:33.485457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.485962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.502698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.504422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.505907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.506510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.848910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:33.863612 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-409ef30f-7601-4e44-a4e5-711a57f42366 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.484178 Oct 19 01:03:33.865000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2028/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:33 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:33.874558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:33.875509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:33.893652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.894425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.895034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.895904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:33.896522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:33.897229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:33.923924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:33.933927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:33.935293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:33.937137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8cab8ca-9b92-4d43-b33e-251720cb0f8b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.478983 Oct 19 01:03:33.948380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1916/3944] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:33 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:34.210382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:34.237096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87e76b62-3057-481c-91bd-de220845bb7e tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1307 microversion: 2.1 time: 0.370595 Oct 19 01:03:34.238111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2029/3945] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:33 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1307 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:34.891966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:34.893256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:34.904490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:34.906538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:34.909013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:34.909980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:34.912426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:34.913104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:34.977776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:34.978407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:34.992423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:34.992948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:34.993387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:34.994109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:34.994553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:34.994977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:35.412414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:35.426409 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c177358f-c955-405a-a4b3-b0066d923d79 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 0.538718 Oct 19 01:03:35.427011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1917/3946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:34 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:35.431890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:35.432509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:35.449912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:35.450418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:35.450865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:35.451589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:35.457190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:35.457661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:35.519175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:35.532615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:35.551271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:35.554852 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4d69738-f874-49aa-99d1-85c24f28c544 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.580735 Oct 19 01:03:35.558592 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2030/3947] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:34 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:35.569873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adb5f9f-c757-4514-aa73-c885b65a2bb3", "name": "network-vif-plugged", "status": "completed", "tag": "2058f5da-14a5-4682-9ef1-7a263aff5297"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:35.586039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:35.587075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:35.587738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:35.601824 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] Creating event network-vif-plugged:2058f5da-14a5-4682-9ef1-7a263aff5297 for instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 on n-h1-master-1 Oct 19 01:03:35.607934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-543dd96d-d0cd-4c8d-8650-4fed38e230aa req-3e9a7064-d3a0-45ad-97d2-65ff901526e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046754 Oct 19 01:03:35.609335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2031/3948] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:35.868578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:35.879067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc5af106-bbe0-49eb-bdd5-b57253cc048c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 200 len: 1488 microversion: 2.1 time: 0.450581 Oct 19 01:03:35.897841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1918/3949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:35 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 1488 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:35.906188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1653411950"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:35.925452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:35.936586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:35.937374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:35.939167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:35.940059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:35.941191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:35.941789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:36.381317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d8aef0b-3e5a-4fe9-992d-53094611b736 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca/action" status: 202 len: 0 microversion: 2.1 time: 0.479626 Oct 19 01:03:36.384850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2032/3950] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:03:35 2022] POST /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:03:36.396780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-241f4462-8cd3-4a20-a40e-54fa0e523c36 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42b5670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:36.477753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:36.502268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:36.516184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-241f4462-8cd3-4a20-a40e-54fa0e523c36 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.122954 Oct 19 01:03:36.521765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:36.523439 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1919/3951] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:36 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:36.524350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:36.525016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:36.526539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:36.527693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:36.528918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:36.584713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:36.585631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:36.600137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:36.608602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:36.609670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:36.610605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:36.611247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:36.612492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:37.524442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:37.535229 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6bca6a24-2cfc-4ccc-ac84-e6cfd78df86b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1320 microversion: 2.1 time: 1.085028 Oct 19 01:03:37.542054 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:37.566376 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2033/3952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:36 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1320 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:37.573851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eea745b9-67c3-49da-bb38-65fff787eb86 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af54200d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:37.579197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:37.580993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:37.582897 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-204e410f-2bb7-48ca-a76a-00df679ec42a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 1.003714 Oct 19 01:03:37.595501 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1920/3953] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:36 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:37.651891 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eea745b9-67c3-49da-bb38-65fff787eb86 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.083930 Oct 19 01:03:37.652975 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2034/3954] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:37 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:38.339942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.340518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.362535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.363159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.363671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.364476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.365070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.365723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.419277 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 HTTP/1.1 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e69fb29e-5644-4c56-bfd8-8a26363863c6'} Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:38.421430 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:38.425845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1301bba7-82f7-430e-a987-6543390222da tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 404 len: 111 microversion: 2.1 time: 0.091933 Oct 19 01:03:38.436999 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1921/3955] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:38 2022] DELETE /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:38.443559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.444319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: e69fb29e-5644-4c56-bfd8-8a26363863c6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.464066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.464679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.465200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.469359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.469915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.470535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.500765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 HTTP/1.1 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e69fb29e-5644-4c56-bfd8-8a26363863c6'} Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.502641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance e69fb29e-5644-4c56-bfd8-8a26363863c6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8ef844c-e0f8-4baa-8f96-2e1ade553955 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6" status: 404 len: 111 microversion: 2.1 time: 0.066715 Oct 19 01:03:38.506640 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2035/3956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:38 2022] GET /compute/v2.1/servers/e69fb29e-5644-4c56-bfd8-8a26363863c6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:38.516449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.517186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.524225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.525105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.525788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.526807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.528106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.528803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.543591 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 HTTP/1.1 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '750d52a9-e30d-44d3-bda1-1c5781c3d165'} Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:38.547002 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.550992 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.575694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.576808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.580890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:38.586358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.587173 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-92bf0c3e-5530-489d-a5e0-c9fae04e3298 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "DELETE /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 404 len: 111 microversion: 2.1 time: 0.076198 Oct 19 01:03:38.590416 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1922/3957] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:03:38 2022] DELETE /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:38.603850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.605827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.617635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.617635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.619858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.620818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] [instance: 750d52a9-e30d-44d3-bda1-1c5781c3d165] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.620907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.634923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.637459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.638106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.639053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.645717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.646413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.680101 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] HTTP exception thrown: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Request method failure captured: Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 HTTP/1.1 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0uxTrkvDdN1kMYigcD5WjMwqvlVaKsV5Hogr2CF-RQ0O2mN_qYV0cZzIiOO7t04l19zyRodN4BRoRJFxml1KFpRVaodegnHEw9m5M8g1WFT7HGN9DCi7D6LNLlW81voPEdSM9LNObiZLOFke7Xoonywoj-WjZ2MG8aRmN4h1BU8xqs Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4a4820802e0a4a2b9de754ee1268c060", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4a4820802e0a4a2b9de754ee1268c060"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4a4820802e0a4a2b9de754ee1268c060"}]}] Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4a4820802e0a4a2b9de754ee1268c060 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-2073780661 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2190bd30671b47048aed416f9c14a545 Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-2073780661-project Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '750d52a9-e30d-44d3-bda1-1c5781c3d165'} Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:03:38.682172 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. Oct 19 01:03:38.686029 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:03:38.692190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] Returning 404 to user: Instance 750d52a9-e30d-44d3-bda1-1c5781c3d165 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:03:38.696404 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f39bdcf1-94f4-4026-aa5f-269e6f8915e1 tempest-DeleteServersTestJSON-2073780661 tempest-DeleteServersTestJSON-2073780661-project] 10.222.0.27 "GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165" status: 404 len: 111 microversion: 2.1 time: 0.094421 Oct 19 01:03:38.700387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1923/3958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:38 2022] GET /compute/v2.1/servers/750d52a9-e30d-44d3-bda1-1c5781c3d165 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:03:38.713088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:38.716723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:38.731243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.733617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.736468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:38.737630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:38.739105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:38.739782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:39.478299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:39.491125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:39.495879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:39.497947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e91cf35d-1595-46ff-8bdb-77a0344f7b9d tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1753 microversion: 2.20 time: 0.796369 Oct 19 01:03:39.502685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:39.507143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1924/3959] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:38 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1753 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:39.529774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9295f10f-a6f0-4f0f-87f8-e9eaf7e9b0da tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1511 microversion: 2.1 time: 0.959304 Oct 19 01:03:39.535073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d411068-aae4-4cb0-b407-a133e454b9b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42da430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:39.552110 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2036/3960] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:38 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1511 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:39.595661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:39.597587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:39.615858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d411068-aae4-4cb0-b407-a133e454b9b6 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.088762 Oct 19 01:03:39.620853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:39.622851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:39.623929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:39.625122 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1925/3961] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:39 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:39.633612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:39.634095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:39.634536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:40.392153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:40.401499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2bf35b6-e6a8-4839-933c-c7f2262d3f51 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1511 microversion: 2.1 time: 0.826276 Oct 19 01:03:40.407174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2037/3962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:39 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1511 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:40.434392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:40.435026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:40.458772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:40.461018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:40.462635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:40.466239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:40.468017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:40.468694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:40.540645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:40.541424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:40.554289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:40.554956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:40.555648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:40.556566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:40.565642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:40.566550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:41.326678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:41.342847 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95690fd6-8f49-4940-a9d8-915fbfa13c7e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1510 microversion: 2.1 time: 0.912838 Oct 19 01:03:41.343982 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1926/3963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:40 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1510 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:41.382908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e74f998-0497-4b50-beb2-72e7a176c8c5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42ac040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:41.486984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e74f998-0497-4b50-beb2-72e7a176c8c5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.117533 Oct 19 01:03:41.487584 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1927/3964] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:41 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:41.501146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88bb725-a093-4084-a90e-3b9a1f27e4ca", "name": "network-vif-plugged", "status": "completed", "tag": "89fd1642-8e5c-4280-9f1d-0194c1c82dd0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:41.538342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:41.543323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:41.543902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:41.569551 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] Creating event network-vif-plugged:89fd1642-8e5c-4280-9f1d-0194c1c82dd0 for instance c88bb725-a093-4084-a90e-3b9a1f27e4ca on n-h1-master-1 Oct 19 01:03:41.579697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cb20891c-05ff-4def-aa6d-d116d3414ae9 req-e4344210-3b9f-483f-9526-2e8fa3e25e77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090463 Oct 19 01:03:41.586412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1928/3965] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:41.589318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:41.595342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:41.603507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:41.604869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:41.626946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:41.629189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:41.629985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:41.632541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:41.633703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:41.635319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:41.636368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:41.648459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:41.666301 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d11dfb11-d086-4aa2-8b23-e3b1af8dd07b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.130512 Oct 19 01:03:41.667248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2038/3966] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:40 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:03:41.895241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:42.121469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:42.143158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.143651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.144085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:42.402200 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:42.442763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.443516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.444112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:42.487587 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] Creating event network-changed:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h2-master-1 Oct 19 01:03:42.499118 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-72e9f7d0-16f0-423c-96ec-b4149f9d7a74 req-2beb313a-35fe-4f8a-a0b4-72fbebf3675c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104147 Oct 19 01:03:42.507215 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2039/3967] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:42.516225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-812713d5-9bc6-49a0-bc10-9db23b696d3d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4fb9b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:42.621291 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-812713d5-9bc6-49a0-bc10-9db23b696d3d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.112548 Oct 19 01:03:42.622954 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2040/3968] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:42 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:42.700314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:42.701604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:42.719140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.722182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.724388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:42.728037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.731680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.732312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:42.824533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1a6e283-0981-4ac9-8387-c6112cf6f526 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 1.235482 Oct 19 01:03:42.837953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1929/3969] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 01:03:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:42.854889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:42.866565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:42.878151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1649677332', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:42.886591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.891395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.893170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:42.894213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:42.897346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:42.898205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:43.123794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:43.235444 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:43.280881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:43.290205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:43.297777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:43.299629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:43.302895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fbf06da5-0a12-4f39-bb94-d57c4cb79f95 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.610059 Oct 19 01:03:43.305762 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2041/3970] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:42 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:03:43.305935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:43.306988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:43.308499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:43.643977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c99aed44-8151-4ff4-a4b4-2a859879dee8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4fb9670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:43.709182 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c99aed44-8151-4ff4-a4b4-2a859879dee8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1412 microversion: 2.1 time: 0.072868 Oct 19 01:03:43.712064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2042/3971] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:43 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1412 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:44.071933 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5cf90faf-36e6-4bd6-907a-d2b11c71b8f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1649677332" status: 200 len: 1514 microversion: 2.1 time: 1.221265 Oct 19 01:03:44.089263 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1930/3972] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:03:42 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1649677332 => generated 1514 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:44.108759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:44.121251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:44.124682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:44.147191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:44.148855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:44.149604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:44.152138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:44.152871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:44.155322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:44.333021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:44.333782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:44.351414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:44.352194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:44.352855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:44.353770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:44.354399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:44.355036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:44.531965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:44.809175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:44.831165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:44.835725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:44.836981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:46.632507 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b7c7e88-d2bc-48f8-bc5f-64233226b6db tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 2.532692 Oct 19 01:03:46.633207 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2043/3973] 10.222.0.27 () {58 vars in 1173 bytes} [Wed Oct 19 01:03:44 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:46.640707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eac512a3-dae0-40fa-a5b3-0878de703f76 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42611f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:46.700202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:46.711649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:46.717572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:46.725842 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb5c11a4-98b1-432e-a073-4adfda874db9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 2.394680 Oct 19 01:03:46.727145 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1931/3974] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:44 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:03:46.733930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:46.749430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:46.752905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Removing options 'limit' from query {{(pid=131450) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 19 01:03:46.755980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:46.761939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:46.770514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:46.778505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:46.779684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:46.780391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:46.785122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:47.293629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:47.308151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:47.308655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:47.309108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:47.539933 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51109f5f-1f62-41e3-9958-fe6cfdb9a290 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.811341 Oct 19 01:03:47.562903 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1932/3975] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 01:03:46 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:47.574266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:47.580198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:47.585607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:47.595853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:47.600352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:47.601049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:47.602025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:47.602659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:47.603273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:47.809113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:47.940508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33bfe61c-acce-4279-95b9-eb9d6a040326 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.370908 Oct 19 01:03:47.954587 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1933/3976] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:03:47 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:47.963427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:47.964042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:47.979194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:47.985355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:47.986061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:47.986966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:47.987575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:47.988182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:48.926795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:48.945824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:48.947416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:48.949310 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5af0b4be-7843-43a9-a613-9e1f9820c38b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.993235 Oct 19 01:03:48.961256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1934/3977] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:47 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:48.978067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:48.996063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:49.001433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Removing options 'limit' from query {{(pid=131450) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 19 01:03:49.002357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:49.014658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.015574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.016921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.019798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.020421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.026807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.102405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:49.209186 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95597f7a-ee82-4cf5-b531-c9e335bae84e tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.246760 Oct 19 01:03:49.224222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1935/3978] 10.222.0.27 () {58 vars in 1150 bytes} [Wed Oct 19 01:03:48 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:49.238851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:49.250070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:49.266365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:49.280305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.286020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.286590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.287433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.288248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.289942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.413746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:49.512221 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44370454-cbb0-4cbc-b2ec-270052b7a4c5 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.277932 Oct 19 01:03:49.518363 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1936/3979] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 01:03:49 2022] GET /compute/v2.1/servers => generated 1010 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:03:49.547392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:49.551010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:49.588652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.589433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.591497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.594428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.595088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.597897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.682701 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66b79be4-596b-4cd6-93d4-d3945a609956 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160942 Oct 19 01:03:49.685598 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1937/3980] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:03:49 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:49.694470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:49.712110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:49.714431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:49.748925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.752700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.753161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:49.759956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:49.760511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:49.761209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:50.031002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:50.168613 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7a756393-e46a-41c3-b814-562a68bbd55b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.480911 Oct 19 01:03:50.182715 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1938/3981] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:03:49 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:50.192405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:50.196541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:50.212316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:50.213996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:50.215187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:50.215973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:50.217963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:50.220593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:50.298178 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d94b6f27-0f15-46cb-9bd2-782183602aff tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809" status: 200 len: 194 microversion: 2.1 time: 0.114085 Oct 19 01:03:50.340080 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1939/3982] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Oct 19 01:03:50 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:50.365439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:50.369055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:50.403455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:50.407218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:50.408674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:50.414895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:50.415721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:50.417564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.316846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:51.332747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:51.336386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:51.339475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1e71dc4-c57e-4b78-8bbd-3c4584445612 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.992598 Oct 19 01:03:51.343859 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1940/3983] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:50 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:51.350308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:51.361228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:51.367142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Removing options 'limit' from query {{(pid=131450) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 19 01:03:51.368752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:51.376931 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=83 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:51.382870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:51.386646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:51.387347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.390356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:51.391062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:51.394889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.457285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-216df69f-9e65-4232-94c2-2a61d7c614e1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.111998 Oct 19 01:03:51.466497 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1941/3984] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 01:03:51 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:51.473457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:51.479006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:51.479962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1649677332', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:03:51.487293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:51.488123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:51.488850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.489817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:51.490478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:51.491128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.624298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:03:51.775171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5958525-8929-4706-9e62-3f48119c8d3f tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1649677332" status: 200 len: 346 microversion: 2.1 time: 0.306013 Oct 19 01:03:51.786348 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1942/3985] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:03:51 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1649677332 => generated 346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:51.797382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:51.814451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:51.815228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:51.815695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:51.860886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:03:52.032812 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-020ea91d-5193-4213-9716-f7fa468db6f1 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "POST /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918/action" status: 202 len: 0 microversion: 2.1 time: 0.244925 Oct 19 01:03:52.035642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1943/3986] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:03:51 2022] POST /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:03:52.057078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:52.065475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:52.104202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:52.107442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:52.108172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:52.109187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:52.114981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:52.116684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:52.942826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:52.959541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-244b6119-3366-4800-bb8d-7b42e144d3de tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 0.919010 Oct 19 01:03:52.972647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1944/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:52 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:53.003638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:53.008703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:53.042022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:53.053529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:53.072708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:53.084591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:53.100326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:53.103448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:53.114280 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:54.182098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:54.192005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:54.193481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:54.221121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93cdf0d8-072f-4bfe-aa5a-585ccee69927 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.229960 Oct 19 01:03:54.224044 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1945/3988] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:52 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:54.238305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:54.239205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:54.254465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:54.255038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:54.255546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:54.256968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:54.257969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:54.259259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:54.327817 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:54.805185 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:54.824194 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=47 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:54.844381 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:54.879879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:54.891994 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ccfae680-a1c6-4264-a3e4-40b2c6187a62 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 0.666497 Oct 19 01:03:54.907164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1946/3989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:54 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:54.921920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3781cc2-3e34-4a36-9019-9b5013fc330a"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:03:54.941542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:54.959866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:54.963314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:54.964364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:54.969512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:54.972807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:54.974849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:55.788022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3807eaf-a32a-4588-ba1b-4e7042a60bb2 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "POST /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.878067 Oct 19 01:03:55.789009 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1947/3990] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:03:54 2022] POST /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:03:55.803926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:55.806577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:55.826644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:55.827689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:55.829785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:55.833081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:55.833931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:55.834536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:56.533666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:56.549863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:56.551354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:56.571539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c44ff17b-3c30-487b-881c-702abcf5597b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.762288 Oct 19 01:03:56.572743 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1948/3991] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:55 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:03:56.589505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:56.590158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:56.609444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:56.609943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:56.610388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:56.611106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:56.611565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:56.612089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:56.986129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:57.007342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ff49de0-415a-451e-ba65-aff10c602bd4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 0.433101 Oct 19 01:03:57.024015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1949/3992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:56 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:57.601722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:57.602701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:57.614479 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:03:57.624583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:57.625130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:57.625590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:57.627580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:57.628057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:57.631228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:58.718211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:58.737518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:58.739705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:58.741434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22a7d7ce-cf88-4327-adc8-4e5e6853980a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.143713 Oct 19 01:03:58.742751 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1950/3993] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:57 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:03:58.748957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:58.760836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:58.772587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:58.773489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:58.774175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:58.775359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:58.776046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:58.776735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:59.175169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:03:59.191021 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b005a250-3df8-4ae6-8a30-d970fcfa5ec6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 0.446319 Oct 19 01:03:59.198277 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1951/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:03:58 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:03:59.777017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:03:59.780004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:03:59.824792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:59.826521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:59.827588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:03:59.828781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:03:59.830681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:03:59.832647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:00.296952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:00.313656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:00.317859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:00.320297 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b3cb4db-fef7-468f-b40d-6fea8bcc68a9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.551021 Oct 19 01:04:00.323702 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1952/3995] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:03:59 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:00.334341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:00.334974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:00.370046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:00.372534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:00.373821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:00.374940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:00.378824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:00.380322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:01.120131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:01.147367 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1159435b-24b8-444f-b264-f3aa39721cbd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 0.822372 Oct 19 01:04:01.148960 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1953/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:00 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:01.355009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:01.355928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:01.368166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:01.368862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:01.383581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:01.384985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:01.385813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:01.386617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:01.543587 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=18 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:01.952970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:01.988578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:01.991529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:01.993688 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-efa0cfae-777f-446e-a373-c5238d8c7fd7 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.645392 Oct 19 01:04:02.017600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1954/3997] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:01 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:02.172945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:02.173741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:02.195178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:02.197032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:02.219439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:02.227894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:02.230089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:02.231150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:02.919660 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eac512a3-dae0-40fa-a5b3-0878de703f76 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1421 microversion: 2.1 time: 16.285130 Oct 19 01:04:02.942416 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2044/3998] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:03:46 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1421 bytes in 16308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:02.952300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e48f48d7-df16-4be1-be33-ac9d1b535c94 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af5674280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:03.044419 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e48f48d7-df16-4be1-be33-ac9d1b535c94 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 200 len: 1421 microversion: 2.1 time: 0.099442 Oct 19 01:04:03.070699 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2045/3999] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:04:02 2022] GET /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 1421 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:03.094449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:03.103699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:03.121077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:03.121974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:03.136327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:03.137605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:03.140293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:03.141243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:04.324461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:04.338340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-85f9041e-d2b2-4e2c-982f-de5ed2d254d2 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1521 microversion: 2.1 time: 2.170764 Oct 19 01:04:04.343131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1955/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:02 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1521 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:04.367787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-698254166", "imageRef": "0864f3ae-6e1d-4716-8480-31b3b6b0a020", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:04.507080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:04:04.596838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:04.616476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:04.620540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:04.624299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34cdcac3-ff0f-4b44-9d33-c9daf5d80de0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.550051 Oct 19 01:04:04.626312 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2046/4001] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:03 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:05.380861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:05.385409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:05.434785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:05.436036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:05.436583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:05.446030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:05.449096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:05.451481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.183371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.207147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee7cb1e8-0980-4e7e-9ae9-1e40906e262a tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1498 microversion: 2.1 time: 0.839132 Oct 19 01:04:06.208144 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2047/4002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:05 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1498 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:06.213049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:06.213646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:06.227389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.229398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.230299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.233097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.233097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.233097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.347350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:04:06.347804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:04:06.348267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:04:06.348719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:04:06.349295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:04:06.398799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.399339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.400443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.401270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.401703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.402145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.444714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:04:06.452079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:04:06.470114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:04:06.480936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0864f3ae-6e1d-4716-8480-31b3b6b0a020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:04:06.570352 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-378a70d0-ba89-48d2-ba0c-9b57eeedbf2a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.224810 Oct 19 01:04:06.571449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1956/4003] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:04:06.577364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:06.582283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.583951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.585079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:06.592892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.593669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.594378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.596006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.596681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.597624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.599911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.605067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.611763 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1101c7ab-a5d4-4cdb-bceb-798422f4ebe3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.400711 Oct 19 01:04:06.612610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2048/4004] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:06 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:06.628174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65bf3f12-23e8-47c7-84c9-fd7728abb80c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:06.630481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65bf3f12-23e8-47c7-84c9-fd7728abb80c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:06.682274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:06.770624 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49ada53f-25b0-4ba0-abd4-996effcf57b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.197886 Oct 19 01:04:06.774170 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1957/4005] 10.222.0.27 () {58 vars in 1154 bytes} [Wed Oct 19 01:04:06 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:06.786633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:06.821047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.821705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.822057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.826901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65bf3f12-23e8-47c7-84c9-fd7728abb80c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:06.836179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65bf3f12-23e8-47c7-84c9-fd7728abb80c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1207 microversion: 2.1 time: 0.219047 Oct 19 01:04:06.840859 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2049/4006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:06 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1207 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:06.881612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Going to try to start instance {{(pid=131450) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:04:06.965320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-90e15c74-c220-4b20-ad89-09ca7d96a7bb tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "POST /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918/action" status: 202 len: 0 microversion: 2.1 time: 0.180053 Oct 19 01:04:06.965975 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1958/4007] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:04:06 2022] POST /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:04:06.975573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:06.976472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:06.991948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:06.992546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:06.993275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:06.994436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.008412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.036864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:07.620862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:07.637791 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20a7e29e-88f7-44e4-94dc-954d98f2a2aa tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1507 microversion: 2.1 time: 0.665146 Oct 19 01:04:07.653769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:07.655202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:07.658898 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2050/4008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:06 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1507 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:07.678710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.679223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.679677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:07.680540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.681079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.681563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:07.720276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88bb725-a093-4084-a90e-3b9a1f27e4ca", "name": "network-vif-unplugged", "status": "completed", "tag": "89fd1642-8e5c-4280-9f1d-0194c1c82dd0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:07.786527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.787996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.790076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:07.837303 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] Creating event network-vif-unplugged:89fd1642-8e5c-4280-9f1d-0194c1c82dd0 for instance c88bb725-a093-4084-a90e-3b9a1f27e4ca on n-h1-master-1 Oct 19 01:04:07.849809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c34f36c9-a695-4642-bef0-e848863572b8 req-241bc778-254b-45bd-89bb-db38b61b666a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152081 Oct 19 01:04:07.851124 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2051/4009] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:07.877609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:07.879131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:07.892122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.893404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.894565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:07.895520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:07.896400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:07.898445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:08.131317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:08.156499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc659eb3-98f1-4cfd-9cc1-254bf655cc2b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1211 microversion: 2.1 time: 0.289784 Oct 19 01:04:08.165120 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2052/4010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:07 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1211 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:08.469816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:08.477149 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:08.484545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:08.486105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:08.487315 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e245dc25-95e8-466f-9f14-5388bde250cf tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.840979 Oct 19 01:04:08.487889 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1959/4011] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:07 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:08.674449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:08.675926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:08.702557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:08.703433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:08.704029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:08.705647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:08.708818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:08.709462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:09.186098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:09.186790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:09.211000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:09.221486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:09.222333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:09.230136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:09.231221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:09.234916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:09.246612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:09.256063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ef96902-ee67-42af-9890-b10d349fe09d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1507 microversion: 2.1 time: 0.593103 Oct 19 01:04:09.281813 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2053/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:08 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:09.378463 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:09.396822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae39b005-51a4-4799-88e9-f5c3f9e11ae7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1277 microversion: 2.1 time: 0.216579 Oct 19 01:04:09.402492 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1960/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:09 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1277 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:09.517059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:09.517925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:09.536529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:09.539934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:09.545612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:09.546438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:09.546930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:09.547636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:10.007608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:10.028672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:10.032582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:10.033858 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a986b6cb-2c38-4e06-b3c7-67ec9f920661 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.521274 Oct 19 01:04:10.060604 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2054/4014] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:09 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:10.287511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:10.288840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:10.303495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:10.311892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:10.312282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:10.317004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:10.317507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:10.317964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:10.432354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:10.433614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:10.448031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:10.458910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:10.471090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:10.471090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:10.471544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:10.471716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:10.791008 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:10.799691 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79780a7a-f4e0-49ca-91d2-0da86963b956 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1265 microversion: 2.1 time: 0.372030 Oct 19 01:04:10.804327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2055/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:10 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:11.093134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:11.095612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:11.137306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.143686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.146353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:11.148531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.153411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.155441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:11.215381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:11.246275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e186355-fe72-441f-b9f0-539c4d50acc0 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1511 microversion: 2.1 time: 0.962556 Oct 19 01:04:11.263987 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1961/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:10 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1511 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:11.279138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:11.287751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:11.289335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.servers [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Removing options 'limit' from query {{(pid=131450) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 19 01:04:11.290712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:11.292311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.293257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.294737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:11.295723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.296399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.297144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:11.299795 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd289b60-33de-45d6-bbd8-c4c9b40253ee tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.025212 Oct 19 01:04:11.309088 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1962/4017] 10.222.0.27 () {58 vars in 1140 bytes} [Wed Oct 19 01:04:11 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:04:11.348372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:11.365477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:11.410903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.412187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.415949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:11.417026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:11.417615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:11.418071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:12.223958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:12.244720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:12.249585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:12.253574 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff401103-871f-4d45-85a9-f0ff4573e950 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.167117 Oct 19 01:04:12.255015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2056/4018] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:11 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:12.261995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:12.263634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:12.273315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:12.274155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:12.275596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:12.276593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:12.277296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:12.278082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:12.297350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:12.310709 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-780d85ad-e643-4631-a936-21ad77606273 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1511 microversion: 2.1 time: 0.999529 Oct 19 01:04:12.313484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1963/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:11 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1511 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:12.343118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:12.343741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:12.378215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:12.378740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:12.379187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:12.385360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:12.387251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:12.387726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:12.884252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:12.898657 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-616bf34d-7723-46c4-9a6f-ad683ec65f89 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.640249 Oct 19 01:04:12.920007 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2057/4020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:12 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:13.080564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:13.101131 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4076f6e-0373-4beb-a45e-447b35e84fb6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1510 microversion: 2.1 time: 0.755845 Oct 19 01:04:13.118237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:13.118918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:13.123608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1964/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:12 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1510 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:13.132603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:13.133120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:13.133627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:13.134483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:13.135203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:13.135958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:13.289465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:13.290594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:13.315560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:13.319312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:13.319816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:13.323046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:13.323428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:13.323877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:14.730974 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:04:14.732244 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:04:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 (ip 10.222.0.27) !!! Oct 19 01:04:14.761092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:14.766311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:14.775541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9809783-b319-48a4-a50c-a37dbf6dbe83 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1511 microversion: 2.1 time: 1.661713 Oct 19 01:04:14.776134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:14.777718 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2058/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:13 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1511 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:14.783780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:14.784709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:14.791922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:14.792894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:14.793601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:14.794733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:14.795398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:14.796028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:14.810164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:14.816349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fca571c5-df94-4df4-9f4c-72067222c223 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.530774 Oct 19 01:04:14.832660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1965/4023] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:13 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:14.879065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:14.879725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:14.900689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:14.903038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:14.905930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:14.906798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:14.907585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:14.909198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:15.079319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lazy-loading 'services' on Instance uuid 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:15.363774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a557e0f-7e9e-48dd-9311-77949f6cbd83 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4/os-volume_attachments/37611834-538c-4397-9177-389cda55181f" status: 202 len: 0 microversion: 2.1 time: 0.583991 Oct 19 01:04:15.364796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2059/4024] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:04:14 2022] DELETE /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4/os-volume_attachments/37611834-538c-4397-9177-389cda55181f => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:04:15.374433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:15.388213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:15.390855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:15.937304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:15.951484 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2eab5b51-dbab-4413-b5a7-5a1e71fec294 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 1.117351 Oct 19 01:04:15.952878 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1966/4025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:14 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:15.957776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:15.958387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:15.999821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.000691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.001272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.002335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.003073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.003648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.006208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.006754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.007211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.007960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.008420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.008880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.290018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:16.397304 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9d0ca60-ff1f-4d48-8b94-2fb4d65a3e90 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 1.030797 Oct 19 01:04:16.397826 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2060/4026] 10.222.0.27 () {58 vars in 1154 bytes} [Wed Oct 19 01:04:15 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:16.405114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d3fd277-291a-4b0a-8265-b2ff8593edd1", "tag": "2946aa83-2800-4a27-8c9b-29da525cc4f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:16.442158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.444889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.446825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.460784 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:16.470072 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] Creating event network-changed:2946aa83-2800-4a27-8c9b-29da525cc4f6 for instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 on n-h2-master-1 Oct 19 01:04:16.477042 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-eeec889e-7042-4ed3-b364-41221dbb9fdd req-4c760dc5-8151-4d18-a885-a915d51bc4c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077801 Oct 19 01:04:16.477884 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2061/4027] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:16.485963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:16.486974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:16.496638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.498126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.498866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.500581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.501598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:16.502274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:16.537445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:16.553606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:16.558171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:16.567502 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-243af176-e825-49b7-8129-9f61e326170c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.608786 Oct 19 01:04:16.569941 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1967/4028] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:15 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:16.836344 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:16.979407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:16.981288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:16.992298 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:16.996373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:16.997944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.011716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.013078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.015582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.017647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.120120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:17.130168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63c31179-9058-4c4c-b4ea-25524ca301bd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1511 microversion: 2.1 time: 0.650781 Oct 19 01:04:17.139369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2062/4029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:16 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1511 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:17.156592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:17.157768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:17.186699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.187121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.189540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.190274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.190735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.191164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.395419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:17.406213 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5b8b771-1b8b-41d2-9a59-448f0a795a80 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.433661 Oct 19 01:04:17.407247 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1968/4030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:16 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:17.611500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:17.612220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:17.626433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.626948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.627407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.628411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:17.629871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.630408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.630827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.635091 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:17.637648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2cd760a0-9f6f-485a-876d-3a440deb9106 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1510 microversion: 2.1 time: 0.487942 Oct 19 01:04:17.638287 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2063/4031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:17 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1510 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:17.671826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:17.672990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:17.692484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.695666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.696494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:17.697415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:17.704893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:17.705582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:18.174239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.187422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.199774 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1153398a-6d45-4254-88cf-f3b2f73ad938 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1511 microversion: 2.1 time: 0.535360 Oct 19 01:04:18.201704 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2064/4032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:17 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1511 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:18.229075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.231906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.235637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:18.240233 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6155667e-6004-4533-ad1f-569b4aa88003 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.636296 Oct 19 01:04:18.250804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.256193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:18.257912 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1969/4033] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:17 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:18.279668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:18.280509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:18.283582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:18.285223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:18.289030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:18.290207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:18.354143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:18.424225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:18.432582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:18.433399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:18.434435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:18.443613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:18.444097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:18.447368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:18.451705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:18.454668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:18.455805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:18.456557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:18.458040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:19.593259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:19.616941 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9cb2b05a-5d7e-47c5-ac6b-f603f8bf8679 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 1.185270 Oct 19 01:04:19.640320 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1970/4034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:18 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:19.647576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:19.648817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:19.665939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:19.666670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:19.667129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:19.674853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:19.675786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:19.676572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:19.699388 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3268e8e2-bf14-44cb-a33b-4056f3311923 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 1.471947 Oct 19 01:04:19.700953 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2065/4035] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:04:18 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:19.735950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:19.770388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:19.774383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:20.065931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.066466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.067490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.068247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.069650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.070093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.152079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:20.254917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-53a6b239-d1df-4573-ae0d-f08618fd0dba tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.523956 Oct 19 01:04:20.269002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2066/4036] 10.222.0.27 () {58 vars in 1150 bytes} [Wed Oct 19 01:04:19 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:20.283205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:20.311212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:20.312787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:20.319004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.323057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.323725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.324811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.326208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.327011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.591360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:20.626044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:20.649295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:20.672120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:20.676175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49794c6c-acca-4d5a-ab5b-95fae4ea2fb2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.032711 Oct 19 01:04:20.678605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1971/4037] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:19 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:20.699167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:20.700378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:20.724227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.726037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.730455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.732852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.736703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.737513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.867095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b744bae5-0c1a-4686-8116-66d27073240b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.587179 Oct 19 01:04:20.876867 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2067/4038] 10.222.0.27 () {58 vars in 1212 bytes} [Wed Oct 19 01:04:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:20.888749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:20.899477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:20.900361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:20.913304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.914778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.915229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:20.918425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:20.919081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:20.919744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.088494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:21.187698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-959c89ec-82c9-4a38-bebb-9f01cbeadba6 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.308233 Oct 19 01:04:21.196494 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2068/4039] 10.222.0.27 () {58 vars in 1196 bytes} [Wed Oct 19 01:04:20 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:21.211634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:21.218101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:21.219013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': '1649677332', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:21.225485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.226289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.227314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.228276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.228963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.229638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.355504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:21.534060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e595b9fe-f7e1-4b66-b5fe-130ce0556953 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1649677332" status: 200 len: 346 microversion: 2.1 time: 0.335928 Oct 19 01:04:21.535878 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2069/4040] 10.222.0.27 () {58 vars in 1156 bytes} [Wed Oct 19 01:04:21 2022] GET /compute/v2.1/servers?name=1649677332 => generated 346 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:21.578197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:21.584019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:21.585187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:21.591772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.592588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.593310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.594289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.594979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.595735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.694227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:21.706959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5015336-e851-414b-bc55-a66c723f89b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 1.026034 Oct 19 01:04:21.712477 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1972/4041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:20 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:21.719298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:21.743582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:21.765566 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:21.770670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.772550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.773266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.777076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:21.778829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:21.780116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:21.854275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:21.989926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8937cfdc-211f-4c8e-b282-72e5b8efd3b4 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.442350 Oct 19 01:04:21.999429 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2070/4042] 10.222.0.27 () {58 vars in 1154 bytes} [Wed Oct 19 01:04:21 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:22.006404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:22.021136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:22.022164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-164967733', 'deleted': False, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:04:22.028677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.029625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.030300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.031297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.031985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.032675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.240476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:04:22.363889 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5839fea2-d71c-4b4b-a588-9f4ab21a087c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-164967733" status: 200 len: 346 microversion: 2.1 time: 0.361615 Oct 19 01:04:22.364888 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2071/4043] 10.222.0.27 () {58 vars in 1228 bytes} [Wed Oct 19 01:04:22 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-164967733 => generated 346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:22.390539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:22.390539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:22.395864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:22.397336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.397945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.398509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.399625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.400270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.400858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.405145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:22.414427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:22.416241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4caf1e42-29a1-4118-9af6-eb08300d7450 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.702250 Oct 19 01:04:22.418086 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1973/4044] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:21 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:22.430693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:22.621583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-023b1c62-c948-433f-ad21-5fe9b2264c7d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 204 len: 0 microversion: 2.1 time: 0.244075 Oct 19 01:04:22.626366 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2072/4045] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:22 2022] DELETE /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:22.634099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:22.634718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:22.672843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.673359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.675204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.677043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.677517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.681373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.740502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:22.741245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:22.760517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.772659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.772659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:22.772659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:22.772659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:22.772659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:23.176139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:23.186654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b39b0faf-e59f-41cf-ba6f-89a28529638d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1517 microversion: 2.1 time: 0.556359 Oct 19 01:04:23.208359 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1974/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:22 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1517 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:23.451235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:23.456357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:23.482418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:23.489237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:23.490012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:23.490961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:23.491628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:23.492251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:23.604934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:23.619088 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e973d2f1-b40f-4427-be0f-a6afa39c1b18 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.883417 Oct 19 01:04:23.644065 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2073/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:22 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:24.001719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:24.011371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:24.023803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:24.025113 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e10bf700-428a-458c-a79a-b1fb9ad4f5b1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.579712 Oct 19 01:04:24.026059 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1975/4048] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:23 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:24.215552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:24.216442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:24.226878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:24.228822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:24.229562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:24.230569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:24.236983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:24.237305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:24.546013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:24.563862 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f88d27c-93c8-4066-b147-8571447949fe tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1517 microversion: 2.1 time: 0.349790 Oct 19 01:04:24.565415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2074/4049] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:24 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1517 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:24.646959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:24.648138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:24.655226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:24.673753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:24.674482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:24.675425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:24.676055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:24.685484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.055979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:25.056806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:25.061015 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:25.088911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.091422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.092268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.093510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.095467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.101630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.227569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:25.258182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91a42bd1-055a-49ee-a95c-775bb7b5ca15 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.615113 Oct 19 01:04:25.266166 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1976/4050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:24 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:25.501393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:25.504973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:25.526011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.529799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:25.530179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.530914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.531907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.534359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.537756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.543668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:25.545663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:25.547139 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5ea23b6-a494-4cf1-9115-7b1185e02688 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.495388 Oct 19 01:04:25.547419 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2075/4051] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:25 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:25.593380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:25.595194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:25.623086 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:25.624515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.629628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.630146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.635902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.636474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.641622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.659338 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f7f237f-bd08-4378-90bd-97957a4edfb9 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.162488 Oct 19 01:04:25.660956 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1977/4052] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:04:25 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:25.663662 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:25.812750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:25.813529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:25.830006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.830792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.837956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.845096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:25.845723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:25.846322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:25.969628 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7568b705-2027-49d2-8cd8-722549809301 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809" status: 200 len: 194 microversion: 2.1 time: 0.162117 Oct 19 01:04:25.984295 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1978/4053] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Oct 19 01:04:25 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809 => generated 194 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:25.998245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:25.998838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:26.024226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.030360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.030941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:26.031969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.032680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.033297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:26.100371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:26.116294 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d4e6225-343b-466a-8ec7-fb72ded74134 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1517 microversion: 2.1 time: 0.526042 Oct 19 01:04:26.131108 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2076/4054] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:25 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1517 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:26.291233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:26.291949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:26.301417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.302828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.303509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:26.304445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.305149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lazy-loading 'services' on Instance uuid 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:26.305647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.306805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:26.493540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c6575f6-6192-4c1d-80ff-26d196854742 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809" status: 202 len: 0 microversion: 2.1 time: 0.507033 Oct 19 01:04:26.509104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1979/4055] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:04:25 2022] DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/b5524eea-eea0-4f26-96e2-9b4836b78809 => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:04:26.579698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:26.580883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:26.600076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.601191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.604613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:26.605699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:26.609243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:26.609987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:27.142880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:27.160963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:27.166689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:27.168356 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-843f8512-0081-4c71-b742-85c19818316f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.595837 Oct 19 01:04:27.200741 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1980/4056] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:26 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:27.216316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:27.217398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:27.237516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:27.239214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:27.241177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:27.247619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:27.248650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:27.249381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:27.927709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:27.936142 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b218da5c-7dfa-4f4b-9aad-55e3eb72a28b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 1.649974 Oct 19 01:04:27.946963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2077/4057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:26 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:27.951807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:27.963796 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4c9c433-5e8a-4d29-8238-6f13eb0e5dd3 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1475 microversion: 2.1 time: 0.761422 Oct 19 01:04:27.969927 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1981/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:27 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1475 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:28.206878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:28.207510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:28.219231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:28.219739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:28.220181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:28.220932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:28.221395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:28.221897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:28.423593 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:28.678406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:28.687993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:28.689495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:28.690674 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b0dd8b5-7ed9-45d2-84e4-03e3deb92b72 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.487944 Oct 19 01:04:28.693474 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2078/4059] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:28 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:28.972452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:28.973864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:28.986177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:28.986517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:28.995520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:28.996329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:28.996953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.001589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.429609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:29.448342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adb5f9f-c757-4514-aa73-c885b65a2bb3", "name": "network-vif-deleted", "tag": "2058f5da-14a5-4682-9ef1-7a263aff5297"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:29.456321 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6c4f91c-b923-4fb2-b272-a46a4bd41ee1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.484941 Oct 19 01:04:29.458167 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2079/4060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:28 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:29.463754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.464244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.466103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:29.466979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:29.475836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.495455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] Creating event network-vif-deleted:2058f5da-14a5-4682-9ef1-7a263aff5297 for instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 on n-h1-master-1 Oct 19 01:04:29.517439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-62372e43-0225-4eeb-9118-e229be2b617a req-e6beeb2f-03b5-4b3f-a76d-d5f17d237ec3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.698167 Oct 19 01:04:29.520486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.521504 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1982/4061] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:29.523746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.526109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.527094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.535748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.536373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.612507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.613240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.613892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.615191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lazy-loading 'fault' on Instance uuid 8adb5f9f-c757-4514-aa73-c885b65a2bb3 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:29.720165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:29.720930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:29.731649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.732065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.732596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.733246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:29.733710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:29.734150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:29.877675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:29.897578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-edd9066f-53d2-42e8-bc80-e6a5be215f3d tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 200 len: 1310 microversion: 2.1 time: 0.437971 Oct 19 01:04:29.898879 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2080/4062] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:29 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 1310 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:30.432752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:30.443931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:30.461874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:30.463147 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e7b1cb8-9b35-4eea-b51c-c0e5817cf1fd tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.747587 Oct 19 01:04:30.466558 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1983/4063] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:29 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:30.490080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:30.490750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:30.506160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:30.510966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:30.511627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:30.512549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:30.513085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:30.514082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:30.926769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:30.927501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 8adb5f9f-c757-4514-aa73-c885b65a2bb3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:30.944213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:30.945065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:30.945205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:30.945946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:30.946507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:30.946823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.001619 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] HTTP exception thrown: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Request method failure captured: Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 HTTP/1.1 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0y-9fLSDB7ogapDXLfDaqTJY_9qgzyOJFirCfuVVcS4hWJOCq1wZfL6ngXTBLSPyt8CMw9iyrmgEP1bmQ5E3_DT-tsZbB2cD_UnbuTiA3Ho_qDVXtTx6Sm1XMnYwchGSefH5BW-GUPVjZ6dqoQ46LnxbnTh88XPwfi8iFL8G9-_SZY Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a42977a7c9aa4831a041b3f1472b52d0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}] Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f6f439f0db774d4c9691083e208cbaaa Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '8adb5f9f-c757-4514-aa73-c885b65a2bb3'} Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:31.003358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:31.008183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Returning 404 to user: Instance 8adb5f9f-c757-4514-aa73-c885b65a2bb3 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:04:31.016846 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d18bfa38-40bc-4493-952d-028e62f9d759 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3" status: 404 len: 111 microversion: 2.1 time: 0.083194 Oct 19 01:04:31.024069 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1984/4064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:30 2022] GET /compute/v2.1/servers/8adb5f9f-c757-4514-aa73-c885b65a2bb3 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:04:31.040376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:31.043388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:31.065710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:31.073835 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ac0890c-124a-4613-95e7-7222a9c1ce83 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.593612 Oct 19 01:04:31.078809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.079323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.079836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.080484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.081077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.081431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.087304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2081/4065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:30 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:31.170478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:31.357491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1b5a3d0-39c3-4cf8-98e6-20928d0811b9 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 204 len: 0 microversion: 2.1 time: 0.331951 Oct 19 01:04:31.365985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:31.366607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:31.369951 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1985/4066] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:31 2022] DELETE /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:31.380340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.380882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.381327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.382042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.382499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.382988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.490678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:31.491455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:31.504463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.505080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.505543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.506245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:31.506703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:31.507135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:31.983525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:32.002758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:32.025415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:32.026703 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-966a4989-a213-4de4-8f23-68de513fc259 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.540574 Oct 19 01:04:32.036870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1986/4067] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:31 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:04:32.068074 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:32.112135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:32.112801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:32.120711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:32.121186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:32.121728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:32.122380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:32.122843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:32.123290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:32.132979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:32.148755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-adceaaf9-2ba3-4e76-b976-816622d24c1b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1516 microversion: 2.1 time: 0.786172 Oct 19 01:04:32.169883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2082/4068] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:31 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1516 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:32.687120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:32.711550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef4ad351-2367-46b6-86df-ef1084be227a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.602937 Oct 19 01:04:32.726849 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1987/4069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:32 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:33.057903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:33.059332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:33.072964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:33.080646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:33.083620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:33.084612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:33.085841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:33.087916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:33.176686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-plugged", "status": "completed", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:33.206151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:33.206776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:33.207335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:33.232095 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] Creating event network-vif-plugged:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h2-master-1 Oct 19 01:04:33.245755 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-42d60a22-16ca-4394-828b-4abc84afa054 req-09dcb905-8541-4b71-b819-c57c511ea73e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072899 Oct 19 01:04:33.249381 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1988/4070] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:04:33.254952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:33.270597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:33.287403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:33.288372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:33.289106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:33.290067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:33.290764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:33.291428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.071217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:34.083322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:34.085044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:34.086583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-45512150-6732-45aa-a876-c1b081e00913 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 1.034298 Oct 19 01:04:34.100684 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2083/4071] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:33 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:34.100684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:34.100684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:34.108634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.109364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.109988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.110943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.111551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.112104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.134948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:34.149552 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9623e3f0-cf41-451d-b451-ce835c2b5d91 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1516 microversion: 2.1 time: 0.898604 Oct 19 01:04:34.154339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1989/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:33 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1516 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:34.445354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:34.464730 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-93c4f042-e077-4572-bdc4-4deda90ca851 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.372422 Oct 19 01:04:34.484925 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2084/4073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:34 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:34.609693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:34.610227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:34.623019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.626426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.627005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.627740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.628394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.629024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.698120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:34.882876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4cccf5e-5efe-410c-8f25-84dba4987eb0 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 204 len: 0 microversion: 2.1 time: 0.272454 Oct 19 01:04:34.885488 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1990/4074] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:34 2022] DELETE /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:34.894562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:34.895193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:34.902299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.905070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.905530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.906269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.906757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.907229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.909080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa82a6ee-fb32-4cea-897a-c72336514275", "name": "network-vif-deleted", "tag": "eba51701-7d4d-4736-bbcc-748ce84c8ddb"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:34.932511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:34.935979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:34.936753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:34.963790 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] Creating event network-vif-deleted:eba51701-7d4d-4736-bbcc-748ce84c8ddb for instance fa82a6ee-fb32-4cea-897a-c72336514275 on n-h2-master-1 Oct 19 01:04:34.975265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff21ce18-5078-4d39-aa5c-ba19df9e18d3 req-2c993a55-a224-430d-b3dc-839bb4daf0fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070618 Oct 19 01:04:34.977715 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1991/4075] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:04:35.119859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:35.120977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:35.145376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.149222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.150949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:35.153252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.157725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.158448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:35.281584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:35.311073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c54115a-bd60-4ce4-bf66-fe98fb388acf tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1470 microversion: 2.1 time: 0.420731 Oct 19 01:04:35.313247 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2085/4076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:34 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:35.326909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:35.328167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:35.342427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.348251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.348909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:35.349906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.350482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.351162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:35.585745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:35.597089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:35.597203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f65daef-e778-4971-901a-96994a012be7 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1474 microversion: 2.1 time: 0.281887 Oct 19 01:04:35.612904 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:35.613971 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2086/4077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:35 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1474 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:35.617087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:35.619771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:35.621510 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-137963cd-279d-4394-bd3d-ff6d21e1d8bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.508721 Oct 19 01:04:35.622346 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1992/4078] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:35 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:35.841657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:35.842302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:35.854891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.860071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.860597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:35.861376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:35.861965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:35.862928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.219614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:36.253329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d01667e4-297f-4018-a391-a8b7a606f4a7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.631147 Oct 19 01:04:36.265510 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2087/4079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:35 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:36.342359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:36.343123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:36.363446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.366984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.367666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.368438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.373120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.373783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.627045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:36.627681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:36.643852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.644399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.644875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.645618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.646065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.652009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.675255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:36.686463 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86933633-6630-4a0b-b3de-882ba22fc502 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1470 microversion: 2.1 time: 0.346998 Oct 19 01:04:36.690124 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1993/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:36 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:36.700199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:36.704487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:36.719014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.719873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.721137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.725596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.726617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.727284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.732560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:36.736132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:36.736647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:36.737182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lazy-loading 'fault' on Instance uuid fa82a6ee-fb32-4cea-897a-c72336514275 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:36.830293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:36.846768 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5ac06dc8-9ad8-4d5a-bb79-754d4a493c45 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 200 len: 1310 microversion: 2.1 time: 0.224488 Oct 19 01:04:36.854751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2088/4081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:36 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 1310 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:37.069356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3fd277-291a-4b0a-8265-b2ff8593edd1", "name": "network-vif-plugged", "status": "completed", "tag": "2946aa83-2800-4a27-8c9b-29da525cc4f6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:37.096838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.098467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.100236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.139191 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] Creating event network-vif-plugged:2946aa83-2800-4a27-8c9b-29da525cc4f6 for instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 on n-h2-master-1 Oct 19 01:04:37.165431 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e2f9287f-f407-4116-8d3b-78b3f00c4ecd req-0c3c258b-49fc-4668-aa78-62e0068c61e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100236 Oct 19 01:04:37.170464 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2089/4082] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:37.182124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:37.194477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:37.201234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:37.202785 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-519e318b-131f-4081-9aea-794698ac4cb9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1809 microversion: 2.20 time: 0.511335 Oct 19 01:04:37.203539 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1994/4083] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:36 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1809 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:37.284377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:37.285485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:37.309698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.312533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.313606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.314771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.315472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.316150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.716480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:37.717267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:37.734099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.737228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.743474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.755103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.755614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.762955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.789728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:37.798140 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-571aa571-0561-4f11-a035-83292e1e944d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.520591 Oct 19 01:04:37.798749 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2090/4084] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:37 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:37.880009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:37.880715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: fa82a6ee-fb32-4cea-897a-c72336514275] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:37.899580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.900088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.900531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.901283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.901745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.902175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.937645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] HTTP exception thrown: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Request method failure captured: Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 HTTP/1.1 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0y-9fLSDB7ogapDXLfDaqTJY_9qgzyOJFirCfuVVcS4hWJOCq1wZfL6ngXTBLSPyt8CMw9iyrmgEP1bmQ5E3_DT-tsZbB2cD_UnbuTiA3Ho_qDVXtTx6Sm1XMnYwchGSefH5BW-GUPVjZ6dqoQ46LnxbnTh88XPwfi8iFL8G9-_SZY Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a42977a7c9aa4831a041b3f1472b52d0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}] Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: f6f439f0db774d4c9691083e208cbaaa Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: exception: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'fa82a6ee-fb32-4cea-897a-c72336514275'} Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:37.939612 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Returning 404 to user: Instance fa82a6ee-fb32-4cea-897a-c72336514275 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e9824ad-68b5-4874-b9e7-0a88000c6d7b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275" status: 404 len: 111 microversion: 2.1 time: 0.066446 Oct 19 01:04:37.943469 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2091/4085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:37 2022] GET /compute/v2.1/servers/fa82a6ee-fb32-4cea-897a-c72336514275 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:37.954505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:37.955014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:37.969911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.970413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.972249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:37.973962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:37.975314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:37.976605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.041510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:38.181706 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:38.276986 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9448c91e-b56a-4ad8-bd56-b0fda1c1790c tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 204 len: 0 microversion: 2.1 time: 0.326989 Oct 19 01:04:38.278752 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2092/4086] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:37 2022] DELETE /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:38.285307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:38.286249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:38.294254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.295067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.295672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.297072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.297802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.298468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.320092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:38.334412 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-707b2d9b-388d-4710-a110-bccb51de9691 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1470 microversion: 2.1 time: 0.622220 Oct 19 01:04:38.344704 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1995/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:37 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1470 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:38.353375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:38.353375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:38.379444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.379444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.379444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.384431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.384968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.385420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.673090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:38.686553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:38.689775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:38.691011 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbe88e7a-3a73-4cb8-afbe-7d14a2fb8128 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1796 microversion: 2.20 time: 0.410880 Oct 19 01:04:38.693572 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2093/4088] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:04:38 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1796 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:04:38.699698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6e1832-c42d-4f89-9b62-e34dfdf583b4", "name": "network-vif-deleted", "tag": "3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:38.721592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.724357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.724854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.750644 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] Creating event network-vif-deleted:3a3e8975-8ef5-4c95-9a69-184b8e9b9f6d for instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 on n-h2-master-1 Oct 19 01:04:38.768280 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0e2ade8c-db4a-49ef-9e34-c2b217c35ec7 req-908e6f6a-a2fb-4ca8-92e4-7e8d10bb3a2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073053 Oct 19 01:04:38.770566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2094/4089] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:38.785537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:38.796471 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8dba5b0-ac56-44d3-ae75-05aba1b9620b tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1517 microversion: 2.1 time: 0.460340 Oct 19 01:04:38.813283 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1996/4090] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:38 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:38.821391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:38.823863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:38.833266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.834177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.834935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:38.836412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:38.837110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:38.838291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:39.014852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:39.025224 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb1752a1-936d-4937-b08d-9796dd93d3b9 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1307 microversion: 2.1 time: 0.207879 Oct 19 01:04:39.026473 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2095/4091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:38 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:39.367578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:39.368863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:39.377994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:39.378786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:39.379412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:39.380662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:39.381371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:39.382018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:39.447774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:39.454477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:39.455072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:39.455861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lazy-loading 'fault' on Instance uuid 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:39.560303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b67c81c105654dac996312942d5f9ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac2546ccf89145aa87a9fc9231a2a7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:39.574351 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4cbb9a4-e3b3-4621-ae24-6c18bf9347c4 tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 200 len: 1304 microversion: 2.1 time: 0.216365 Oct 19 01:04:39.584684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1997/4092] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:39 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:39.824284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:39.825693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:39.862153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:39.863521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:39.864382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:39.868267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:39.868785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:39.869236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.052994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:40.053815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:40.076122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.079002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.079002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.081275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.084181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.086424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.170702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:40.181562 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-148ce51f-5565-4b8b-afb5-2b7ccf53bed8 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1517 microversion: 2.1 time: 0.362765 Oct 19 01:04:40.203376 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2096/4093] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:39 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1517 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:40.359084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:40.375960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0bf2ca7a-f394-4e8a-bc62-3f536a48bcaf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1487 microversion: 2.1 time: 0.326466 Oct 19 01:04:40.378545 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1998/4094] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:40 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:40.401305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:40.402911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:40.409301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.410321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.411859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.413128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.417393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.418768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.462409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:40.600515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:40.601659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] [instance: 6b6e1832-c42d-4f89-9b62-e34dfdf583b4] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:40.614173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.614649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.615093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.615809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.616263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.629056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.646229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] HTTP exception thrown: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. Oct 19 01:04:40.646455 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32261710-28dd-4ec5-958a-b8f1f83d0584 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 204 len: 0 microversion: 2.1 time: 0.249069 Oct 19 01:04:40.651079 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2097/4095] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:40 2022] DELETE /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Request method failure captured: Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 HTTP/1.1 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xb71w5DLK_qxRYe50FPVMsXhuRKgeC9sxaeRs8zuRXWXVi9pXLLQ2CoWvr9_QTZziVpiw5BJe-MEKN0krU512jb5KU5YcyiF-TcH7twyIV09tT76z-jTfkkwuDkt2gwAYGywH0wFPO16dAW7iunlwCxznU3uvpaJdOsd-7SYDtJos Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ac2546ccf89145aa87a9fc9231a2a7e6 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesBackupsTest-1058378382 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ac2546ccf89145aa87a9fc9231a2a7e6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac2546ccf89145aa87a9fc9231a2a7e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ac2546ccf89145aa87a9fc9231a2a7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ac2546ccf89145aa87a9fc9231a2a7e6"}]}] Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesBackupsTest-1058378382 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ac2546ccf89145aa87a9fc9231a2a7e6 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesBackupsTest-1058378382 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesBackupsTest-1058378382-project Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: b67c81c105654dac996312942d5f9ce5 Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesBackupsTest-1058378382-project Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '6b6e1832-c42d-4f89-9b62-e34dfdf583b4'} Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:40.659275 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:40.663964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] Returning 404 to user: Instance 6b6e1832-c42d-4f89-9b62-e34dfdf583b4 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:04:40.664908 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a72c927-4bec-4bc1-86e9-edadba9a48ee tempest-VolumesBackupsTest-1058378382 tempest-VolumesBackupsTest-1058378382-project] 10.222.0.27 "GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4" status: 404 len: 111 microversion: 2.1 time: 0.069116 Oct 19 01:04:40.677370 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 1999/4096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:40 2022] GET /compute/v2.1/servers/6b6e1832-c42d-4f89-9b62-e34dfdf583b4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:40.678167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:40.678167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:40.704647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.704647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.704647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:40.704647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:40.713599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:40.716561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:41.036556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:41.047133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be4eccbe-e27b-4693-a41c-ea3f136fb57f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1493 microversion: 2.1 time: 0.393097 Oct 19 01:04:41.048274 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2098/4097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:40 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1493 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:41.208790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:41.216368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:41.242246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:41.243749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:41.244217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:41.245025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:41.251695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:41.253275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:41.583565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:41.599117 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b92e720c-348c-41e8-9191-fdb6e77c14cd tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1517 microversion: 2.1 time: 0.394359 Oct 19 01:04:41.603959 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2000/4098] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:41 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1517 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:41.885686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0468d6-0728-4c64-8a8a-9b5bca391918", "name": "network-vif-deleted", "tag": "5d77ffd4-a4b7-44b6-a127-c13798b8a83e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:41.898655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:41.899953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:41.900582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:41.918369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] Creating event network-vif-deleted:5d77ffd4-a4b7-44b6-a127-c13798b8a83e for instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 on n-h1-master-1 Oct 19 01:04:41.949773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e002d86f-cc6a-435e-a6cf-9fc5b4a3eeba req-085eaaad-ff13-4410-aa7a-983299c5f7a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065306 Oct 19 01:04:41.958357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2099/4099] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:42.077956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:42.080490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:42.110442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:42.111263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:42.111749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:42.113740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:42.116803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:42.117461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:42.631227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:42.632243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:42.646410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:42.648991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:42.650423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:42.651971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:42.654473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:42.655195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:42.758569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:42.763649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:42.765784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:42.767700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lazy-loading 'fault' on Instance uuid 7a0468d6-0728-4c64-8a8a-9b5bca391918 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:42.911155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:42.922917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c288a525-d816-44ac-860f-916accd05c1c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1493 microversion: 2.1 time: 0.851995 Oct 19 01:04:42.932285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2001/4100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:42 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1493 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:43.007023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:43.007801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:43.018990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.021947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.022606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.025214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.025890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.032099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.161578 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62a7efec-1ee6-47da-a4dd-cbb44e5e0746 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/c3781cc2-3e34-4a36-9019-9b5013fc330a" status: 200 len: 194 microversion: 2.1 time: 0.159196 Oct 19 01:04:43.173017 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2002/4101] 10.222.0.27 () {58 vars in 1413 bytes} [Wed Oct 19 01:04:43 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/c3781cc2-3e34-4a36-9019-9b5013fc330a => generated 194 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:43.178518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:43.179014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:43.214545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.215740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.216216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.221355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.223032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.223779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.254204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6f439f0db774d4c9691083e208cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a42977a7c9aa4831a041b3f1472b52d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:43.269344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e9ab362-5e6e-41fd-b731-fe142ac93220 tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 200 len: 1311 microversion: 2.1 time: 0.643831 Oct 19 01:04:43.270569 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2100/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:42 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 1311 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:04:43.438025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lazy-loading 'services' on Instance uuid 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:43.664615 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d823fae-b50e-47de-85a5-656a5d9cbd24 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/c3781cc2-3e34-4a36-9019-9b5013fc330a" status: 202 len: 0 microversion: 2.1 time: 0.489894 Oct 19 01:04:43.680022 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2003/4103] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:04:43 2022] DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments/c3781cc2-3e34-4a36-9019-9b5013fc330a => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:04:43.957804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:43.963239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:43.971597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d3fd277-291a-4b0a-8265-b2ff8593edd1", "name": "network-vif-deleted", "tag": "2946aa83-2800-4a27-8c9b-29da525cc4f6"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:43.975359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.976979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.979512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.981389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.982123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.984595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:43.987332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:43.987582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:43.988683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:44.003174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] Creating event network-vif-deleted:2946aa83-2800-4a27-8c9b-29da525cc4f6 for instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 on n-h2-master-1 Oct 19 01:04:44.012780 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e269a3b9-ecc3-44d5-a7b0-3f6d7f0d1652 req-1eaae406-34e8-4d82-a180-873e54103547 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045042 Oct 19 01:04:44.019363 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2004/4104] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:04:44.138077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:44.138829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:44.140321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:44.142738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lazy-loading 'fault' on Instance uuid 1d3fd277-291a-4b0a-8265-b2ff8593edd1 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:04:44.297615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:44.299501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] [instance: 7a0468d6-0728-4c64-8a8a-9b5bca391918] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:44.330494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:44.332222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:44.336267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:44.337306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:44.340259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:44.341027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:44.385145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] HTTP exception thrown: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Request method failure captured: Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 HTTP/1.1 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0y-9fLSDB7ogapDXLfDaqTJY_9qgzyOJFirCfuVVcS4hWJOCq1wZfL6ngXTBLSPyt8CMw9iyrmgEP1bmQ5E3_DT-tsZbB2cD_UnbuTiA3Ho_qDVXtTx6Sm1XMnYwchGSefH5BW-GUPVjZ6dqoQ46LnxbnTh88XPwfi8iFL8G9-_SZY Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a42977a7c9aa4831a041b3f1472b52d0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a42977a7c9aa4831a041b3f1472b52d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a42977a7c9aa4831a041b3f1472b52d0"}]}] Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: a42977a7c9aa4831a041b3f1472b52d0 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-861945760 Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f6f439f0db774d4c9691083e208cbaaa Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ListServerFiltersTestJSON-861945760-project Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '7a0468d6-0728-4c64-8a8a-9b5bca391918'} Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:44.389947 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. Oct 19 01:04:44.395370 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:44.396871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] Returning 404 to user: Instance 7a0468d6-0728-4c64-8a8a-9b5bca391918 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:04:44.397905 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6f4c86f6-6dac-4746-aa6b-a7e890ef4eef tempest-ListServerFiltersTestJSON-861945760 tempest-ListServerFiltersTestJSON-861945760-project] 10.222.0.27 "GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918" status: 404 len: 111 microversion: 2.1 time: 0.106210 Oct 19 01:04:44.398483 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2005/4105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:44 2022] GET /compute/v2.1/servers/7a0468d6-0728-4c64-8a8a-9b5bca391918 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:04:44.421809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:44.432289 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21adc22c-5d78-47b3-a33b-500a18eafbca tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 200 len: 1297 microversion: 2.1 time: 0.480000 Oct 19 01:04:44.433248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2101/4106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:43 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 1297 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:45.460113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:45.462863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:45.476161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:45.477890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:45.479569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:45.481787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:45.483723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:45.494237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:45.578935 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 HTTP/1.1 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1d3fd277-291a-4b0a-8265-b2ff8593edd1'} Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:45.580501 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:04:45.584709 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:04:45.590103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:04:45.595793 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51819c8c-5ce3-4238-9fb7-26515384bbb8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 404 len: 111 microversion: 2.1 time: 0.143508 Oct 19 01:04:45.603985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2006/4107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:45 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:04:45.610680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41ec828f-2222-408e-b7bc-dfff3740a42b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af5082040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:46.979669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41ec828f-2222-408e-b7bc-dfff3740a42b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 204 len: 0 microversion: 2.1 time: 1.373758 Oct 19 01:04:46.983890 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2102/4108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:45 2022] DELETE /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 0 bytes in 1376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:46.997966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:46.999657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:47.021774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:47.022413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:47.022883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:47.033234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:47.034002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:47.034663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:47.132494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:47.439508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-274c8f71-b07d-408a-828b-2b7e5fab907a tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 204 len: 0 microversion: 2.1 time: 0.452612 Oct 19 01:04:47.441532 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2007/4109] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:46 2022] DELETE /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:47.553761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1410201594", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:47.665308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] validate_networks() for [('efe452ee-8fd5-43a6-8b4e-0de7df8dd8b9', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:04:50.443483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:04:50.444671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:04:50.445344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:04:50.446029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:04:50.446805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:04:50.477677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:50.478399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:50.479009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:50.485629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:50.487686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:50.490387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:50.535213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:04:50.550104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Getting quotas for user 1f062f2ecc0547ae960ed98e7aeef9ee and project d0a15ec11a0f4e33941010967cdc55f3. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:04:50.622320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:04:50.631737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:04:50.840120 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f7352a6-0a27-4435-99ca-674b530fcb22 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.285799 Oct 19 01:04:50.845210 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2103/4110] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:04:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:04:50.854225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-970f46df-2e41-42fb-aed5-814fe5a69c57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:50.854939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-970f46df-2e41-42fb-aed5-814fe5a69c57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:51.131506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-970f46df-2e41-42fb-aed5-814fe5a69c57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:51.147439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-970f46df-2e41-42fb-aed5-814fe5a69c57 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1208 microversion: 2.1 time: 0.297839 Oct 19 01:04:51.173969 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2008/4111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:50 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1208 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:52.171778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d7731949-31e6-43ea-8c0b-11b1657d7551 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:52.172395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d7731949-31e6-43ea-8c0b-11b1657d7551 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:52.436052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d7731949-31e6-43ea-8c0b-11b1657d7551 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:52.453717 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d7731949-31e6-43ea-8c0b-11b1657d7551 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1208 microversion: 2.1 time: 0.285729 Oct 19 01:04:52.462198 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2104/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:52 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1208 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:52.874532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c88bb725-a093-4084-a90e-3b9a1f27e4ca", "name": "network-vif-deleted", "tag": "89fd1642-8e5c-4280-9f1d-0194c1c82dd0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:04:52.913299 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:52.922686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:52.925977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:52.930407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:53.005887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] Creating event network-vif-deleted:89fd1642-8e5c-4280-9f1d-0194c1c82dd0 for instance c88bb725-a093-4084-a90e-3b9a1f27e4ca on n-h1-master-1 Oct 19 01:04:53.034238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2bf57ecb-f293-46cf-97e7-ffab198d7dc1 req-19623c57-b89f-4449-a709-881ba130e9c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161054 Oct 19 01:04:53.038232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2009/4113] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:04:53.489414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:53.493098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:53.505396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:53.508039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:53.508497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:53.512666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:53.513357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:53.513983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:53.924411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:53.943995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4e20711-38a8-43cd-883d-4fad7524a424 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1260 microversion: 2.1 time: 0.458320 Oct 19 01:04:53.944594 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2105/4114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:53 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1260 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:54.972553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:54.973572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:54.994838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:54.995522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:54.996580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:54.997437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:54.998032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:55.001425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:55.416682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:55.435220 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8521d31f-4108-43bf-819a-6e4ce9e77218 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1266 microversion: 2.1 time: 0.467178 Oct 19 01:04:55.445019 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2010/4115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:54 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1266 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:56.462737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:56.463370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:56.468304 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:56.497537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:56.500465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:56.502929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:56.506252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:56.506954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:56.507559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:56.775922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:56.792951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6951aa6b-b4d7-4572-bb5a-7c1818e6ae9d tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1266 microversion: 2.1 time: 0.334201 Oct 19 01:04:56.793768 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2106/4116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:56 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1266 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:57.816842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:57.819273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:57.846625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:57.847431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:57.847924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:57.848712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:57.851252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:57.851775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:57.901489 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:58.346622 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:04:58.362246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-359f4510-de77-4901-bd94-4d42ebc16732 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.547552 Oct 19 01:04:58.362990 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2011/4117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:57 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:04:58.528027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:58.531045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:58.570217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:58.570731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:58.571256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:58.571942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:58.572686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:58.573312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:58.734252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21445faf-bc5b-441c-a600-528b18139f4d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216396 Oct 19 01:04:58.753439 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2107/4118] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:04:58 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 25 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:04:58.985604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:58.989420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:59.012298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.017993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.020119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.021593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.023939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.025805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.096380 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f55b7cd8-b0f5-4d51-9d50-7cb62bd70d0b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115801 Oct 19 01:04:59.104705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2012/4119] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:04:58 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:04:59.194133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:59.196535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:59.215174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.217314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.217776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.220196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.220746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.221193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.310346 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:04:59.384753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:59.385796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:59.403951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.405638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.407968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.411498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.413467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.415538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.443176 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:04:59.513523 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-477c5038-6d88-4417-b1e3-13f722cbfaef tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 204 len: 0 microversion: 2.1 time: 0.327339 Oct 19 01:04:59.516669 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2108/4120] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:04:59 2022] DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:04:59.529433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:04:59.533734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:04:59.545888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.547969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.550197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:04:59.551235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:04:59.553166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:04:59.554421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:00.515846 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:00.841973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:00.858625 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5d8daa5-4ff6-4133-8fb8-77f48905907d tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1673 microversion: 2.1 time: 1.334966 Oct 19 01:05:00.860174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2109/4121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:59 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1673 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:01.050869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:01.071068 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43966071-c496-4b34-98e5-f211c7103333 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 1.690034 Oct 19 01:05:01.071674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2013/4122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:04:59 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:01.894152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:01.894788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:01.930587 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:01.938752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:01.939269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:01.939727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:01.940458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:01.940986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:01.952612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:02.225969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6ac133-36e3-4100-8ac9-f20a82b39999", "tag": "75270598-a272-4027-a82e-1adc600ef9e4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:02.242745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:02.243612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:02.244411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:02.274653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] Creating event network-changed:75270598-a272-4027-a82e-1adc600ef9e4 for instance ec6ac133-36e3-4100-8ac9-f20a82b39999 on n-h2-master-1 Oct 19 01:05:02.300937 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-796e98de-b903-4e9d-8bae-7305b46c057e req-89cc5c40-1127-42d2-b8d6-937e51186112 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.522031 Oct 19 01:05:02.302250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2110/4123] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:05:02.309864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:02.311225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:02.331164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:02.335144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:02.335601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:02.336351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:02.344647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:02.345563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:02.448281 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:03.184468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:03.192575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30c33d10-a0d8-4272-8ec7-a65a91746003 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1673 microversion: 2.1 time: 1.309327 Oct 19 01:05:03.201617 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2014/4124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:01 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1673 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:03.262220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:03.287948 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1827d4a1-ad8d-4226-9c30-b65163a9b7b5 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.983812 Oct 19 01:05:03.292935 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2111/4125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:02 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:04.235104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:04.236468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:04.262264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:04.269282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:04.271959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:04.273289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:04.276866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:04.279211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:04.333199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:04.333947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:04.356003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:04.356435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:04.362515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:04.363289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:04.367993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:04.368483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:04.709329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:04.725876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9bae0078-a56e-4b66-b638-44c66fb3ec96 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1605 microversion: 2.1 time: 0.496125 Oct 19 01:05:04.726828 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2015/4126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:04 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1605 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:04.860856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:04.871295 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-412a04d5-ede6-41e6-9aea-0476546903c3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.547645 Oct 19 01:05:04.872016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2112/4127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:04 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:05.582603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "248ef2fa-d5e2-4fb1-92b2-bf483ae86b16", "name": "network-vif-deleted", "tag": "004a82f9-5338-45ac-ab2f-e93f21a99e4f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:05.635449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.637209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.638582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:05.676379 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] Creating event network-vif-deleted:004a82f9-5338-45ac-ab2f-e93f21a99e4f for instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 on n-h1-master-1 Oct 19 01:05:05.690391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-554e6b25-c0c5-4cef-ab27-dd44e1499dc4 req-162fbfd4-f6b0-407a-a5cf-f4cda3cdd64a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112540 Oct 19 01:05:05.692848 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2016/4128] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:05.756635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:05.757860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:05.772187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.780941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.781690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:05.785942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.786684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.790696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:05.886309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.889286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.889944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:05.890745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lazy-loading 'fault' on Instance uuid 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:05:05.900293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:05.901552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:05.919822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.921032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.921860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:05.924331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:05.926471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:05.927450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:06.158077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098f448796ff4635ac6b4b7262bf6ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa2d47392564feabc36c67f7382cddf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:06.168754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-485f396c-7d79-459a-8bef-3192b2b87f76 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 200 len: 1327 microversion: 2.1 time: 0.416989 Oct 19 01:05:06.169408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2113/4129] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:05 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 1327 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:06.821441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:06.831620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5aa18b8-bda2-4d69-acb9-936721aa3e8f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.935973 Oct 19 01:05:06.840004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2017/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:05 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:07.203721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:07.204576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:07.218636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.219056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.219502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.233255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.233799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.234316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.272983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 HTTP/1.1 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '248ef2fa-d5e2-4fb1-92b2-bf483ae86b16'} Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:07.293219 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb09d7c4-2992-4dfe-9df2-36af2e8c4e58 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 404 len: 111 microversion: 2.1 time: 0.095064 Oct 19 01:05:07.301341 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2114/4131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:07 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:07.307137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea50a1d1-2888-4e88-9b4e-229995fddf34 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '.version_select at 0x7f2af42405e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:07.367686 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea50a1d1-2888-4e88-9b4e-229995fddf34 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526048289" status: 202 len: 0 microversion: 2.1 time: 0.064057 Oct 19 01:05:07.368551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2018/4132] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:05:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526048289 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:05:07.794337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:07.795447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:07.828373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.828958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.829417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.830169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.830632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.831064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.876041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:07.876041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:07.895993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.896879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.897533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.898961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:07.902465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:07.903211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:07.926349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84537a3a-6a08-45b2-ab90-e98fcf02edd4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments/f505426e-1994-48aa-9263-e4b5022ca7ac" status: 200 len: 194 microversion: 2.20 time: 0.141992 Oct 19 01:05:07.927697 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2115/4133] 10.222.0.27 () {60 vars in 1454 bytes} [Wed Oct 19 01:05:07 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments/f505426e-1994-48aa-9263-e4b5022ca7ac => generated 194 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:08.286351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-446206344", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "bc2a91cd-9f77-410c-bcdc-2da7372dd82f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:08.338256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:08.366416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b0b242a-be90-4976-8d19-f9b44280c628 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.498941 Oct 19 01:05:08.375601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2019/4134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:07 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:08.389364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:08.391516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:08.423087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:08.423608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:08.424068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:08.425787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:08.427136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:08.428368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:08.486552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] validate_networks() for [('bc2a91cd-9f77-410c-bcdc-2da7372dd82f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:05:08.701481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lazy-loading 'services' on Instance uuid 0d3db501-5534-43da-a1da-262169ee3c87 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:05:08.914618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9194896-2ea0-4497-a14b-e24dd3298f46 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments/f505426e-1994-48aa-9263-e4b5022ca7ac" status: 202 len: 0 microversion: 2.20 time: 0.537121 Oct 19 01:05:08.922361 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2020/4135] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Oct 19 01:05:08 2022] DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments/f505426e-1994-48aa-9263-e4b5022ca7ac => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:05:08.928279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:08.953918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:08.999219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:09.007492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:09.009420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:09.014235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:09.018135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:09.020475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:09.125128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c63a2695-04f6-48d0-b324-f51a03bcbd81 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.201061 Oct 19 01:05:09.139943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2021/4136] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:08 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:09.394811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:09.395438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:09.406900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:09.410154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:09.411449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:09.413296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:09.414593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:09.415898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:10.157226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:10.168462 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8c26030-9ccb-4169-8965-131e7f19d782 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.778184 Oct 19 01:05:10.190357 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2022/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:09 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:10.202788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:10.211800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:10.239570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:10.242788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:10.243769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:10.245915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:10.249696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:10.250968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:10.388221 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ceb485d2-c6a9-486e-8de6-84ba7a645b2c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.196039 Oct 19 01:05:10.402149 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2023/4138] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:10 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:10.779345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:05:10.780069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:05:10.780559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:05:10.781055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:05:10.781479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:05:10.831923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:10.835205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:10.836014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:10.846853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:10.848096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:10.852860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:10.945471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Getting quotas for project 88b704bc24504b6baecfe8bcf1ca9b39. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:05:10.991605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Getting quotas for user 35a7ced563ae4a2da6fb2c7b317e336e and project 88b704bc24504b6baecfe8bcf1ca9b39. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:05:11.072779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:05:11.096039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:05:11.197965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:11.200411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:11.252383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:11.253214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:11.255480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:11.258000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:11.259538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:11.260115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:11.309972 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77e14558-705f-4926-abcc-81ea566ce606 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.380563 Oct 19 01:05:11.321077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2116/4139] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:05:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:05:11.334262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8733be85-4dbc-4188-9128-896d2716535f tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:11.335307 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8733be85-4dbc-4188-9128-896d2716535f tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:12.224608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8733be85-4dbc-4188-9128-896d2716535f tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:12.236129 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8733be85-4dbc-4188-9128-896d2716535f tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1224 microversion: 2.1 time: 0.913671 Oct 19 01:05:12.250795 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2117/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:11 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1224 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:12.271881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:12.294897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:12.324017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:12.343581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:12.344070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:12.344952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:12.345415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:12.366635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:12.491546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa50081d-6e0d-43a8-b695-456cda34f5d6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.238647 Oct 19 01:05:12.492126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2118/4141] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:12 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:12.567342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:12.593581 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-597bcce2-13ec-4a90-b87d-f34b3cf77b02 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 1.397459 Oct 19 01:05:12.624048 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2024/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:11 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:13.278226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:13.278839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:13.299345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.299843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.300284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.301026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.301480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.301898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.504938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:13.507087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:13.523884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.524508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.524901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.525538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.526526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.526972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.607554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:13.621544 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea68643b-bbea-4721-a2c2-6fa4a658d1a3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1276 microversion: 2.1 time: 0.344208 Oct 19 01:05:13.623296 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2119/4143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:13 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1276 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:13.646420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:13.647042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:13.653230 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-456de24a-b44a-477b-bcf3-0ee107b28dba tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.152405 Oct 19 01:05:13.657858 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2025/4144] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:13 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:13.661321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.664383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.665030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.665919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:13.677381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:13.678080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:13.980570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:14.002702 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9eb1f74b-7d63-46c8-985b-927b1b679bb7 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.378074 Oct 19 01:05:14.004489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2120/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:13 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:14.650288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:14.650984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:14.652429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6ac133-36e3-4100-8ac9-f20a82b39999", "name": "network-vif-plugged", "status": "completed", "tag": "75270598-a272-4027-a82e-1adc600ef9e4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:14.666050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:14.666611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:14.667069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:14.679021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:14.679423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:14.679923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:14.680167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:14.684204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:14.693155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:14.730056 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] Creating event network-vif-plugged:75270598-a272-4027-a82e-1adc600ef9e4 for instance ec6ac133-36e3-4100-8ac9-f20a82b39999 on n-h2-master-1 Oct 19 01:05:14.745594 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7fc7579e-2cd7-4cf8-94fb-9abec597f784 req-7a2177ee-de7c-48e4-ac17-586c715d509d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.837750 Oct 19 01:05:14.750148 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2026/4146] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:05:14.763869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:14.777461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:14.800550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:14.801793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:14.808893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:14.810498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:14.812703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:14.815422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:14.936547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:14.964764 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7ab9b4b-baf3-43b5-a025-bceea5c0ff9a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.211256 Oct 19 01:05:14.967546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2027/4147] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:14 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:14.979641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c2273eed-dfce-464b-85c5-449b8e0b3aff tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1282 microversion: 2.1 time: 0.332330 Oct 19 01:05:14.985776 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2121/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:14 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1282 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:15.030565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:15.031469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:15.052150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:15.053114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:15.053260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:15.060952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:15.061463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:15.076335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:15.488557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:15.497594 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68823d5f-f918-4fb9-b837-035513391187 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1308 microversion: 2.1 time: 0.472874 Oct 19 01:05:15.500907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2028/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:15 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:15.986295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:15.992042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:16.012664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:16.014522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:16.020392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.021416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.026446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:16.031836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.036061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.036900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.042445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:16.056672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.060797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:16.071155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.119659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.121045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:16.187199 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:16.236284 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db636b2e-dd78-4781-9ea8-2185ef4b02b0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.259951 Oct 19 01:05:16.244027 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2122/4150] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:15 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:16.436130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:16.450450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b3f12e0-3d24-41e7-86ec-d02587fd07a8 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1282 microversion: 2.1 time: 0.443002 Oct 19 01:05:16.452835 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2029/4151] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:16 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1282 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:16.529096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:16.529965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:16.542637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.543384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.544799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:16.549119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:16.549794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:16.550473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.151514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:17.161022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae014152-7b24-4611-8ea7-af57853aa4d2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1488 microversion: 2.1 time: 0.636558 Oct 19 01:05:17.164358 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2123/4152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:16 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1488 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:17.188576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1588323945"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:17.192412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:17.209944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.210771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.211902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.216461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.217274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.224726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.255723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:17.258491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:17.280332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.289259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.289884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.296944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.297636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.298230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.419493 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26d7f90d-48d8-4b77-8d93-88cd2a1e9719 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.167759 Oct 19 01:05:17.426121 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2124/4153] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:17 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:17.486298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:17.493951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:17.517770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.518286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.518732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.519460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:17.531037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:17.531666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:17.961361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:17.974783 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-571e974b-cd4a-49c5-b6d2-253c630f5623 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "POST /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999/action" status: 202 len: 0 microversion: 2.1 time: 0.790352 Oct 19 01:05:17.975821 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2030/4154] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:05:17 2022] POST /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999/action => generated 0 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:05:17.985434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3ea18ca-16ce-4e13-8d9a-9d746bfdb903 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 0.501720 Oct 19 01:05:17.986737 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2125/4155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:17 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:17.995643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-195c5269-bd1f-45ed-b80a-8dafb00fb243 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af497fe50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.125453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-195c5269-bd1f-45ed-b80a-8dafb00fb243 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc" status: 200 len: 1412 microversion: 2.1 time: 0.141222 Oct 19 01:05:18.126284 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2031/4156] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:17 2022] GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc => generated 1412 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:18.142142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d401b763-b627-43fa-a2e3-db915ee4a957 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4586af0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.240088 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d401b763-b627-43fa-a2e3-db915ee4a957 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc" status: 200 len: 1412 microversion: 2.1 time: 0.102928 Oct 19 01:05:18.241035 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2126/4157] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:18 2022] GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:18.257367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-beda05f3-624c-482d-9617-ee216943215c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af4a27700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.434661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.437970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:18.462393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:18.465416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:18.467506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:18.471116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:18.473566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:18.474526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:18.569577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-beda05f3-624c-482d-9617-ee216943215c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc" status: 204 len: 0 microversion: 2.1 time: 0.317730 Oct 19 01:05:18.570623 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2032/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:18 2022] DELETE /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:05:18.581882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84efddae-124a-4a79-a6c2-4fe8697bd39c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af42ac310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.621531 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-84efddae-124a-4a79-a6c2-4fe8697bd39c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84efddae-124a-4a79-a6c2-4fe8697bd39c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc HTTP/1.1 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '65cb3525-a4de-4790-a356-c67010ea0edc'} Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 65cb3525-a4de-4790-a356-c67010ea0edc Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 19 01:05:18.627234 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65cb3525-a4de-4790-a356-c67010ea0edc could not be found. Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:18.632319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84efddae-124a-4a79-a6c2-4fe8697bd39c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:18.637466 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-84efddae-124a-4a79-a6c2-4fe8697bd39c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc" status: 404 len: 62 microversion: 2.1 time: 0.060376 Oct 19 01:05:18.639582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2033/4159] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:18 2022] GET /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:18.646748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5da15cd6-9534-4424-aafd-70dfe068bb29 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.218680 Oct 19 01:05:18.657599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:18.658924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:18.666515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:18.667933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:18.668812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:18.669895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:18.670889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:18.671516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:18.675498 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2127/4160] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:18 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:18.939728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:18.952829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-197c5078-35b1-4cf0-8d83-1b44f78bb8e8 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1500 microversion: 2.1 time: 0.308676 Oct 19 01:05:18.961050 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2034/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:18 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:19.016079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:19.017108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:19.027181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:19.027696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:19.028140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:19.028885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:19.029342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:19.029775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:19.299845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:19.304317 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:19.311591 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-759e66f1-8142-4eb3-b6a5-8d5c22536425 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 0.299395 Oct 19 01:05:19.313019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2128/4162] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:19 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:19.668016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:19.674950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:19.694146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:19.711369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:19.711997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:19.714060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:19.714686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:19.717040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:19.782576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe7d26af-d120-4c20-bd51-50ca31bc1b3a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.125672 Oct 19 01:05:19.785762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2035/4163] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:19 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:19.990534 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:19.990643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:20.007708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.009542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.010155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.014392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.016099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.017185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.035096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99377326-716f-4d66-8957-60e09d66d29e", "tag": "9e475c2c-dc0a-471e-9328-7e3ca130c85c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:20.066978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.070257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.071891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.127583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] Creating event network-changed:9e475c2c-dc0a-471e-9328-7e3ca130c85c for instance 99377326-716f-4d66-8957-60e09d66d29e on n-h1-master-1 Oct 19 01:05:20.140212 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ba6951f7-d684-466f-b738-56c9508ccbf6 req-c225a1f2-65d4-4e67-8c83-0f7140139a8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109934 Oct 19 01:05:20.142826 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2036/4164] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:20.341114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:20.342373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:20.373747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.375479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.378893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.380877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.383154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.383619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.903700 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:20.924287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:20.939395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-669705c6-c2de-471a-99df-79665f647a9f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1506 microversion: 2.1 time: 0.956333 Oct 19 01:05:20.945742 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2129/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:19 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1506 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:20.951980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:20.959579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:20.981523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.986142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.987930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:20.988979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:20.991282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:20.991958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:21.088086 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-658b4fcb-8195-42c3-a5af-6ac203811d63 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139637 Oct 19 01:05:21.090246 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2130/4166] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:20 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:05:21.971273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:21.972411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:21.983984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:21.987632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:21.995487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:21.995682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.002137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.002821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.003424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.011605 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a08ebf7-82d9-4123-94ff-16c4e417c849 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 1.671395 Oct 19 01:05:22.013628 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2037/4167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:20 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:22.113184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:22.118497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:22.128194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.129067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.130295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.132206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.133039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.134150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.214368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22505e45-ab76-44c6-ae0d-a2242a387195 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.111743 Oct 19 01:05:22.216282 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2038/4168] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:05:22 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:22.235338 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:22.375678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:22.377476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:22.404786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.409587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.411298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.419246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.424602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.425964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.555709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:05:22.652765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:22.674378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65461fef-fcb3-4a13-9e20-a3bb2f51f423 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1488 microversion: 2.1 time: 0.707664 Oct 19 01:05:22.678387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2131/4169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:21 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1488 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:22.701404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:22.701917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:22.725312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.730865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.731616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.732687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.733414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.734062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.783248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fc4c5ca-dcdb-4603-bd8a-bc40f34fedd5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 204 len: 0 microversion: 2.20 time: 0.409151 Oct 19 01:05:22.786842 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2039/4170] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:05:22 2022] DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:05:22.799913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:22.802727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:22.804441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:05:22.817175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.817677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.821537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.824751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:22.825431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:22.825896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:22.997669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54ba7367-abca-41d9-a33f-f82f2a032718 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 204 len: 0 microversion: 2.1 time: 0.300698 Oct 19 01:05:23.003002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2132/4171] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:22 2022] DELETE /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:05:23.013642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1ab7163-8308-4ef8-b021-824597ece540 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af93304c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:23.053671 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a1ab7163-8308-4ef8-b021-824597ece540 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1ab7163-8308-4ef8-b021-824597ece540 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc HTTP/1.1 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '65cb3525-a4de-4790-a356-c67010ea0edc'} Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 65cb3525-a4de-4790-a356-c67010ea0edc to delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 65cb3525-a4de-4790-a356-c67010ea0edc could not be found. Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.055581 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1ab7163-8308-4ef8-b021-824597ece540 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1ab7163-8308-4ef8-b021-824597ece540 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc" status: 404 len: 62 microversion: 2.1 time: 0.049290 Oct 19 01:05:23.066377 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2133/4172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:23 2022] DELETE /compute/v2.1/images/65cb3525-a4de-4790-a356-c67010ea0edc => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 19 01:05:23.083485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:23.084549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:23.093273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:23.093979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:23.094731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:23.095680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:23.096856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:23.097623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:23.825658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:23.836059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:23.838609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:23.841201 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d70c8d4-69d6-447b-b34d-2dfc7362380b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 1.050102 Oct 19 01:05:23.863641 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2040/4173] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:22 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:23.868754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:23.874117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:23.879815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:23.884411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:23.887985 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-82d7308f-12d7-4acf-acd4-695ed2aa26e0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 0.827838 Oct 19 01:05:23.888491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:23.889223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:23.890184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:23.890876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:23.893380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:23.908763 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2134/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:23 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:23.967967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:05:24.111656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Instance is already in deleting state, ignoring this request Oct 19 01:05:24.112600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad004830-c1fe-45f0-a137-6ea65a046caf tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 204 len: 0 microversion: 2.1 time: 0.247662 Oct 19 01:05:24.113529 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2041/4175] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:23 2022] DELETE /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:05:24.121597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:24.122233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:24.133802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.134303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.136538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:24.138979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.152012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.152710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:24.619209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:24.632846 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4200753-52e2-4045-b17c-f4e5ca024cd3 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1494 microversion: 2.1 time: 0.511020 Oct 19 01:05:24.633840 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2135/4176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:24 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1494 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:24.868673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:24.870005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:24.877275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.878005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.878617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:24.879539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.880163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.880856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:24.915340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:24.916788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:24.931436 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:05:24.931904 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e (ip 10.222.0.27) !!! Oct 19 01:05:24.934626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.941231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.946960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:24.948856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:24.953250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:24.953927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:25.566781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:25.583644 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c726e59-579e-44c1-bf5e-9e0bdb05c124 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 0.672135 Oct 19 01:05:25.605534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2136/4177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:24 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:25.674852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:25.676305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:25.691870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:25.692379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:25.697027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:25.699027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:25.699670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:25.700257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:27.075658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:27.097509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5d4104a-75ba-4e8a-a89b-9032d35e0a97 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1452 microversion: 2.1 time: 1.432776 Oct 19 01:05:27.103063 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2137/4178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:25 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1452 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:27.111035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6ac133-36e3-4100-8ac9-f20a82b39999", "name": "network-vif-plugged", "status": "completed", "tag": "75270598-a272-4027-a82e-1adc600ef9e4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:27.123298 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:27.195131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:27.198389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:27.199637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:27.223975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] Creating event network-vif-plugged:75270598-a272-4027-a82e-1adc600ef9e4 for instance ec6ac133-36e3-4100-8ac9-f20a82b39999 on n-h2-master-1 Oct 19 01:05:27.231540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f7380b24-6aa1-48d5-8523-dafe7ee9b662 req-939e5b6e-5adc-4992-8250-3a8c79ea2f9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126946 Oct 19 01:05:27.239051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2138/4179] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:27.281782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:27.282907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:27.294023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:27.295019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:27.295703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:27.297212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:27.297919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:27.298620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:27.369016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:27.399683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:27.413843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:27.419386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44327fbd-eec8-46b4-832d-4f1ab6d1ead5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 2.555679 Oct 19 01:05:27.444781 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2042/4180] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:24 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:27.493739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6ac133-36e3-4100-8ac9-f20a82b39999", "name": "network-vif-deleted", "tag": "75270598-a272-4027-a82e-1adc600ef9e4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:27.534083 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:27.539234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:27.539732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:27.540174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:27.600298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] Creating event network-vif-deleted:75270598-a272-4027-a82e-1adc600ef9e4 for instance ec6ac133-36e3-4100-8ac9-f20a82b39999 on n-h2-master-1 Oct 19 01:05:27.618971 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c0ea4fe4-ca41-466b-830b-f15ca3e66fe2 req-b2dfee7d-40d3-423a-905f-06999d88f382 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169312 Oct 19 01:05:27.623605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2043/4181] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:28.124216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:28.125007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:28.145497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:28.149517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:28.150805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:28.155867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:28.183021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:28.205122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:28.367644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:28.371317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:28.386529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:28.390392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lazy-loading 'fault' on Instance uuid ec6ac133-36e3-4100-8ac9-f20a82b39999 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:05:28.973612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f062f2ecc0547ae960ed98e7aeef9ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0a15ec11a0f4e33941010967cdc55f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:28.999689 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f906d56-528f-48cc-ad3d-40a6bd5a312c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 200 len: 1298 microversion: 2.1 time: 0.881065 Oct 19 01:05:29.003546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2044/4182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:28 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 1298 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:05:29.019030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:29.019884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:29.054305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:29.054702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:29.055161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:29.057032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:29.058200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:29.058798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:29.462362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:29.480883 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6ae2a81-c5d2-4192-b6be-e26d2d429d96 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 2.214925 Oct 19 01:05:29.482147 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2139/4183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:27 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:29.912935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:29.918301 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:29.931201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-unplugged", "status": "completed", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:29.947944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:29.954501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:29.961539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:29.964105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:29.965034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:29.966791 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d1f2c35e-81b2-4a45-9210-6bfda91cb209 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.956483 Oct 19 01:05:29.992762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2045/4184] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:29 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:30.026391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.027517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: ec6ac133-36e3-4100-8ac9-f20a82b39999] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.054590 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] Creating event network-vif-unplugged:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h2-master-1 Oct 19 01:05:30.064290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.065765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.068533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.073780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.075758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-23220610-c339-4215-b89f-aba920f18cd6 req-d82ab899-3ec9-4be6-88af-66b072dfab53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148453 Oct 19 01:05:30.076481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.077198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.081681 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2140/4185] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:30.114387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 HTTP/1.1 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ec6ac133-36e3-4100-8ac9-f20a82b39999'} Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.116487 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. Oct 19 01:05:30.121095 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.124864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance ec6ac133-36e3-4100-8ac9-f20a82b39999 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.126024 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c214091e-a407-4493-b1f9-3e98b04947c2 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999" status: 404 len: 111 microversion: 2.1 time: 0.104162 Oct 19 01:05:30.127115 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2046/4186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] GET /compute/v2.1/servers/ec6ac133-36e3-4100-8ac9-f20a82b39999 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:05:30.135887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.136722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.147907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.148875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.149548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.150549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.151302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.151965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.191107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 HTTP/1.1 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '1d3fd277-291a-4b0a-8265-b2ff8593edd1'} Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.193072 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.196916 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.202442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.209968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0ce18a7-c11c-417e-b427-174f49a0043b tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 404 len: 111 microversion: 2.1 time: 0.078620 Oct 19 01:05:30.210906 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2141/4187] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.219328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.220346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 1d3fd277-291a-4b0a-8265-b2ff8593edd1] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.232269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.235114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.235851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.236835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.237728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.240540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.269225 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 HTTP/1.1 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1d3fd277-291a-4b0a-8265-b2ff8593edd1'} Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.281469 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. Oct 19 01:05:30.285730 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.287594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance 1d3fd277-291a-4b0a-8265-b2ff8593edd1 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.288776 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-711a48de-4cc8-49da-9153-01d69c9b33d1 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1" status: 404 len: 111 microversion: 2.1 time: 0.073431 Oct 19 01:05:30.289920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2047/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] GET /compute/v2.1/servers/1d3fd277-291a-4b0a-8265-b2ff8593edd1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.298758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-841af908-e724-4dfa-8f36-a9cf13c28efb tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af458ad30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.357369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-841af908-e724-4dfa-8f36-a9cf13c28efb tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-841af908-e724-4dfa-8f36-a9cf13c28efb tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 HTTP/1.1 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0864f3ae-6e1d-4716-8480-31b3b6b0a020'} Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0864f3ae-6e1d-4716-8480-31b3b6b0a020 to delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0864f3ae-6e1d-4716-8480-31b3b6b0a020 could not be found. Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.359282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:30.364202 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.365775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-841af908-e724-4dfa-8f36-a9cf13c28efb tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.366646 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-841af908-e724-4dfa-8f36-a9cf13c28efb tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020" status: 404 len: 62 microversion: 2.1 time: 0.072001 Oct 19 01:05:30.367329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2142/4189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/images/0864f3ae-6e1d-4716-8480-31b3b6b0a020 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:30.376501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.377168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.383866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.384558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.385291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.387600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.388184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.388996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.414950 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca HTTP/1.1 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c88bb725-a093-4084-a90e-3b9a1f27e4ca'} Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.417621 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.421482 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.426262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.427448 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0d76bc5-a9f2-4ae8-81d1-d7291e6c456f tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 404 len: 111 microversion: 2.1 time: 0.055243 Oct 19 01:05:30.428807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2048/4190] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.438086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.438847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: c88bb725-a093-4084-a90e-3b9a1f27e4ca] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.452289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.453919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.457225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.458134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.458745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.459292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.490362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca HTTP/1.1 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c88bb725-a093-4084-a90e-3b9a1f27e4ca'} Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.492150 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. Oct 19 01:05:30.498512 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.503836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.504583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.510468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance c88bb725-a093-4084-a90e-3b9a1f27e4ca could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.513007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.514168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09216f88-516d-4f89-a1fa-31c9e83a5800 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca" status: 404 len: 111 microversion: 2.1 time: 0.079997 Oct 19 01:05:30.515436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.515854 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2143/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] GET /compute/v2.1/servers/c88bb725-a093-4084-a90e-3b9a1f27e4ca => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.516493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.517358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.526863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.530664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.539030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e815ec4-d5ef-4490-94be-2aba87228625 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af428c670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.592871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8e815ec4-d5ef-4490-94be-2aba87228625 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e815ec4-d5ef-4490-94be-2aba87228625 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 HTTP/1.1 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '209e1221-0d65-4133-a4fa-2178361ee5d8'} Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 209e1221-0d65-4133-a4fa-2178361ee5d8 to delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 209e1221-0d65-4133-a4fa-2178361ee5d8 could not be found. Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.595501 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:30.600386 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.602082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e815ec4-d5ef-4490-94be-2aba87228625 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.602931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e815ec4-d5ef-4490-94be-2aba87228625 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8" status: 404 len: 62 microversion: 2.1 time: 0.084123 Oct 19 01:05:30.604115 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2144/4192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/images/209e1221-0d65-4133-a4fa-2178361ee5d8 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:30.624002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.627796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.653699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.655801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.657261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.663114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.664596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.669237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.700261 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 HTTP/1.1 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: exception: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a584ee5c-6aa5-4946-b367-3914667196c5'} Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.702039 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.707239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.714609 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e31a33ee-bda1-441b-8457-8ef5bf0e9be0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 404 len: 111 microversion: 2.1 time: 0.106454 Oct 19 01:05:30.716790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2145/4193] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.739194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.749343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: a584ee5c-6aa5-4946-b367-3914667196c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.767009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.769748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.773586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.774741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.775539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.781413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.832522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 HTTP/1.1 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: exception: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a584ee5c-6aa5-4946-b367-3914667196c5'} Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.834792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. Oct 19 01:05:30.838815 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.846391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance a584ee5c-6aa5-4946-b367-3914667196c5 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.848779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a292525-fd7e-4009-b7d0-4036547b2b34 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5" status: 404 len: 111 microversion: 2.1 time: 0.117383 Oct 19 01:05:30.849909 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2146/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] GET /compute/v2.1/servers/a584ee5c-6aa5-4946-b367-3914667196c5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:30.858289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b282698a-5a13-4f94-bd92-d6b4c1623f5c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af93d3f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.899022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b282698a-5a13-4f94-bd92-d6b4c1623f5c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b282698a-5a13-4f94-bd92-d6b4c1623f5c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 HTTP/1.1 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: method: Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: exception: Image not found. Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '127debe8-afaa-4784-93b3-1a704cb21f91'} Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 127debe8-afaa-4784-93b3-1a704cb21f91 to delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 127debe8-afaa-4784-93b3-1a704cb21f91 could not be found. Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.900985 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.904928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b282698a-5a13-4f94-bd92-d6b4c1623f5c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:30.906341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b282698a-5a13-4f94-bd92-d6b4c1623f5c tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91" status: 404 len: 62 microversion: 2.1 time: 0.051927 Oct 19 01:05:30.909369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2147/4195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/images/127debe8-afaa-4784-93b3-1a704cb21f91 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:30.919899 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:30.920419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:30.940769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.941202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.942670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.947628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:30.948511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:30.949199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:30.981400 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 HTTP/1.1 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd1d418aa-2e73-4d69-a123-af4b9941aaf7'} Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:30.987425 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:30.992263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:30.998072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:31.000538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bae62d36-ec81-4565-b7ec-c207f16cd8aa tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 404 len: 111 microversion: 2.1 time: 0.088254 Oct 19 01:05:31.003068 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2148/4196] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:30 2022] DELETE /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:31.019050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:31.020184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:31.039196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.043544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.044270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:31.046940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.047913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.048529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:31.452285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:31.467692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:31.487568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:31.493326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a5297d80-5426-4768-95f7-4b816b95a33e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1724 microversion: 2.20 time: 0.487127 Oct 19 01:05:31.499228 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2149/4197] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:31 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:31.519408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:31.526815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: d1d418aa-2e73-4d69-a123-af4b9941aaf7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:31.556815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.557446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.560999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:31.561797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.569968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.570440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:31.627786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:31.642285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2a66754-6501-4253-bc7c-6b5658fb4dfe tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 1.142149 Oct 19 01:05:31.647467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2049/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:30 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:31.654862 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 HTTP/1.1 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd1d418aa-2e73-4d69-a123-af4b9941aaf7'} Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.659188 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. Oct 19 01:05:31.667064 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.678242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance d1d418aa-2e73-4d69-a123-af4b9941aaf7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:31.681237 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20b86105-aee3-4d37-b14b-a84faa31f1a0 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7" status: 404 len: 111 microversion: 2.1 time: 0.178956 Oct 19 01:05:31.683135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2150/4199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:31 2022] GET /compute/v2.1/servers/d1d418aa-2e73-4d69-a123-af4b9941aaf7 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:31.693536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d92ca37-fe17-43ec-a3cc-e05aafffbe08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '.version_select at 0x7f2af434a310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:31.739042 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0d92ca37-fe17-43ec-a3cc-e05aafffbe08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Image not found. Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d92ca37-fe17-43ec-a3cc-e05aafffbe08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 HTTP/1.1 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: method: Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: exception: Image not found. Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1fa324ae-280d-4ab7-b66d-8d54d6f51028'} Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1fa324ae-280d-4ab7-b66d-8d54d6f51028 to delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1fa324ae-280d-4ab7-b66d-8d54d6f51028 could not be found. Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.741492 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 19 01:05:31.747030 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:31.749634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d92ca37-fe17-43ec-a3cc-e05aafffbe08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Image not found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:31.750659 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d92ca37-fe17-43ec-a3cc-e05aafffbe08 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028" status: 404 len: 62 microversion: 2.1 time: 0.063588 Oct 19 01:05:31.751364 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2050/4200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:31 2022] DELETE /compute/v2.1/images/1fa324ae-280d-4ab7-b66d-8d54d6f51028 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:31.760520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:31.761457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:31.776145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.784509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.785306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:31.786431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:31.788884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:31.789638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:32.496868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99377326-716f-4d66-8957-60e09d66d29e", "name": "network-vif-plugged", "status": "completed", "tag": "9e475c2c-dc0a-471e-9328-7e3ca130c85c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:32.542660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:32.549720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:32.550312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:32.579443 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] Creating event network-vif-plugged:9e475c2c-dc0a-471e-9328-7e3ca130c85c for instance 99377326-716f-4d66-8957-60e09d66d29e on n-h1-master-1 Oct 19 01:05:32.622477 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e8083868-d3a0-4ab2-a4b9-97bd4abc11b1 req-eb695a47-3ef5-4b3d-981a-e101739ef5b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125191 Oct 19 01:05:32.630564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2051/4201] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:32.648103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:32.650786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:32.663517 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 HTTP/1.1 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '9276ba46-49f5-405b-af88-c0e926b5a630'} Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:32.674840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:32.679959 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:32.683365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:32.684463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26ae26d4-529b-41e8-bbdb-7a953eb84e42 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 404 len: 111 microversion: 2.1 time: 0.928519 Oct 19 01:05:32.685653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2151/4202] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:31 2022] DELETE /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 111 bytes in 930 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:32.693714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:32.695714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:32.696656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:32.699329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:32.700012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:32.703782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:32.704587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:32.705375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:32.705825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:32.706350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:32.706803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:32.707481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:32.708199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:32.708691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:33.700924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:33.732102 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:33.735013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:33.736740 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97c26a14-a6d0-40e4-bcd9-5ba188f25e39 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1656 microversion: 2.20 time: 1.102770 Oct 19 01:05:33.737633 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2052/4203] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:32 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1656 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:33.747725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:33.749071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] [instance: 9276ba46-49f5-405b-af88-c0e926b5a630] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:33.758900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:33.760924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:33.761780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:33.762958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:33.763679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:33.764331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:33.791217 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] HTTP exception thrown: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Request method failure captured: Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 HTTP/1.1 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0v2-Qucgv9ZUebaaa5ghhC_vh5Tf6fS_6EFhbNpTYyPjcCKNX0q7ihueDwGrmWQCdZVYWq8GkiM1kxdXg3jXeEpRHQ4to7LbgHXSlyOOtq9dPqQuaLWUVlFI5arpZZpBtiuMjMvnDnOFrg5wUb4vMLqxwIliAgYmoFFbPCiPU1qGeY Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d0a15ec11a0f4e33941010967cdc55f3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d0a15ec11a0f4e33941010967cdc55f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d0a15ec11a0f4e33941010967cdc55f3"}]}] Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ImagesTestJSON-630964259 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: d0a15ec11a0f4e33941010967cdc55f3 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ImagesTestJSON-630964259 Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 1f062f2ecc0547ae960ed98e7aeef9ee Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ImagesTestJSON-630964259-project Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9276ba46-49f5-405b-af88-c0e926b5a630'} Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:33.794432 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. Oct 19 01:05:33.800583 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:33.803143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] Returning 404 to user: Instance 9276ba46-49f5-405b-af88-c0e926b5a630 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:33.804979 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffe63ff9-dab3-4eac-be72-bdca906f1146 tempest-ImagesTestJSON-630964259 tempest-ImagesTestJSON-630964259-project] 10.222.0.27 "GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630" status: 404 len: 111 microversion: 2.1 time: 0.065283 Oct 19 01:05:33.806181 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2053/4204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:33 2022] GET /compute/v2.1/servers/9276ba46-49f5-405b-af88-c0e926b5a630 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:34.289193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:34.298220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5765279b-1bc0-4e29-b506-64d655ad87d1 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1324 microversion: 2.1 time: 1.610219 Oct 19 01:05:34.321737 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2152/4205] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:32 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1324 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:34.424136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d3db501-5534-43da-a1da-262169ee3c87", "name": "network-vif-deleted", "tag": "b49d8dd1-0ebc-44db-97ac-47bd85f036f5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:34.473398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:34.484990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:34.485551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:34.519160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] Creating event network-vif-deleted:b49d8dd1-0ebc-44db-97ac-47bd85f036f5 for instance 0d3db501-5534-43da-a1da-262169ee3c87 on n-h2-master-1 Oct 19 01:05:34.537537 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-661c48fa-376a-45c7-aa85-b8955e4b4800 req-3b3ca671-dd4f-4b5c-abcd-1155ccc51ce5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124371 Oct 19 01:05:34.544581 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2054/4206] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:05:34.769608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:34.770596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:34.785620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:34.786464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:34.787125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:34.790248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:34.791038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:34.793171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:34.893387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:34.894013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:34.894535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:34.897587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lazy-loading 'fault' on Instance uuid 0d3db501-5534-43da-a1da-262169ee3c87 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:05:34.907989 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:35.001968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:35.014379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:35.024468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:35.027199 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-59986cf8-cf5c-4715-84a0-c5a76fdcc532 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 200 len: 1372 microversion: 2.20 time: 0.261592 Oct 19 01:05:35.041487 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2153/4207] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:34 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 1372 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:35.350346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:35.351710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:35.371505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:35.372048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:35.376371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:35.382964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:35.384473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:35.385771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.022069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:36.037003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5dffefea-b825-4755-8bf0-c3f3910d91bf tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1521 microversion: 2.1 time: 0.691747 Oct 19 01:05:36.037795 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2055/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:35 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1521 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:36.063220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.064519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:36.065942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.068043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:36.075551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.081323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.082115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.083103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.083792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.084489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.089599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.094617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.097789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.100803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.102066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.106031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.142278 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 HTTP/1.1 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0d3db501-5534-43da-a1da-262169ee3c87'} Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.144270 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:05:36.148375 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.152991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:36.154154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e495f537-8f74-42d3-924f-a72d5ccf656f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 404 len: 111 microversion: 2.20 time: 0.095874 Oct 19 01:05:36.162268 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2154/4209] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:36 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:05:36.179084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e7cb7e-6a9f-4bbf-9125-dd79788212fc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '.version_select at 0x7f2af45049d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.220577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] HTTP exception thrown: Instance is not a member of specified network Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Request method failure captured: Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e/ips/invalid HTTP/1.1 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT01Dpj4Lcts-6hx5Ad5cAz6lCsogBAXPHKRcKVc9YkLpszTw3TAWelOOrftUO-Nq3qzhsGdnK_Z_N6ofFr1yO6MGIDvcCDOu0m96VGeRDwiemg60EeEUwPUJARykSdx5VzIKdxPHwNwzIy9iuUsolIaXjBh1MuRJYdjYBpDYkDc9wtE Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88b704bc24504b6baecfe8bcf1ca9b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}] Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 35a7ced563ae4a2da6fb2c7b317e336e Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: exception: Instance is not a member of specified network Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '99377326-716f-4d66-8957-60e09d66d29e', 'id': 'invalid'} Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 19 01:05:36.232099 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.237107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:36.238704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91ae618d-6fd8-4ac8-98a7-babbe6f7b48d tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.177242 Oct 19 01:05:36.245427 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2056/4210] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 01:05:36 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e/ips/invalid => generated 91 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:36.257251 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e7cb7e-6a9f-4bbf-9125-dd79788212fc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687956963" status: 204 len: 0 microversion: 2.20 time: 0.093445 Oct 19 01:05:36.268581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.269858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Failed to fetch instance by id 999 {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 01:05:36.270386 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2155/4211] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 01:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1687956963 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:05:36.271253 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] HTTP exception thrown: Instance 999 could not be found. Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Request method failure captured: Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT01Dpj4Lcts-6hx5Ad5cAz6lCsogBAXPHKRcKVc9YkLpszTw3TAWelOOrftUO-Nq3qzhsGdnK_Z_N6ofFr1yO6MGIDvcCDOu0m96VGeRDwiemg60EeEUwPUJARykSdx5VzIKdxPHwNwzIy9iuUsolIaXjBh1MuRJYdjYBpDYkDc9wtE Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88b704bc24504b6baecfe8bcf1ca9b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}] Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 35a7ced563ae4a2da6fb2c7b317e336e Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 999 could not be found. Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '999'} Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 19 01:05:36.276731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:36.281852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:36.282511 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4bc302c2-2737-43d9-be00-76f13b080ee0 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.033667 Oct 19 01:05:36.284453 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2057/4212] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 01:05:36 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:05:36.293855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.294612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:36.317815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.319083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.320055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.323248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.323863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.324401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.413775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:05:36.583354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f12c308-5bf4-493e-a813-4304c24437bb tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "DELETE /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 204 len: 0 microversion: 2.1 time: 0.292658 Oct 19 01:05:36.594704 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2156/4213] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:36 2022] DELETE /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:05:36.603632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:36.604360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:36.638340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.640051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.645229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:36.646878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:36.648403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:36.651171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:37.270459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:37.285306 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-854b9805-c023-43a7-9665-c90601fe7db2 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1527 microversion: 2.1 time: 0.687269 Oct 19 01:05:37.301809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2058/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:36 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1527 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:37.977249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:37.979561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:38.004163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.006401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.008008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:38.013113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.013918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.015671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:38.068675 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 HTTP/1.1 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '248ef2fa-d5e2-4fb1-92b2-bf483ae86b16'} Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:38.076751 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.081729 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.083524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:38.087977 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-107b6e7c-881c-4800-8143-d549df34586a tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 404 len: 111 microversion: 2.1 time: 0.114451 Oct 19 01:05:38.090000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2157/4215] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:37 2022] DELETE /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:38.098859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:38.100256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:38.124894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.130945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.135466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:38.136954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.137667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.138299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:38.205370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 HTTP/1.1 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '248ef2fa-d5e2-4fb1-92b2-bf483ae86b16'} Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:38.214358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:38.219388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3009888-a515-42df-8f7b-e52bda7c24f1 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16" status: 404 len: 111 microversion: 2.1 time: 0.122756 Oct 19 01:05:38.221649 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2059/4216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:38 2022] GET /compute/v2.1/servers/248ef2fa-d5e2-4fb1-92b2-bf483ae86b16 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:38.311304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:38.312104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:38.337250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.339632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.342414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:38.346331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:38.346867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:38.349337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:39.460756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:39.476239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08cf4cb7-1830-4605-8f9e-25c7d8bf5630 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1527 microversion: 2.1 time: 1.169604 Oct 19 01:05:39.476902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2158/4217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:38 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1527 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:39.940575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da8af848-c205-437b-9751-65180f5af675 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Action: 'create', calling method: .version_select at 0x7f2af4b71af0>, body: {"keypair": {"name": "tempest-keypair-622542462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1IhPX5a+s1mOuMMQBw7hn+LQ6T73M3xJ5tHzQ3QwKnj+s0Mrfr6crEDMkDZNdCN4llfh6rfQs5pfXcwlVlLHnxPX2w1TLqhNLgI8qLP5yjRN6umYb6nAqtT1lMcy5DFw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:39.973876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-da8af848-c205-437b-9751-65180f5af675 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Getting quotas for project 39c10fa11e244a629264dd733478c21b. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:05:39.990596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-da8af848-c205-437b-9751-65180f5af675 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Getting quotas for user 5ac399b59740442a93081bb1a78297b4 and project 39c10fa11e244a629264dd733478c21b. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:05:40.050289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da8af848-c205-437b-9751-65180f5af675 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.114387 Oct 19 01:05:40.053082 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2060/4218] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 01:05:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 01:05:40.505219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:40.505845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:40.524715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:40.524715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:40.525711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:40.526625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:40.527100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:40.527534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:40.803473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c164e58d-af82-43a7-97c5-d2dfca74d872 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: .version_select at 0x7f2af42d29d0>, body: {"keypair": {"name": "tempest-keypair-87234931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOx0KrPYEhCogNIbcs9ufZKPIauYE1X9LlIwgcS4gvV7v5kIGCr4eoms5s1KtSH/zt/bbBONQsDQH435R1qYCRNagrGFz6yvwCcfYz53UC/HmlUq51GCoXEMzgUDNzlPrw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:40.886194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c164e58d-af82-43a7-97c5-d2dfca74d872 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:05:40.900949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c164e58d-af82-43a7-97c5-d2dfca74d872 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for user e3d4cc70eeca421585fabdb682af7caf and project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:05:40.952567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c164e58d-af82-43a7-97c5-d2dfca74d872 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.154011 Oct 19 01:05:40.954275 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2061/4219] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 01:05:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 156 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 01:05:40.959338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99377326-716f-4d66-8957-60e09d66d29e", "name": "network-vif-deleted", "tag": "9e475c2c-dc0a-471e-9328-7e3ca130c85c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:40.982647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:40.983524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:40.984671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:41.012162 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] Creating event network-vif-deleted:9e475c2c-dc0a-471e-9328-7e3ca130c85c for instance 99377326-716f-4d66-8957-60e09d66d29e on n-h1-master-1 Oct 19 01:05:41.021134 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f6d46650-5a83-4c71-96ae-bae0d7d6eccd req-fd886b40-d795-47fe-a18f-c3c0d06b618f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065239 Oct 19 01:05:41.022451 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2062/4220] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:41.174767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7ced563ae4a2da6fb2c7b317e336e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88b704bc24504b6baecfe8bcf1ca9b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:41.183391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-754ffc5a-ff7e-4333-b05c-9ee9bf0c3ee3 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 200 len: 1485 microversion: 2.1 time: 0.682247 Oct 19 01:05:41.183980 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2159/4221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:40 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 1485 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:05:42.212352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:42.213426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] [instance: 99377326-716f-4d66-8957-60e09d66d29e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:42.225528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:42.228826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:42.229294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:42.232260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:42.232810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:42.235793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:42.267873 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] HTTP exception thrown: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Request method failure captured: Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e HTTP/1.1 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT01Dpj4Lcts-6hx5Ad5cAz6lCsogBAXPHKRcKVc9YkLpszTw3TAWelOOrftUO-Nq3qzhsGdnK_Z_N6ofFr1yO6MGIDvcCDOu0m96VGeRDwiemg60EeEUwPUJARykSdx5VzIKdxPHwNwzIy9iuUsolIaXjBh1MuRJYdjYBpDYkDc9wtE Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88b704bc24504b6baecfe8bcf1ca9b39", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88b704bc24504b6baecfe8bcf1ca9b39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88b704bc24504b6baecfe8bcf1ca9b39"}]}] Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 88b704bc24504b6baecfe8bcf1ca9b39 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1845412098 Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 35a7ced563ae4a2da6fb2c7b317e336e Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1845412098-project Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '99377326-716f-4d66-8957-60e09d66d29e'} Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:42.270731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. Oct 19 01:05:42.277119 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:42.280239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] Returning 404 to user: Instance 99377326-716f-4d66-8957-60e09d66d29e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:42.282366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-edccbe5b-1225-42e2-84c3-ca138bbe7743 tempest-ServerAddressesNegativeTestJSON-1845412098 tempest-ServerAddressesNegativeTestJSON-1845412098-project] 10.222.0.27 "GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e" status: 404 len: 111 microversion: 2.1 time: 0.075535 Oct 19 01:05:42.288681 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2063/4222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:42 2022] GET /compute/v2.1/servers/99377326-716f-4d66-8957-60e09d66d29e => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:45.231996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:45.233367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:45.258156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:45.258678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:45.259787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:45.260530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:45.261033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:45.261468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:45.280600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 HTTP/1.1 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '58c66c11-a25f-4e38-9147-4488c81b7f65'} Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:45.294637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.298851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.303083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:45.313966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-65bbb438-c53f-4d3e-875e-c82c27504f7b tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 404 len: 111 microversion: 2.1 time: 0.085762 Oct 19 01:05:45.314555 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2160/4223] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:05:45 2022] DELETE /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:45.325023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:45.325654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] [instance: 58c66c11-a25f-4e38-9147-4488c81b7f65] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:45.346711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:45.348408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:45.350607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:45.351281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:45.356064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:45.356547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:45.426962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] HTTP exception thrown: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Request method failure captured: Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 HTTP/1.1 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0u0SRo-xuLW9u5tZgdbs5sKP3pkaE-PywpdM9uoI0W4aLQu0u6XvJernHZtJOr0sZMQ9qumBRHDmULaF6yHOPc5bSHxrqTB8Ljje5tS2BZHfyYwqYs61lBzgFOqrcFs2wHRxUReT_nL0bli4a3aSkGXudXSk95Bu7XGtAVoCezOies Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_daa2d47392564feabc36c67f7382cddf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/daa2d47392564feabc36c67f7382cddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/daa2d47392564feabc36c67f7382cddf"}]}] Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: daa2d47392564feabc36c67f7382cddf Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2136478511 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 098f448796ff4635ac6b4b7262bf6ff1 Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeTestJSON-2136478511-project Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '58c66c11-a25f-4e38-9147-4488c81b7f65'} Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:05:45.428522 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. Oct 19 01:05:45.432961 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:05:45.441287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] Returning 404 to user: Instance 58c66c11-a25f-4e38-9147-4488c81b7f65 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:05:45.442804 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b58ac71d-5500-4fb6-95db-d4339d130703 tempest-AttachVolumeTestJSON-2136478511 tempest-AttachVolumeTestJSON-2136478511-project] 10.222.0.27 "GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65" status: 404 len: 111 microversion: 2.1 time: 0.123958 Oct 19 01:05:45.443755 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2064/4224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:05:45 2022] GET /compute/v2.1/servers/58c66c11-a25f-4e38-9147-4488c81b7f65 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:05:48.047999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1078859211", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0db2f078-d922-4f51-8add-ad4019011282"}, {"port": "0da738a0-f0f8-4ef5-a13f-8bf8beb69f95", "tag": "port-1"}, {"port": "721aec34-2caf-4b3d-a272-ae4a9fff87e7", "tag": "port-2"}, {"uuid": "dd120c7b-6257-4e9c-937c-25826c9390ed", "tag": "net-1"}, {"uuid": "dd120c7b-6257-4e9c-937c-25826c9390ed"}, {"uuid": "d4843ce8-e86b-4951-84ac-6bf6dfec8675", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d4843ce8-e86b-4951-84ac-6bf6dfec8675", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "33484440-0521-41f6-9eca-16b152d419fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "82ce545a-8703-4913-bd42-6127040e8eb0", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "ed33819e-8649-49f1-8f20-44083627f78f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--496580838"}], "key_name": "tempest-keypair-622542462", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:48.947456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] validate_networks() for [('0db2f078-d922-4f51-8add-ad4019011282', None, None, None, None, None), (None, None, '0da738a0-f0f8-4ef5-a13f-8bf8beb69f95', None, None, None), (None, None, '721aec34-2caf-4b3d-a272-ae4a9fff87e7', None, None, None), ('dd120c7b-6257-4e9c-937c-25826c9390ed', None, None, None, None, None), ('dd120c7b-6257-4e9c-937c-25826c9390ed', None, None, None, None, None), ('d4843ce8-e86b-4951-84ac-6bf6dfec8675', '10.2.2.100', None, None, None, None), ('d4843ce8-e86b-4951-84ac-6bf6dfec8675', '10.2.2.200', None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:05:51.378692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-167067993", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15781cc1-f605-410c-8b0d-091017a02b70"}], "security_groups": [{"name": "tempest-securitygroup--1292062713"}], "key_name": "tempest-keypair-87234931", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:05:51.426448 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:51.942140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] validate_networks() for [('15781cc1-f605-410c-8b0d-091017a02b70', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:05:55.150360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:05:55.151545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:05:55.152425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:05:55.153112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:05:55.153779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:05:55.173249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:55.174157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:55.174838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:55.175830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:55.179946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:55.181944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:55.225934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:05:55.243707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Getting quotas for user e3d4cc70eeca421585fabdb682af7caf and project 58b0d66fb5304e7ba517c2f714a7ccac. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:05:55.267240 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:55.269913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:05:55.279061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:05:55.385436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37ac0c72-425e-40d7-bbea-18cea89d100a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.011281 Oct 19 01:05:55.387788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2065/4225] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 01:05:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 4016 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 19 01:05:55.406857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bca4f491-0da3-4787-b022-e0c37eec425b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af555d1f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:55.509504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bca4f491-0da3-4787-b022-e0c37eec425b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352" status: 200 len: 662 microversion: 2.1 time: 0.112291 Oct 19 01:05:55.522750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2066/4226] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:55 2022] GET /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352 => generated 662 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:55.548963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:55.552532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:55.789413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:55.798787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:55.813828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:55.818825 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-00697f5a-f34d-41b7-87e2-d5ef75a01b35 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1279 microversion: 2.20 time: 0.291071 Oct 19 01:05:55.819680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2067/4227] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:55 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1279 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:55.830747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e9fbc00-6296-4860-a27f-a78991974097 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af48efd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:55.922861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e9fbc00-6296-4860-a27f-a78991974097 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352" status: 200 len: 662 microversion: 2.1 time: 0.099236 Oct 19 01:05:55.924844 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2068/4228] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:55 2022] GET /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:56.850955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:56.852848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:56.881243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:56.881748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:56.882190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:56.883253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:56.886941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:56.887602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:57.227457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:57.240326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:57.242922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:57.248694 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b14ce273-dbd0-4722-8b16-d4a4c8f002a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1331 microversion: 2.20 time: 0.402469 Oct 19 01:05:57.267483 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2069/4229] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:56 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1331 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:57.855174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5a68267-ddd1-44c2-9d7e-ed96f9798d5b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af555d700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:57.947377 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5a68267-ddd1-44c2-9d7e-ed96f9798d5b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc" status: 200 len: 662 microversion: 2.1 time: 0.097097 Oct 19 01:05:57.951204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2070/4230] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:57 2022] GET /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:57.967083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d52a956-8b08-4daf-8218-c5e259c61e5b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b298b0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:58.049895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d52a956-8b08-4daf-8218-c5e259c61e5b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc" status: 200 len: 662 microversion: 2.1 time: 0.091233 Oct 19 01:05:58.054216 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2071/4231] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:57 2022] GET /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:58.278067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:58.279227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:05:58.281612 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:05:58.297180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:58.297831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:58.299135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:58.302087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:05:58.302962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:05:58.303509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:05:59.032560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:59.045087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:59.057052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:05:59.060036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51830052-e684-4b75-b75d-32ebc22242de tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1337 microversion: 2.20 time: 0.789393 Oct 19 01:05:59.066705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2072/4232] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:05:58 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1337 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:05:59.732179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5521e82-3958-4d11-9644-c58643bbf0fd tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b9fdc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:59.814972 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5521e82-3958-4d11-9644-c58643bbf0fd tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f" status: 200 len: 661 microversion: 2.1 time: 0.086656 Oct 19 01:05:59.815796 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2073/4233] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:59 2022] GET /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f => generated 661 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:59.831272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d23b221b-31d5-4a6d-98ae-fd3d4d52cc5d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b29dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:05:59.890102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d23b221b-31d5-4a6d-98ae-fd3d4d52cc5d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f" status: 200 len: 661 microversion: 2.1 time: 0.063618 Oct 19 01:05:59.891185 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2074/4234] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:05:59 2022] GET /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f => generated 661 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:05:59.980325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-316582860", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:00.078821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:06:00.850893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:06:00.851593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:06:00.852316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:06:00.853271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:06:00.853910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:06:00.878034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:00.878882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:00.881123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:00.882319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:00.887507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:00.890882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:00.928849 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=63 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:00.957467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Getting quotas for project 979214475e474053bef7b2daaf4ae6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:06:00.969065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Getting quotas for user 314b17e8914f48e985e90481cd3c3a3d and project 979214475e474053bef7b2daaf4ae6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:06:01.008843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:06:01.015674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:06:01.162279 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d7e3e37-331c-4b54-b782-c68a7cb418af tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187209 Oct 19 01:06:01.166083 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2075/4235] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:05:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:06:01.181283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:01.182124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:01.202921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:01.207726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:01.208380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:01.209447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:01.210241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:01.210863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:01.358501 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:02.426779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:02.449933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:02.452752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:02.457313 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43fcfaeb-82ab-4e4f-a292-6d7e4e0f01ea tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 1.287977 Oct 19 01:06:02.458249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2076/4236] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:01 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:02.474335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-813264", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:02.589194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:06:03.127193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:06:03.127748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:06:03.128085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:06:03.128504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:06:03.129010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:06:03.154662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.159004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.160811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.162825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.166969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.167787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.224649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Getting quotas for project 39c10fa11e244a629264dd733478c21b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:06:03.231386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:06:03.231821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:06:03.232296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Getting quotas for user 5ac399b59740442a93081bb1a78297b4 and project 39c10fa11e244a629264dd733478c21b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:06:03.232602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:06:03.233051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:06:03.233472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:06:03.257438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.257968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.270123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.273840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.275255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.286026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.330749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Getting quotas for project 979214475e474053bef7b2daaf4ae6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:06:03.345586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Getting quotas for user 314b17e8914f48e985e90481cd3c3a3d and project 979214475e474053bef7b2daaf4ae6fc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:06:03.376522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:06:03.380918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:06:03.497411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fe92a8a-dc44-4546-86a6-eda8dd9d9277 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.037871 Oct 19 01:06:03.499062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2077/4237] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:06:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:06:03.518869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:03.534950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:03.573790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.575617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.576078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.579485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:03.579997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:03.580458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:03.595694 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:06:03.599072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='33484440-0521-41f6-9eca-16b152d419fc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='82ce545a-8703-4913-bd42-6127040e8eb0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed33819e-8649-49f1-8f20-44083627f78f',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:06:04.367131 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-71bda799-2dbe-4f83-bac7-d1a391059433 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 16.322951 Oct 19 01:06:04.370174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2161/4238] 10.222.0.27 () {62 vars in 1189 bytes} [Wed Oct 19 01:05:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 16327 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:06:04.376840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-995f72f8-e22b-48ac-89d5-c0f4ebef5b7d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:04.377788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-995f72f8-e22b-48ac-89d5-c0f4ebef5b7d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:04.388151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:04.409496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:04.418192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:04.422833 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e57e79c8-e81e-4055-a694-ecc546eacdce tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 0.921034 Oct 19 01:06:04.425120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2078/4239] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:03 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:04.439749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:04.440610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:05.441420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-995f72f8-e22b-48ac-89d5-c0f4ebef5b7d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:05.442493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:05.451252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-995f72f8-e22b-48ac-89d5-c0f4ebef5b7d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1214 microversion: 2.1 time: 1.079554 Oct 19 01:06:05.451856 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2162/4240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:04 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1214 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:05.459632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:05.462420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:05.467791 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51e5da3b-e9fa-4cfe-aac7-f5d7d8f67501 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1285 microversion: 2.32 time: 1.040524 Oct 19 01:06:05.468530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:05.469195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:05.471512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2079/4241] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:04 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1285 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:05.516136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:05.516658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:05.525210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:05.526022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:05.526729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:05.534451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:06.145850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:06.209708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:06.212339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:06.223921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:06.276890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] Creating event network-changed:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h1-master-1 Oct 19 01:06:06.301497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6cb22f77-57b5-42e2-83a0-afbd2bcc8141 req-09e4a566-b4d5-43d5-b92f-23aecba791bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164841 Oct 19 01:06:06.309993 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2080/4242] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:06.479528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:06.480162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:06.496112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:06.496675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:06.498770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:06.501159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:06.502588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:06.505003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:06.903060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:06.916739 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce93a734-4dce-4a02-8cc8-f3d4f68feaf9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1272 microversion: 2.1 time: 0.442720 Oct 19 01:06:06.917866 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2081/4243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:06 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1272 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:06.936497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:06.937402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:07.021029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.033774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.037246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.042158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37bd60a7-1c49-4af2-bf38-1ac38b617c18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 1.589272 Oct 19 01:06:07.042885 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2163/4244] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:05 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:07.176664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.184828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.191976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:07.193608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b5478b1-5fc4-446a-9d73-f7fff348f010 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1285 microversion: 2.32 time: 0.263965 Oct 19 01:06:07.198002 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2082/4245] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:06 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:07.956055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:07.957115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:07.975650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:07.977360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:07.982043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:07.983321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:07.984055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:07.985513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:08.072693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:08.074713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:08.085851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:08.093683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:08.101084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:08.103458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:08.104526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:08.106211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:08.646592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:08.654698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04da1564-853e-4b53-98ed-f20906879f73 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1272 microversion: 2.1 time: 0.711569 Oct 19 01:06:08.673143 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2164/4246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:07 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1272 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:08.680704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:08.685516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:08.702671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:08.703175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:08.713446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:08.717180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:08.725367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:08.725837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:09.349859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.360165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.361922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.363308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-711f86d1-856b-4775-ac81-5ce5f306d92a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1575 microversion: 2.32 time: 0.689192 Oct 19 01:06:09.364063 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2165/4247] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:08 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1575 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:09.597642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.606436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.618185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:09.619398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c83c9ba9-7b73-4d1b-a210-f48c938e066f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 1.551939 Oct 19 01:06:09.620339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2083/4248] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:08 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:09.691163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:09.703003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:09.772807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:09.782208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:09.783670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:09.787912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:09.790722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:09.794816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:10.153471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:10.163073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5b70b34-484d-4a08-af92-d120aa6d46f9 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1272 microversion: 2.1 time: 0.482304 Oct 19 01:06:10.165277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2166/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:09 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:10.397842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:10.398507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:10.411273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:10.411837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:10.412298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:10.413140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:10.413607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:10.414046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:10.651822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:10.652733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:10.659240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:10.659736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:10.660181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:10.660944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:10.661404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:10.661834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:10.777546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:10.788649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:10.797839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:10.799064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bae1c353-27f7-43ca-b17b-aae1875ba70e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1593 microversion: 2.32 time: 0.405951 Oct 19 01:06:10.811621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2084/4250] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:10 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1593 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:11.191207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:11.192091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:11.220907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:11.225622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:11.228165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:11.229476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:11.232142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:11.232844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:11.691887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:11.718711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b494562-3bde-4ffa-9704-c07c5a23e34c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1272 microversion: 2.1 time: 0.533912 Oct 19 01:06:11.722517 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2085/4251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:11 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1272 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:11.832152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:11.833531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:11.853161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:11.859582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:11.860130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:11.864691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:11.868495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:11.873026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:12.064435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.069759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.082825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.085631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.087631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.089723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:12.092075 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ed2f806-8c20-457f-8630-e682dcace585 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 1.444422 Oct 19 01:06:12.093730 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a47e390b-9eea-4c6a-9445-6679671a278a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1593 microversion: 2.32 time: 0.266401 Oct 19 01:06:12.097170 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2086/4252] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:11 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1593 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:12.116954 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2167/4253] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:10 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 1465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:12.755639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:12.756539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:12.787104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:12.787688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:12.788164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:12.788948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:12.796772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:12.797555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:13.126822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:13.128163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:13.138777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:13.141075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:13.142659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:13.146940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:13.147666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:13.155222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:13.225050 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:13.306722 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:14.320077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:14.337231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:14.355682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:14.358050 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-337bafcc-d596-47ec-a9bd-1c19da1930fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1593 microversion: 2.32 time: 1.238414 Oct 19 01:06:14.360542 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2168/4254] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:13 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1593 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:14.374750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:14.385377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:14.405242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:14.406804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:14.407875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:14.408755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:14.409420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:14.409983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:14.466007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:14.477458 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e5f34e0-1c09-4bd2-8493-998ecd9f7a8e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 1.728882 Oct 19 01:06:14.485803 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2087/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:12 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:14.581705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "name": "network-vif-plugged", "status": "completed", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:14.608344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:14.609092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:14.610419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:14.641723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] Creating event network-vif-plugged:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h1-master-1 Oct 19 01:06:14.668301 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9a0e0f62-c3ad-4316-a307-624d17a1ea4a req-d6c88142-a510-4238-b190-44ad43148945 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093618 Oct 19 01:06:14.671240 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2088/4256] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 19 01:06:15.390363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:15.391076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:15.404662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:15.413571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:15.414529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:15.415724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:15.417619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:15.418366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:15.451253 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:15.745224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:15.797934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:15.811072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:15.826168 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de20e854-e396-41d0-9e5c-9f68eb63f57f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1593 microversion: 2.32 time: 0.440771 Oct 19 01:06:15.836424 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2089/4257] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:15 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1593 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:15.864188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:15.864895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:15.885689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:15.886198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:15.886642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:15.887534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:15.890040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:15.890879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:16.472859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:16.484913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:16.491424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:16.492971 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1465634d-8f3a-4be3-a3fa-7a2795733f7b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1405 microversion: 2.20 time: 2.130778 Oct 19 01:06:16.501508 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2169/4258] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:14 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1405 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:16.853345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:16.854077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:16.864060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:16.871651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:16.876302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:16.877408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:16.878069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:16.878682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:17.031891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:17.046705 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b9f7422-46fe-4cd2-9801-4f9799aa1e0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 1.200619 Oct 19 01:06:17.047950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2090/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:15 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:17.207864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:17.229006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:17.231092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:17.241439 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5fadaa8a-5564-463f-b912-618c94cf3b8d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1593 microversion: 2.32 time: 0.385240 Oct 19 01:06:17.243138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2170/4260] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:16 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1593 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:17.532979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:17.547185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:17.553142 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=24 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:17.578959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:17.579481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:17.579940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:17.580717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:17.581189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:17.581634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:17.732064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:17.756048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:17.757474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:17.762198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:17.786147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] Creating event network-changed:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:06:17.796665 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-795f8320-98ba-4afd-a8b4-91d51e8ebe7d req-9b11b162-5a79-43d2-b1d2-7a9ea93d75a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067848 Oct 19 01:06:17.799297 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2171/4261] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:18.075532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:18.076243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:18.095315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:18.095831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:18.096278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:18.097087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:18.097537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:18.108027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:19.544705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:19.559362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:19.561364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:19.562820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c850b3fb-f1a4-4a5a-834e-a147909e9aec tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1597 microversion: 2.20 time: 2.035610 Oct 19 01:06:19.604355 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2091/4262] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:17 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1597 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:19.610135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:19.613878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:19.648072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:19.648732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:19.649237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:19.650012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:19.650496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:19.655048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:19.924894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:19.942327 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f881e8f6-a32e-4584-9ad3-4b9d9f4e0151 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 1.870286 Oct 19 01:06:19.956647 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2172/4263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:18 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:19.956647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:19.957005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:19.985247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:19.985775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:19.986223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:19.986954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:19.987715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:19.994898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:20.263050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:20.289328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:20.291723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:20.296554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c69a752c-04b4-4198-8b81-0b348dca148b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1660 microversion: 2.32 time: 0.690220 Oct 19 01:06:20.312742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2092/4264] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:19 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1660 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:20.312742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c5c2bc-3833-4752-8ad2-e93373a02c26", "tag": "566fe953-5648-4dd1-80f8-a63e4b846ff7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:20.324116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d7c6f43-8bb7-4b14-8e47-9c2fc23f65a8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.369910 Oct 19 01:06:20.325412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2173/4265] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:06:19 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-interface => generated 285 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:06:20.347365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:20.348345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:20.351974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:20.379608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] Creating event network-changed:566fe953-5648-4dd1-80f8-a63e4b846ff7 for instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 on n-h1-master-1 Oct 19 01:06:20.397113 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-df989cd7-8e0b-4f11-8478-491d27efb160 req-3523a4d8-bc36-4cfa-8fac-66246a2db03f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096375 Oct 19 01:06:20.401436 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2093/4266] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:20.971044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:20.971661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:20.983131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:20.983636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:20.984081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:20.989526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:20.990062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:20.990687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:21.333920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:21.335513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:21.355066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:21.356592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:21.360202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:21.363737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:21.364665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:21.365379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:22.336964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:22.358484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:22.375883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:22.377385 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbaea996-09a5-4ad4-8444-9b54337abb45 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1706 microversion: 2.32 time: 1.051852 Oct 19 01:06:22.388237 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2094/4267] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:21 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1706 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:23.184275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:23.205408 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41c18fdf-7bc3-43e7-bba3-cb17fbd57b05 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 2.238140 Oct 19 01:06:23.209812 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2174/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:20 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 2243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:23.418958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:23.424409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:23.433319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:23.441887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:23.442648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:23.444030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:23.447479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:23.448395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:24.235848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:24.236509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:24.256327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:24.256854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:24.262220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:24.264285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:24.268869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:24.270244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:24.940807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:24.964996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:24.971625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:24.985444 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f78375e3-254c-4562-aefc-306328fb1773 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1706 microversion: 2.32 time: 1.572582 Oct 19 01:06:24.988658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2095/4269] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:23 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1706 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:26.039451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:26.042419 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=73 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:26.056133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b976cda2-f39f-45a6-8260-aeea6256655e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 1.825709 Oct 19 01:06:26.059125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2175/4270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:24 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:26.063971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:26.064601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:26.082443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b662536d-a2d7-4f36-af45-a50cd45bccca tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: .version_select at 0x7f2af49dbca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-324832320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDVTq8wNysoUZ8ueE5s8feJQV7LJOpKe36bJOV8fEGV0yKERr+73gkudFuk+QgdRzePcaFPFqwbPrXfhyzrparplYL9BkUiBdUW23VGYZ73l2TIc2/ISpeYzDZTmKmzSA=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:26.103290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:26.107291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:26.107747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:26.108501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:26.108997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:26.109427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:26.131290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b662536d-a2d7-4f36-af45-a50cd45bccca tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:06:26.154296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b662536d-a2d7-4f36-af45-a50cd45bccca tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:06:26.235593 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b662536d-a2d7-4f36-af45-a50cd45bccca tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.761817 Oct 19 01:06:26.248529 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2096/4271] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:06:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:27.097144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:27.097873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:27.119572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:27.120096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:27.120554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:27.121374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:27.121842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:27.122281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:27.701472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:27.729201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:27.737078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:27.741253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-effb5df2-45bc-4e7e-8397-3fd5bc2cf659 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1752 microversion: 2.32 time: 1.678686 Oct 19 01:06:27.743676 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2176/4272] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:26 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1752 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:27.995101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c5c2bc-3833-4752-8ad2-e93373a02c26", "name": "network-vif-plugged", "status": "completed", "tag": "566fe953-5648-4dd1-80f8-a63e4b846ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:28.018540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:28.019036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:28.019474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:28.052444 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] Creating event network-vif-plugged:566fe953-5648-4dd1-80f8-a63e4b846ff7 for instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 on n-h1-master-1 Oct 19 01:06:28.065359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6f121d86-7a75-4e90-9807-a09606225e69 req-00978867-886f-4003-9d76-dca7ddad748e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074575 Oct 19 01:06:28.068417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2177/4273] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:28.364184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:28.389162 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f616a04-3f9b-4a67-adef-52c01da69557 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 1.302137 Oct 19 01:06:28.390528 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2097/4274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:27 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:28.773941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:28.775723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:28.793197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:28.801484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:28.803571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:28.804698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:28.822803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:28.825049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:29.259373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:29.281911 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:29.284298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:29.284932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:29.285430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:29.309686 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:29.312040 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] Creating event network-changed:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h1-master-1 Oct 19 01:06:29.322781 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-84d5adba-fdee-4591-8998-cb8a418073e8 req-acaa08ea-8c41-4a38-9a59-f22bb8a564ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068220 Oct 19 01:06:29.326097 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2098/4275] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:29.424051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:29.425662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:29.438988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:29.444652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:29.448839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:29.459237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:29.463076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:29.469030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:29.619981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:29.630247 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:29.646450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:29.647697 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a45d6990-ef92-4893-a0a0-2d308f3b7a81 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1798 microversion: 2.32 time: 0.879900 Oct 19 01:06:29.652238 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2178/4276] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:28 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1798 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:29.943326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:29.968103 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44c57503-110f-44c6-86c1-e1fb522499da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1314 microversion: 2.1 time: 0.548886 Oct 19 01:06:29.974138 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2099/4277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:29 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:30.257818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-plugged", "status": "completed", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:30.285478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:30.295790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:30.298735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:30.356442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] Creating event network-vif-plugged:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:06:30.375860 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7463986c-3578-494b-a6c0-855b1353ec7b req-aba24e42-431e-4644-92d0-e0a5d305386c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124441 Oct 19 01:06:30.384575 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2179/4278] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:30.623797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-336298208", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:30.678766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:30.681438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:30.708073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:30.708588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:30.734088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:30.734811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:30.735305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:30.735747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:30.808475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] validate_networks() for [('231315bc-4360-4e98-8040-ec0c2c31211f', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:06:32.005306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:32.010961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:06:32.011489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:06:32.011878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:06:32.014360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:06:32.014802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:06:32.047827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:32.053852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:32.059384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a929acfa-a999-4246-8e71-5be114bfbfb3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1844 microversion: 2.32 time: 1.385048 Oct 19 01:06:32.061071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:32.061645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:32.062110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:32.063577 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2180/4279] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:30 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1844 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:32.065378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:32.065859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:32.066307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:32.079372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:32.091170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:32.113290 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:32.120521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:32.126157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:32.128085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:32.138684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:32.141182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:32.145262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:32.175472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Getting quotas for project 7f6213a887b044f49207f366ca8f5980. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:06:32.194361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Getting quotas for user fa1f3b94587e468d8c6dd9f134665691 and project 7f6213a887b044f49207f366ca8f5980. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:06:32.229425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:06:32.236345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:06:32.365135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b5e6053-2ab8-4ab2-b778-3f2de2151acb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.039416 Oct 19 01:06:32.375600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2100/4280] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:06:32.383066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04e78306-b654-43f0-9513-c503c9f12aac tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:32.383692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04e78306-b654-43f0-9513-c503c9f12aac tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:32.585098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04e78306-b654-43f0-9513-c503c9f12aac tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:32.597154 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04e78306-b654-43f0-9513-c503c9f12aac tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1216 microversion: 2.1 time: 0.215726 Oct 19 01:06:32.599506 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2101/4281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1216 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:33.040867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:33.054903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-553e526d-8e6b-4ac1-b3ba-818ff53b971a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1464 microversion: 2.1 time: 0.985152 Oct 19 01:06:33.065202 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2181/4282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:32 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1464 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:33.081027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:33.081396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:33.093931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.094450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.094906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.095639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.096100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.096537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.097286 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:33.097880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:33.106945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.111985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.112440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.114452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.115093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.117895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.739926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:33.749062 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fe4ba8f-3550-4f15-8fb5-e8937ce843d7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1467 microversion: 2.1 time: 0.672808 Oct 19 01:06:33.766277 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2102/4283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:33 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1467 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:33.781356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:33.781989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:33.811351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.811866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.812321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.813089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.825645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.826227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.862742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:33.881943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:33.887933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:33.938757 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-969796d8-76da-41bd-9d1a-c838842b844a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1844 microversion: 2.32 time: 0.819666 Oct 19 01:06:33.940601 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2182/4284] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:33 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1844 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:33.959421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1818511130"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:33.964205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:33.984296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.985063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.985685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:33.986937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:33.987568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:33.988164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:34.159360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:34.171095 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-72fb09f2-7c27-404f-8e3a-e0ca60cfdc79 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1212 microversion: 2.1 time: 0.393651 Oct 19 01:06:34.178044 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2103/4285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:33 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1212 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:34.208719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "38f11a8d-d34c-40f5-9986-fb064f507f0b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:34.252359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:34.255201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:34.255771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:34.308576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] Creating event network-changed:38f11a8d-d34c-40f5-9986-fb064f507f0b for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:34.331671 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-69c5e15d-2cc9-4d84-a585-948be7303c17 req-b2863e6b-4a97-41a5-9d60-e7061f79bf21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143603 Oct 19 01:06:34.334583 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2104/4286] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:34.587751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bb1cff3-3e40-44b6-bf12-b51e847abc82 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "POST /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.642642 Oct 19 01:06:34.591120 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2183/4287] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:06:33 2022] POST /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:06:34.606347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7aaa9878-152b-4259-9380-96cfccf84e4e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af497f160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:34.685986 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7aaa9878-152b-4259-9380-96cfccf84e4e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.087478 Oct 19 01:06:34.688503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2105/4288] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:34 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:34.972339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:34.973133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:34.990770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:34.991269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:35.005592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:35.009238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:35.013795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:35.014317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:35.205196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:35.206719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:35.220055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:35.221564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:35.226709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:35.230779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:35.231772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:35.233190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:36.588113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:36.598370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-044aaab4-d77f-40e6-b637-2d5d49a94676 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1274 microversion: 2.1 time: 1.397652 Oct 19 01:06:36.600933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2106/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:35 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1274 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:36.605888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d24a05e1-6b93-4466-bf31-98df90b63a59 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af49dbaf0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:36.696422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d24a05e1-6b93-4466-bf31-98df90b63a59 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.094130 Oct 19 01:06:36.697886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2107/4290] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:36 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:37.085865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:37.110294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:37.115059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:37.119537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-880057f4-6a7a-47ab-afc8-6470ee749e03 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1844 microversion: 2.32 time: 2.152183 Oct 19 01:06:37.123445 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2184/4291] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:34 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1844 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:06:37.343414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "0da738a0-f0f8-4ef5-a13f-8bf8beb69f95"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:37.368670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:37.369172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:37.374462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:37.415010 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] Creating event network-changed:0da738a0-f0f8-4ef5-a13f-8bf8beb69f95 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:37.430460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c04a92c2-2eae-467e-8681-9f69b979d92c req-4c20d15b-3c5c-490d-933c-f0a7c34ae1ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091500 Oct 19 01:06:37.434343 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2108/4292] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:37.623473 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:37.624105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:37.643210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:37.643979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:37.644335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:37.648990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:37.649391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:37.649853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:37.717915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb3541e5-9b21-4051-84a2-6363c5b8ceb8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af9349160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:37.825758 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb3541e5-9b21-4051-84a2-6363c5b8ceb8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.113783 Oct 19 01:06:37.830792 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2109/4293] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:37 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:38.152868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:38.154686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:38.171799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:38.172573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:38.174378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:38.177133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:38.177819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:38.178451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:38.784062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:38.798469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09fe2350-8f85-45a6-8c32-7471695aed45 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.178492 Oct 19 01:06:38.811565 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2185/4294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:37 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:38.843005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-371e6222-d628-4e5c-9756-0a9443b6c845 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fc64c0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:39.499771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:39.512537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-371e6222-d628-4e5c-9756-0a9443b6c845 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.674221 Oct 19 01:06:39.516488 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2186/4295] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:38 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:39.528917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:39.535601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:39.537174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46a737d9-8b1b-4f91-8ba2-3e59221f73ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1865 microversion: 2.32 time: 1.390488 Oct 19 01:06:39.538057 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2110/4296] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:38 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1865 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:39.830689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:39.831226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:39.858748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:39.859424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:39.863083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:39.864025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:39.864649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:39.868639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:40.293333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-plugged", "status": "completed", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:40.336773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:40.337727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:40.338462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:40.378907 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] Creating event network-vif-plugged:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:06:40.393595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ebd08c52-bdb8-41ad-8f13-50d6f593ef3c req-7b047597-5f4b-4316-8312-b30a8c34fad6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104144 Oct 19 01:06:40.396254 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2111/4297] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:40.534627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53ffdb23-7a32-4327-9f72-4f41a250207f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4f05e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:40.669320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53ffdb23-7a32-4327-9f72-4f41a250207f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.140610 Oct 19 01:06:40.671644 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2112/4298] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:40 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:40.687589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:40.706998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-553d4f45-06e5-42c7-8954-48c2f6427485 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 0.881586 Oct 19 01:06:40.707877 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2187/4299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:39 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:40.718202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:40.719363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:40.731338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:40.732132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:40.732887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:40.734495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:40.735235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:40.735917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:41.307003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:41.353136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:41.357871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:41.361520 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-05175cd5-ced1-4493-af4a-fe15814f0232 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1886 microversion: 2.32 time: 0.688542 Oct 19 01:06:41.363731 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2113/4300] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:40 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1886 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:41.570132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "721aec34-2caf-4b3d-a272-ae4a9fff87e7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:41.593232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:41.594164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:41.597550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:41.625062 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] Creating event network-changed:721aec34-2caf-4b3d-a272-ae4a9fff87e7 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:41.634358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-32563c59-4a11-4ef7-9b8d-280abb3a836d req-d7a0f687-c459-4ab0-81c2-0f308e24fa4a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069845 Oct 19 01:06:41.636752 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2188/4301] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:41.686038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50e2c7b6-4f3f-429e-8a26-55c2dd427613 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5639430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:41.743102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:41.744387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:41.766232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:41.767110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:41.768283 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50e2c7b6-4f3f-429e-8a26-55c2dd427613 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.086091 Oct 19 01:06:41.769139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:41.770125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:41.775226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:41.775569 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2114/4302] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:41 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:41.777544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:42.395378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:42.397010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:42.399562 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:42.409872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:42.420305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:42.423256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:42.424535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:42.430714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:42.431616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:42.593824 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:43.373242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:43.387283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1d2f6be5-1c87-4988-99f7-7987f10f9baf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.655824 Oct 19 01:06:43.390510 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2189/4303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:41 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:43.407099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-81a94af8-b6e4-4354-a7f9-b49151d88712 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af508ad30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:43.506859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-81a94af8-b6e4-4354-a7f9-b49151d88712 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.113613 Oct 19 01:06:43.508543 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2190/4304] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:43 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:43.667590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:43.706330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:43.708870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:43.709912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:43.750370 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] Creating event network-changed:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h1-master-1 Oct 19 01:06:43.777369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6c816df2-2363-4263-9af6-ec57b625b500 req-f1dfef37-a153-4eff-9bad-4bf948cb4b08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110235 Oct 19 01:06:43.782164 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2191/4305] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:44.416466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:44.417619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:44.436766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:44.437468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:44.438019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:44.438859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:44.439434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:44.440068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:44.534752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:44.556892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:44.558433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:44.559673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-247f3182-a7dc-49b8-8047-3d730029bce1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1886 microversion: 2.32 time: 2.168292 Oct 19 01:06:44.565385 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2115/4306] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:42 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1886 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:44.581816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29270fcd-0239-4bad-94b1-9b50733843b0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d9eb80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:44.673136 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29270fcd-0239-4bad-94b1-9b50733843b0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.105341 Oct 19 01:06:44.675667 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2116/4307] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:44 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:44.940723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:44.961443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a8d58e9-4cbd-48a6-b185-d788ff048216 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 0.543159 Oct 19 01:06:44.965349 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2192/4308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:44 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:45.588850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:45.589484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:45.603374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:45.603884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:45.604344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:45.605117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:45.605578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:45.606015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:45.691433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4e5f2286-3966-4e61-b818-b023c04041fd tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5021ca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:45.812641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4e5f2286-3966-4e61-b818-b023c04041fd tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.125624 Oct 19 01:06:45.813699 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2193/4309] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:45 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:45.855134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "99e14050-3458-4a6f-941f-fd4d097c5722"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:45.880517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:45.887535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:45.888314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:45.930157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] Creating event network-changed:99e14050-3458-4a6f-941f-fd4d097c5722 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:45.940653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-61102b4a-861a-4858-9683-22c8a60cf330 req-d8b6c13f-9a5a-4ba3-8c94-92edc04db953 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090770 Oct 19 01:06:45.947238 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2194/4310] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:06:45.993099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:45.994353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:46.007507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:46.009319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:46.010560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:46.015304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:46.017633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:46.020602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:46.852745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:46.870216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:46.871898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:46.879295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f52eaa7-55a1-4bb3-bb27-a7b151c2a4b5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1886 microversion: 2.32 time: 1.295786 Oct 19 01:06:46.879894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2117/4311] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:45 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1886 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:46.900852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04250ea7-c6db-4488-a7bf-4452629b9b8a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4f7bb80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:46.994959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04250ea7-c6db-4488-a7bf-4452629b9b8a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.110039 Oct 19 01:06:46.995550 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2118/4312] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:46 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:47.457370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:47.500106 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-081c42ea-6fcc-46d2-9391-c75ab113ec59 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.495150 Oct 19 01:06:47.518682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2195/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:45 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:47.911019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:47.914882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:47.940258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:47.952383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:47.953120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:47.955211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:47.958932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:47.959729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:48.014982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-089b8f01-0446-4709-9c05-890077464642 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af450bb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:48.151778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-089b8f01-0446-4709-9c05-890077464642 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.145011 Oct 19 01:06:48.170809 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2196/4314] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:48 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:48.535689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:48.536323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:48.561987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:48.566414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:48.566920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:48.574832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:48.579088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:48.579591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:48.624013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:48.646086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:48.654947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:48.658772 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6e2a696-d1fb-4224-988a-0c41b1edd26b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1886 microversion: 2.32 time: 0.752515 Oct 19 01:06:48.662004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2119/4315] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:47 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1886 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:48.682159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "efb6bc64-e058-4f7e-bee3-a9a36db12eb4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:48.729535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:48.730416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:48.734215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:48.759706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] Creating event network-changed:efb6bc64-e058-4f7e-bee3-a9a36db12eb4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:48.772546 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-88a86806-47e5-428b-8e3f-d4e2952d6981 req-da39f47c-3adb-423b-a17a-efbddf245544 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094865 Oct 19 01:06:48.776960 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2120/4316] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:49.171490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab02137e-9c43-4313-9ec3-cf698cf0b796 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b714c0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:49.254775 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab02137e-9c43-4313-9ec3-cf698cf0b796 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.088532 Oct 19 01:06:49.256041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2121/4317] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:49 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:49.639760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:49.665790 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-089f20a9-5692-410b-ac09-1b8771e39cdd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.131979 Oct 19 01:06:49.669337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2197/4318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:48 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:49.690788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:49.691637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:49.715686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:49.717965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:49.720094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:49.723889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:49.725129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:49.725743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:50.276781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28937c4a-6573-453c-85e4-b3406a6dd11b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5082c10>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:50.384108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28937c4a-6573-453c-85e4-b3406a6dd11b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.116085 Oct 19 01:06:50.387245 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2198/4319] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:50 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:50.582423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:50.637203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:50.640359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:50.644545 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de6e7dec-feba-4202-878c-3663b0c4dac7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.958604 Oct 19 01:06:50.664657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2122/4320] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:49 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:50.693146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:50.694002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:50.720161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:50.720785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:50.722807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:50.723694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:50.726032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:50.732073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:50.798752 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:51.164252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:51.181367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-225586bc-84c9-42df-b0f7-e09d43066c08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 0.493083 Oct 19 01:06:51.182962 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2199/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:50 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:51.404573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b2f9e4c-929f-4675-b34f-d3231e3047f4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b97ca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:51.504218 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b2f9e4c-929f-4675-b34f-d3231e3047f4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.104863 Oct 19 01:06:51.513421 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2123/4322] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:51 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:51.683097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:51.684035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:51.722202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:51.727038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:51.727511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:51.746683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:51.747846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:51.748394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:51.913729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "name": "network-vif-plugged", "status": "completed", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:51.970916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:51.980496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:51.981080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:52.006143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] Creating event network-vif-plugged:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h1-master-1 Oct 19 01:06:52.025460 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c93b5a16-6a17-41e9-9d87-c39861553270 req-fb3e84dd-f55e-407b-8720-fba7cf7cdd64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117082 Oct 19 01:06:52.029004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2124/4323] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:52.223108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:52.224074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:52.235949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:52.245641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:52.246469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:52.247464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:52.253384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:52.254205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:53.121581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:53.132526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:53.143787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:53.153865 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1781086a-8083-4815-b881-cb987543112f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 1.468868 Oct 19 01:06:53.157651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2200/4324] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:51 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:53.169573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f08dd61-5073-458f-99d6-b89755d37534 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af42c3dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:53.265813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f08dd61-5073-458f-99d6-b89755d37534 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.106854 Oct 19 01:06:53.268004 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2201/4325] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:53 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:53.283944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "8e2e8ddf-967a-4d6e-b31d-f682369381c4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:53.322508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:53.329406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:53.339319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:53.340779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:53.346667 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6edd67f6-8ecd-49bf-9941-193289793300 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.131553 Oct 19 01:06:53.348193 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2125/4326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:52 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:53.361509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] Creating event network-changed:8e2e8ddf-967a-4d6e-b31d-f682369381c4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:53.373240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:53.373557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-757f30af-bb9c-4ad5-b373-0ee51235794e req-49c04961-fadb-4bc8-a843-5f13f38e6ce2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097679 Oct 19 01:06:53.375224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:53.377061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2202/4327] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:53.384013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:53.384013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:53.384472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:53.385234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:53.385708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:53.386138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:53.469903 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-89413a5a-41d2-4aa8-90f9-14d957114b49 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/ips" status: 200 len: 152 microversion: 2.20 time: 0.111573 Oct 19 01:06:53.481621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2126/4328] 10.222.0.27 () {60 vars in 1289 bytes} [Wed Oct 19 01:06:53 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/ips => generated 152 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:06:54.189840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:54.190637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:54.214806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:54.215327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:54.215775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:54.216508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:54.217017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:54.217502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:54.285044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-130f4925-3187-41bb-b405-3a39dfbb85a8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4240f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:54.426917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-130f4925-3187-41bb-b405-3a39dfbb85a8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.146813 Oct 19 01:06:54.432400 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2127/4329] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:54 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:06:54.467969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:54.468609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:54.513399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:54.524073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:54.524684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:54.528379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:54.528941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:54.529394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:55.456732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:55.466407 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-914bfd77-68cf-4ace-9da1-5995ef9ec43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1316 microversion: 2.1 time: 1.028700 Oct 19 01:06:55.469327 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2128/4330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:54 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1316 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:55.477542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e04c4b5b-29f7-4370-b4d9-488ab49e40a1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d523a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:55.587764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:55.598014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:55.599555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:55.612678 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e04c4b5b-29f7-4370-b4d9-488ab49e40a1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.138713 Oct 19 01:06:55.613719 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2129/4331] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:55 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:55.622179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e2b55ec-ae00-4f7a-8453-cf29d003c5b1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 1.419191 Oct 19 01:06:55.633459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2203/4332] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:54 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:56.499841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:56.500409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:56.529216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:56.534135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:56.536472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:56.540076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:56.541840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:56.541840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:56.636105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74c67a1f-74e2-439e-97ba-c296564dbb93 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5869310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:56.720416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74c67a1f-74e2-439e-97ba-c296564dbb93 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.094546 Oct 19 01:06:56.721483 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2204/4333] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:56 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:56.734303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:56.735957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:56.755978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:56.763595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:56.764796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:56.767204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:56.767926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:56.770162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:57.636481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:57.654412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:57.665231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:57.666554 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc8d6b3a-698b-4757-8527-c74453907118 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.943034 Oct 19 01:06:57.667159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2205/4334] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:56 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:57.738500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55e3ffab-7000-43e6-b18f-a8735c2fb411 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fb9670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:57.818862 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55e3ffab-7000-43e6-b18f-a8735c2fb411 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.085553 Oct 19 01:06:57.826899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2206/4335] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:06:57 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:58.000839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:58.018855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "5fed55e1-6607-4d7f-aedd-c225114d151f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:58.049176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b273d4d8-e423-4de8-bb0c-395efed27ff1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 1.547559 Oct 19 01:06:58.052236 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2130/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:06:56 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:06:58.087931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:58.088485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:58.095064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:58.097829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:58.098733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:58.131804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:58.140409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:58.142994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:58.145682 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] Creating event network-changed:5fed55e1-6607-4d7f-aedd-c225114d151f for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:06:58.146604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:58.147910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:58.148538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:58.168613 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a01113c6-3e2b-4532-82c3-815024b72bc7 req-07d872a0-c5bf-43dc-ae7b-a3a30e16a40e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155560 Oct 19 01:06:58.173111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2207/4337] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:06:58.215950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lazy-loading 'flavor' on Instance uuid dd58bab4-c8ff-4a0a-a972-7fc97c1f942f {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:06:58.231296 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:06:58.510553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-416023643", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:06:58.652285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dcd4b8f8-afec-49d0-b2b8-99d3baebf7d8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/action" status: 202 len: 0 microversion: 2.20 time: 0.598607 Oct 19 01:06:58.653223 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2131/4338] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 01:06:58 2022] POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:06:58.691238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:58.692495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:58.726078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] validate_networks() for [('231315bc-4360-4e98-8040-ec0c2c31211f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:06:58.735998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:58.736764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:58.737363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:58.738830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:58.739491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:58.740094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:59.271258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:59.283977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:59.293344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:06:59.294590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb77905f-3dd7-4c73-a59e-58057233527f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.634994 Oct 19 01:06:59.295160 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2132/4339] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:58 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:06:59.314608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:06:59.315488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:06:59.341375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:59.356494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:59.357055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:06:59.357907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:06:59.358387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:06:59.358818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:00.192347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:00.212598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:00.214096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:00.215307 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f5179cdd-82b8-4331-b987-f2f90b9abe50 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.913631 Oct 19 01:07:00.238624 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2133/4340] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:06:59 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:00.244247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fe4fac8-6403-45f2-93ff-d37d6d09b315 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b29670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:00.331827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fe4fac8-6403-45f2-93ff-d37d6d09b315 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.092000 Oct 19 01:07:00.333179 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2134/4341] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:00 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:00.340039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:00.344443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:00.360563 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:00.362746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:00.373873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:00.374777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:00.375878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:00.376595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:00.377292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:01.067406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:07:01.067878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:07:01.068297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:07:01.069621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:07:01.070049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:07:01.087168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:01.102203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:01.104302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:01.105264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:01.108338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:01.108907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:01.188141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Getting quotas for project 7f6213a887b044f49207f366ca8f5980. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:07:01.206190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Getting quotas for user fa1f3b94587e468d8c6dd9f134665691 and project 7f6213a887b044f49207f366ca8f5980. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:07:01.242071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:07:01.273140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:07:01.372499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ca7a54fc-ec30-4ac5-a592-6883b99a2e9a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.867137 Oct 19 01:07:01.373805 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2208/4342] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:06:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:07:01.380167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:01.381297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:01.389726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:01.390453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:01.391074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:01.392169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:01.392817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:01.393436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:01.564921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:01.574942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:01.576380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:01.588238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35c82216-7520-4559-addd-92ddd3b97833 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 1.253737 Oct 19 01:07:01.588867 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2135/4343] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:00 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:01.598466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-263703463", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "d0586039-cbff-45b7-800f-56155ba4a3f7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-324832320", "security_groups": [{"name": "tempest-secgroup-smoke-445155618"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:03.324073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] validate_networks() for [('d0586039-cbff-45b7-800f-56155ba4a3f7', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:07:03.840194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:03.856215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:03.860176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:03.862127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1f518a12-bb2b-4183-bd22-f6cfd4e95f8f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 2.487151 Oct 19 01:07:03.863249 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2209/4344] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:01 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:03.874049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e04c8c0b-76f0-4f25-8409-80674cd7bf09 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af452a9d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:03.956540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e04c8c0b-76f0-4f25-8409-80674cd7bf09 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.087083 Oct 19 01:07:03.962193 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2210/4345] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:03 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:03.977037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:03.978603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:03.999352 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:04.016357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:04.017330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:04.019853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:04.023812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:04.024831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:04.025513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:04.280351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:04.289725 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb1e393e-603b-47e7-ae58-e66bf37482cc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1268 microversion: 2.1 time: 0.325718 Oct 19 01:07:04.312807 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2211/4346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:03 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1268 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:04.330862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:04.336084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:04.349362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:04.350442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:04.353682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:04.354713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:04.358370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:04.359049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:05.587169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:05.607119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:05.623870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:05.626392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ac6e581-19fe-44e7-9746-0f8c866111d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 1.307555 Oct 19 01:07:05.632236 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2212/4347] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:04 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:05.644317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:05.645657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:05.658783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:05.665205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:05.667360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:05.668568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:05.670211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:05.671357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:06.185439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:07:06.186900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:07:06.187625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:07:06.188341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:07:06.188969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:07:06.217576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:06.222025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:06.225709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:06.226612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:06.227245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:06.227536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:06.290145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:07:06.308785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:07:06.352055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:07:06.359450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:07:06.547271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0f66599-2c16-4b60-ab50-f7cd19d77c2a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 4.952464 Oct 19 01:07:06.553912 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2136/4348] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 4960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:07:06.572531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b6fd5b1c-7561-42e8-b92d-2e953555533c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b9f5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:06.700000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b6fd5b1c-7561-42e8-b92d-2e953555533c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.144019 Oct 19 01:07:06.701781 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2137/4349] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:06 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:06.715308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:06.717693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:06.730347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:06.731180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:06.732014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:06.733606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:06.734279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:06.734896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:06.840920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:06.858589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:06.864054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:06.867413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a6fd421-851d-4273-837b-27ab8d652733 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 1.233641 Oct 19 01:07:06.869905 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2213/4350] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:05 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:06.898642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7376d25-77ed-4b8a-9a91-c8b5b3b249ed tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:06.901274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7376d25-77ed-4b8a-9a91-c8b5b3b249ed tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:07.039261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:07.057018 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec2f3dac-1632-45c5-a5c9-cf4c93185639 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1274 microversion: 2.1 time: 0.352624 Oct 19 01:07:07.058405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2138/4351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:06 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1274 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:07.069384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:07.070009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:07.094690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:07.095423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:07.096381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:07.098628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:07.099330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:07.101804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:07.118564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7376d25-77ed-4b8a-9a91-c8b5b3b249ed tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:07.143511 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7376d25-77ed-4b8a-9a91-c8b5b3b249ed tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1265 microversion: 2.1 time: 0.250403 Oct 19 01:07:07.144198 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2214/4352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:06 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:07.598231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:07.608181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:07.614139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:07.618124 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5eb3566c-07aa-43eb-923c-d63f82ddbb4b tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.556899 Oct 19 01:07:07.620139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2139/4353] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:07 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:07.716331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-76d1abc0-c0a1-4599-9e84-043dbc6ccadc tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4e70d30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:07.832483 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-76d1abc0-c0a1-4599-9e84-043dbc6ccadc tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.120483 Oct 19 01:07:07.833115 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2215/4354] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:07 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:07.895402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:07.896034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:07.907157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:07.907972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:07.908637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:07.913504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:07.914188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:07.914801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.086554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:08.087811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:08.098101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.098610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.099606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.100489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.100988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.101434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.439680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:08.451350 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9848aceb-883d-4de0-95a7-3291cf69de1b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1274 microversion: 2.1 time: 0.369166 Oct 19 01:07:08.453204 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2216/4355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:08 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:08.459142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:08.460019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:08.472941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.473768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.475282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.476965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.477715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.478493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.685947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:08.699332 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a5618924-de60-4f63-bf29-0e3c1acc8294 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1317 microversion: 2.1 time: 0.244734 Oct 19 01:07:08.718776 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2217/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:08 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:08.719150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:08.728937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:08.736910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:08.738254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f21d7ac-f363-41ba-9dba-6d4195c3a882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.846699 Oct 19 01:07:08.738437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:08.739229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2140/4357] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:07 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:08.742051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:08.782732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.790552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.791220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.795241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:08.801332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:08.803467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:08.852375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f2d6a60-e70a-436b-ad61-7020dfc20740 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5639280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:08.956479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f2d6a60-e70a-436b-ad61-7020dfc20740 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.110383 Oct 19 01:07:08.976348 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2141/4358] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:08 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:09.486861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:09.487490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:09.500541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:09.503074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:09.503397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:09.504115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:09.504578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:09.505038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:09.531520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:09.549997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:09.554094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:09.555593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29fc9c59-f089-4e0a-97e0-e2d2c8c048be tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.847384 Oct 19 01:07:09.574091 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2218/4359] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:08 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:09.748232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:09.749310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:09.775890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:09.776821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:09.777567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:09.816123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:09.816123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:09.816123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:09.977352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:09.992738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42794bc9-53ec-4e5f-8533-808f5b654c33 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1323 microversion: 2.1 time: 0.247863 Oct 19 01:07:09.994062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2219/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:09 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1323 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:10.002118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:10.006837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:10.038681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:10.039710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:10.042756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:10.045916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:10.048215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:10.049792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:10.229794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:10.239649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ade090cf-9356-4d99-860a-32543a75663c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.765251 Oct 19 01:07:10.243501 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2142/4361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:09 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:10.248326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65653922-b9c6-4a22-a42f-980957d5c8da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4f79280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:10.380141 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65653922-b9c6-4a22-a42f-980957d5c8da tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.135309 Oct 19 01:07:10.384249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2143/4362] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:10 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:10.590092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:10.593026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:10.593656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:10.603917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:10.606029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:10.606546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:10.606998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:10.607727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:10.608196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:10.608659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:10.612299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:10.622998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-068b5c52-a190-48a5-92e1-e334058b6285 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.627630 Oct 19 01:07:10.627852 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2220/4363] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:09 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:11.024947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:11.025576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:11.047704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.050205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.051852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.058599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.059329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.062939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.146303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:11.158572 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:11.163448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:11.166758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:11.174277 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6661c9fc-7aca-4007-af38-f71af60ff581 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.583231 Oct 19 01:07:11.178131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2144/4364] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:10 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:07:11.272747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:11.274068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:11.283652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.285185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.286480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.290533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.291190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.291781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.299615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:11.323007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-741572ca-d66f-4591-b4eb-479cd7c3ebd6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1323 microversion: 2.1 time: 0.301344 Oct 19 01:07:11.334905 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2221/4365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:11 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1323 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:11.400271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5ff960b2-376b-4b89-b180-dad711c7b823 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d91dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:11.488489 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5ff960b2-376b-4b89-b180-dad711c7b823 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1453 microversion: 2.1 time: 0.092612 Oct 19 01:07:11.489503 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2222/4366] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:11 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:11.657941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:11.658625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:11.668991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.669982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.670673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.672850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.674115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.675413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.877760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:11.889250 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bcef6a64-8d01-49e4-98d9-3d2f8c6c1eef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.621665 Oct 19 01:07:11.891242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2145/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:11 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:11.899972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed075090-4932-426a-a6fd-4a773fce4145", "tag": "03828afd-d39c-43a9-8cc6-cd8aa2059bbb"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:11.921988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:11.921988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:11.921988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:11.954006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] Creating event network-changed:03828afd-d39c-43a9-8cc6-cd8aa2059bbb for instance ed075090-4932-426a-a6fd-4a773fce4145 on n-h2-master-1 Oct 19 01:07:11.965145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a134fa0e-82c0-4bbe-a701-2559e26675ff req-4fa76399-9ad8-45c1-b520-b61241f96871 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070144 Oct 19 01:07:11.966538 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2146/4368] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:12.177602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.193843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.201894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.204250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d0a652d-6213-4d50-aa07-e54970a945d1 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.550451 Oct 19 01:07:12.207264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.207971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:12.210404 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2223/4369] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:11 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:12.237062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.237546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.237993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.238699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.239158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.239592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.350031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.350837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:12.362749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.366456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.367112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.368249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.368906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.369523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.697238 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.702226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.709045 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-beb7fa2e-4124-41f0-b188-dec9cfe0cf54 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.364506 Oct 19 01:07:12.711005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.712153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2224/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:12.717047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fbf1e9d5-acc5-471c-9b47-9bfb877f7f2e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5021dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.717814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:12.719029 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-646fcde2-6758-4185-a4b5-db90d4f7b77f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.516395 Oct 19 01:07:12.729008 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2147/4371] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:12.797382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fbf1e9d5-acc5-471c-9b47-9bfb877f7f2e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1462 microversion: 2.1 time: 0.084097 Oct 19 01:07:12.798914 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2225/4372] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:12.816356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb7655f9-7804-4785-aeb3-2156f6d9da7b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d9ee50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.893072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb7655f9-7804-4785-aeb3-2156f6d9da7b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 200 len: 1462 microversion: 2.1 time: 0.080528 Oct 19 01:07:12.910794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.911603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:12.918077 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2148/4373] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 1462 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:12.930296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.931340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.931648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.931840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:12.932660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:12.934710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.936989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.937621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.975699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.976590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.978612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:12.981094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:12.981949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:12.982640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.009224 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:13.329818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:13.367681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf3b6031-bd8b-4e3f-8200-3f6d876e16ca tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1467 microversion: 2.1 time: 0.461133 Oct 19 01:07:13.368314 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2226/4374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1467 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:13.392439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:13.393131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:13.417525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.418055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.423386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.424972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.429476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.441837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.441998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:13.467038 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6159d2fe-f34e-4186-80e9-163d9730bebe tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.544170 Oct 19 01:07:13.483593 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2149/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:12 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:13.483593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1165246629"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:13.483593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:13.501518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.502055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.503343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.504106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.504579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.505050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.926617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70e5def4-239d-43f7-99af-4be4b48853fe tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "POST /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26/action" status: 202 len: 0 microversion: 2.1 time: 0.454188 Oct 19 01:07:13.934176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2150/4376] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:07:13 2022] POST /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:07:13.944188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:13.949251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:13.962380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.963119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.963732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.969561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:13.972007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:13.972995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:13.995018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.005510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.015142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.017567 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f41639c-a2e6-4dce-ac95-bf85ff74d5f3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.648233 Oct 19 01:07:14.021925 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2227/4377] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:13 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:14.039673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:14.040989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:14.056167 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:14.061422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:14.063199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:14.064441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:14.066814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:14.067375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:14.068924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:14.872058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.882981 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3fb3524-90ea-4c47-80c0-034ab5972443 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.947281 Oct 19 01:07:14.883830 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2151/4378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:13 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:14.892003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d379733-a4d4-4af8-9539-246069444548 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fafca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:14.958370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.961146 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d379733-a4d4-4af8-9539-246069444548 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1453 microversion: 2.1 time: 0.075182 Oct 19 01:07:14.962459 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2152/4379] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:14 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:14.970700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:14.975090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.978436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:14.980914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d53a097-45e8-4192-b49a-2af43518d4d1 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 0.956829 Oct 19 01:07:14.981751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2228/4380] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:14 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:14.992837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:14.993806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:14.994717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:14.995232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:14.995641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.023900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.024558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.025289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.026254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.026940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.027078 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] Creating event network-changed:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h1-master-1 Oct 19 01:07:15.027737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.035338 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3ff4d42e-776d-4ad4-a84a-a6d1975415c7 req-3fdc2b57-15d8-4000-b2b3-25d2a9e9ba4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071509 Oct 19 01:07:15.036564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2153/4381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:15.061669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:15.062638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:15.074228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.080991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.081638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.082762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.083390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.084523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.394060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:15.410241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25aa44c2-2119-4d36-98b7-367082a56655 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.417053 Oct 19 01:07:15.411055 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2229/4382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:14 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:15.669948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:15.683724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:15.685881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:15.695109 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-906b464f-1d9c-4e15-ba13-b61caf02c2d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.629840 Oct 19 01:07:15.705648 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2154/4383] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:15 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:07:15.933027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:15.934677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:15.945354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.948849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.949986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.952433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:15.953223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:15.953879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:15.986218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37d31240-7ff4-4b3d-bc3e-396d25a44f0c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4f05790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:16.072514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37d31240-7ff4-4b3d-bc3e-396d25a44f0c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1453 microversion: 2.1 time: 0.090371 Oct 19 01:07:16.073140 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2155/4384] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:15 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:16.110488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:16.111118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:16.142395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.142973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.143433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:16.144156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.144602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.145266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:16.250616 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:16.339644 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:16.604830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:16.613900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:16.621875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:16.628762 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df6b1d46-ee94-480a-a680-9fc631305611 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1743 microversion: 2.20 time: 0.525291 Oct 19 01:07:16.633888 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2156/4385] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:16 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1743 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:16.651083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:16.654302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:16.676083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.681919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.683671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:16.685059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.688894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.690236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:16.690384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:16.702623 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e437c792-6e30-4a01-8e65-9fc02e374e91 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.774493 Oct 19 01:07:16.710112 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2230/4386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:15 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:16.735005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:16.735669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:16.754708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.756862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.757729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:16.759790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:16.760813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:16.764515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.073872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:17.086470 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae2ed129-4218-4126-bd58-142945796a6f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.448870 Oct 19 01:07:17.090387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2157/4387] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:16 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:17.111002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b48af38-adb7-4468-b674-f84356cebb0b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4f1c5e0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:17.123352 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:17.196878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b48af38-adb7-4468-b674-f84356cebb0b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1453 microversion: 2.1 time: 0.089355 Oct 19 01:07:17.197155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:17.204934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2158/4388] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:17 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:17.214110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:17.219127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:17.221819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c48f14d0-a77c-4615-8c34-4687c16e2f76 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.500850 Oct 19 01:07:17.241562 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2231/4389] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:16 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:17.390066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:17.402181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:17.403000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:17.403679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.418423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] Creating event network-vif-unplugged:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:07:17.424086 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f46f8b72-1962-4819-a1c3-efbd8a5d32be req-7160b853-0553-4847-a9aa-604ab3d4e4a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038002 Oct 19 01:07:17.425723 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2159/4390] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:17.672224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:17.673205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:17.685104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:17.685897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:17.686511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.688471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:17.691905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:17.693122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.746545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:17.750446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:17.763069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:17.764189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:17.764992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.765942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:17.766696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:17.768018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:17.988297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.009799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.012288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.013591 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-45431876-f39b-463c-81ca-f9215d23bd8e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1743 microversion: 2.20 time: 0.345501 Oct 19 01:07:18.015093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2232/4391] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:17 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1743 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:18.116740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:18.117856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:18.133365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:18.135910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:18.136463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:18.137378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:18.140146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:18.140721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:18.185288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.194663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb236ada-3639-41b4-8dbb-078aced6c731 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.459997 Oct 19 01:07:18.198790 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2160/4392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:17 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:18.211861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-519b183b-6ef6-457c-a259-d2e11417399a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af434a310>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:18.285963 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-519b183b-6ef6-457c-a259-d2e11417399a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1453 microversion: 2.1 time: 0.078499 Oct 19 01:07:18.287733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2161/4393] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:18 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:18.293907 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:18.294686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:18.306255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:18.310702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:18.311590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:18.313559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:18.314404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:18.316600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:18.580877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.589105 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-203a2781-d753-4cd9-921a-33c8b0d65c6b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.477246 Oct 19 01:07:18.589695 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2233/4394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:18 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:18.720770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.745883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.748349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:18.751178 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-254d4980-4277-4929-a42a-8fe1529ea43e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.461807 Oct 19 01:07:18.777566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2162/4395] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:18 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:19.047017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:19.048506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:19.062863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.064288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.066324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.068775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.070502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.072203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.228122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:19.229763 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:19.250157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.250990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.252770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.256393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.257832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.260122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.351838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:19.365593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:19.367060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:19.368386 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc0cd22e-809c-4e5d-86b3-62a83ad3d7c8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1743 microversion: 2.20 time: 0.325484 Oct 19 01:07:19.392796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2234/4396] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:19 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1743 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:19.411220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f4d87a5-aa89-4d98-bc30-9784cf702a3f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5c405e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:19.661150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:19.676696 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f4d87a5-aa89-4d98-bc30-9784cf702a3f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1453 microversion: 2.1 time: 0.282434 Oct 19 01:07:19.677331 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2235/4397] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:19 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1453 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:19.684266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-553062fd-042b-4331-b094-e8cb8676d723 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.461131 Oct 19 01:07:19.685249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2163/4398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:19 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:19.689737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:19.690356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:19.704677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.707318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.707971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.709703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.713238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.713902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.791573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:19.792558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:19.805371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.805883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.806828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:19.807841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:19.808312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:19.814578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:20.132659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.143335 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f312c59-d125-4b92-91eb-3a41a1966cc8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.464958 Oct 19 01:07:20.148459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2236/4399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:19 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:20.176569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.192105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.194673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.199295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-091ab259-a613-4987-b4c0-79ce125761d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.413955 Oct 19 01:07:20.203250 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2164/4400] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:19 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:20.406034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:20.406829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:20.435211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:20.437855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:20.441119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:20.442210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:20.443362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:20.445289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:20.692339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b124b538-ecad-415c-93a9-d3b09c0a8da8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d9e700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:20.799233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.817256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.829186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:20.834173 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-262438d7-cdd4-461e-9e34-7947a7e9787a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.431789 Oct 19 01:07:20.835648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2237/4401] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:20 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:20.851019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:20.851929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:20.866098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:20.869363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:20.871520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:20.873434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:20.874010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:20.874549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:21.102650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:21.113693 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80185dec-bcc9-49b3-9502-bf8bfca47266 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.271771 Oct 19 01:07:21.115659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2238/4402] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:20 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:21.171429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:21.172936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:21.188741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:21.193791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:21.194614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:21.195549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:21.196434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:21.198333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:21.576733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:21.591016 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ccce5c28-b89a-4e82-bffb-7ef6f9f2d27c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.423319 Oct 19 01:07:21.605899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2239/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:21 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:21.622304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:21.623058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:21.658697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:21.659213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:21.659675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:21.664353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:21.665072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:21.665538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:22.184056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.203974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.203974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.205431 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26843819-458c-4520-b29d-8cf4b6d579fd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.598424 Oct 19 01:07:22.223458 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2240/4404] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:21 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:22.230326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:22.231180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:22.266595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:22.268657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:22.272468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:22.273504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:22.275567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:22.276221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:22.770416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.791416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.798697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:22.800059 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa1460bf-27b5-4231-9d77-791808b763fa tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.574103 Oct 19 01:07:22.800692 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2241/4405] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:22 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:22.823123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:22.825642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:22.848546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:22.849254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:22.849714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:22.850614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:22.851690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:22.853692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:23.182716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:23.197562 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5323f1b9-63dd-4713-a942-7113a600217f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.387614 Oct 19 01:07:23.198726 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2242/4406] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:22 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:23.213877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:23.215877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:23.228898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:23.229649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:23.230319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:23.236180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:23.237435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:23.238783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:23.696975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:23.704893 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:23.715760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e612442b-3f0f-4228-80b0-9a7da6faa01d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.515641 Oct 19 01:07:23.722323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2243/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:23 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:23.746111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:23.746756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:23.763643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:23.764663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:23.773279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:23.774694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:23.775358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:23.775959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:24.431133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.452317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.459668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.461967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-594a1101-6bed-4de1-b3a3-d6c694b5accf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.731047 Oct 19 01:07:24.476645 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2244/4408] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:23 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:24.476645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:24.476645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:24.491548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:24.492047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:24.492491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:24.494176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:24.494722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:24.495097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:24.813781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.847940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.850630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:24.852991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a5d90152-480e-4f85-b8b2-a09d857067a3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.388743 Oct 19 01:07:24.856612 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2245/4409] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:24 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:24.869768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:24.871852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:24.899188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:24.902163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:24.902871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:24.905182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:24.907857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:24.909414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:25.412841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:25.425345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b1b4254-bd92-4d57-9d40-a215b5bd5cc3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.564487 Oct 19 01:07:25.426372 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2246/4410] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:24 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:25.471196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed075090-4932-426a-a6fd-4a773fce4145", "name": "network-vif-plugged", "status": "completed", "tag": "03828afd-d39c-43a9-8cc6-cd8aa2059bbb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:25.507683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:25.508581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:25.511439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:25.548950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] Creating event network-vif-plugged:03828afd-d39c-43a9-8cc6-cd8aa2059bbb for instance ed075090-4932-426a-a6fd-4a773fce4145 on n-h2-master-1 Oct 19 01:07:25.558851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2fed89b5-e8f0-4828-b99c-a8ec1c3650fc req-311081c7-8575-4a22-bef0-041a18147ec8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111643 Oct 19 01:07:25.560081 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2247/4411] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:25.568403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:25.569495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:25.578978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:25.579826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:25.580518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:25.581682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:25.582370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:25.583154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:25.822156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:25.845489 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db214701-6fb4-4022-80a0-f82ed931757d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.283547 Oct 19 01:07:25.846868 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2248/4412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:25 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:25.852940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:25.853933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:25.861515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:25.865813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:25.866589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:25.867593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:25.868279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:25.868987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:26.264527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.278882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.287785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.289238 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c8f0d92-f4f9-4b83-9868-94be482e19fc tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.440829 Oct 19 01:07:26.290145 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2249/4413] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:25 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:26.304955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:26.304955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:26.314866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:26.317215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:26.322474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:26.323403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:26.323938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:26.324257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:26.761904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.807838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.830852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:26.834751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-30d5e989-9221-45d7-9a0a-7f2326a240bc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.541934 Oct 19 01:07:26.838699 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2250/4414] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:26 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:26.845156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:26.846042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:26.853364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:26.854153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:26.854944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:26.855937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:26.856785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:26.857544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:27.225877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:27.242406 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee9e94e3-5e1d-4bec-8ad1-02606f170562 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.397190 Oct 19 01:07:27.243241 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2251/4415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:26 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:27.269673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:27.271952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:27.286690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:27.289393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:27.289948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:27.293376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:27.297445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:27.298763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:27.727681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:27.737716 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-184f8e6b-2a98-4d9a-a9a9-39c75e81e2be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1316 microversion: 2.1 time: 0.479598 Oct 19 01:07:27.758685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2252/4416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:27 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:27.765641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:27.768167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:27.776596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:27.777416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:27.778095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:27.780011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:27.780750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:27.782011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:28.378446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:28.390203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:28.399644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:28.405066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fecfa47b-5248-4c26-b9ca-19101466d2d9 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.644194 Oct 19 01:07:28.405960 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2253/4417] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:27 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:28.438779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "name": "network-vif-plugged", "status": "completed", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:28.467548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:28.468112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:28.468558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:28.531036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] Creating event network-vif-plugged:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h1-master-1 Oct 19 01:07:28.570503 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c99a185b-c87b-4396-b9c8-29ad9699e1e8 req-f95189d5-c145-467f-bb8f-9f7e96e3182f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151597 Oct 19 01:07:28.574986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2254/4418] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:28.601126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:28.601859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:28.638423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:28.639060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:28.639524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:28.640611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:28.641115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:28.652138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:29.148073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:29.164095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:29.170348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:29.173290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a77092f1-4726-4d0b-8402-1353fac32238 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.595392 Oct 19 01:07:29.174469 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2255/4419] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:28 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:29.186841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:29.187891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:29.200465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:29.203375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:29.205164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:29.206200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:29.210179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:29.210975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:29.529889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:29.543086 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc210075-d23d-4453-92b6-77fc6b2366f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.362787 Oct 19 01:07:29.563166 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2256/4420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:29 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:29.570678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:29.572573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:29.593852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:29.594373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:29.594827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:29.595727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:29.596033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:29.596456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:29.817838 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:30.088554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:30.105047 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1e51f05-7658-49ad-b684-dbbfb09ecd13 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1505 microversion: 2.1 time: 0.534463 Oct 19 01:07:30.107850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2257/4421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:29 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:30.134805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:30.141140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:30.151357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:30.154533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:30.155191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:30.156101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:30.157145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:30.161710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:30.186326 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=49 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:30.594624 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:30.613544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:30.616230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:30.626485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97fb46e4-1fd8-4ce6-a829-56d42c4188d7 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.497180 Oct 19 01:07:30.627336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2258/4422] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:30 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:30.638998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:30.639870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:30.651412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:30.652200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:30.654628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:30.655560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:30.656207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:30.660274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:30.723804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:07:30.977628 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2bc12a4f-8b0a-4b7e-8eae-6cefee26acff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 204 len: 0 microversion: 2.1 time: 0.348636 Oct 19 01:07:30.978282 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2259/4423] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:07:30 2022] DELETE /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:07:30.996228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:30.997369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:31.011343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.012136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.016047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:31.017074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.019073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.019706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:31.082858 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:31.335413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:31.351133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:31.353853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:31.362365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69ad4d32-dc52-43e0-8cec-59f829068d12 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.378520 Oct 19 01:07:31.363736 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2260/4424] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:30 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:31.374527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:31.378016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:31.390250 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:31.393979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.395072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.397019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:31.402125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.402868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.403495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:31.784572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:31.797504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58639b41-31ff-4cea-9d78-d71ed9a5f860 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.430007 Oct 19 01:07:31.798110 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2261/4425] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:31 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:31.838520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:31.840437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:31.863505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.866432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.868125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:31.869846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:31.872967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:31.875448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:32.247463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:32.263773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c69fd54a-a1ac-41eb-bd3d-de4e027118e9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1511 microversion: 2.1 time: 0.434373 Oct 19 01:07:32.266073 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2262/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:31 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:32.280208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c5c2bc-3833-4752-8ad2-e93373a02c26", "name": "network-vif-plugged", "status": "completed", "tag": "566fe953-5648-4dd1-80f8-a63e4b846ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:32.319322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:32.320132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:32.324427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:32.370850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] Creating event network-vif-plugged:566fe953-5648-4dd1-80f8-a63e4b846ff7 for instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 on n-h1-master-1 Oct 19 01:07:32.384134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5605737f-ee9e-47ae-a933-4f2c80c9a3a9 req-369e4a82-2d06-41a7-a9c9-3f8c28ec3ff2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116585 Oct 19 01:07:32.391470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2263/4427] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:32.414546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:32.417478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:32.451027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:32.451940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:32.454116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:32.467282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:32.467887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:32.468354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:33.051625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.063092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.065121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.066513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74711c9d-1787-434a-9a82-ccd81fdc41ed tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.671556 Oct 19 01:07:33.067350 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2264/4428] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:32 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:33.072472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:33.073324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:33.080195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:33.080925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:33.081540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:33.082413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:33.083552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:33.084245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:33.456381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.482909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.484894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.485694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b6b8445-53df-4961-b5cd-4a63f6476851 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.417047 Oct 19 01:07:33.486275 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2265/4429] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:33 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:33.520927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:33.521562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:33.544386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:33.544860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:33.545309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:33.546031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:33.546509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:33.546936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:33.988545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:33.997490 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6871b956-5b1a-435c-aefb-34c93b743e6c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.487883 Oct 19 01:07:34.002135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2266/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:33 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:34.021751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:34.024890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:34.052583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:34.053966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:34.056412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:34.057693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:34.058359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:34.060053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:34.412750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:34.440297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d88eeec4-56c9-485d-a6f8-bdcf9a7a191d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 200 len: 1511 microversion: 2.1 time: 0.427254 Oct 19 01:07:34.453711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2267/4431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:34 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:34.459558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:34.460175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:34.488560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:34.489171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:34.489808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:34.490389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:34.490851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:34.499989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:35.446674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:35.464805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:35.471020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:35.472553 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4ea48ee2-2c78-4448-8093-db48b0c16476 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 1.017688 Oct 19 01:07:35.475175 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2268/4432] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:34 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:35.491201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:35.493532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:35.531295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:35.534120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:35.536877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:35.540911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:35.545881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:35.546552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:36.628601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:36.640640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:36.644747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:36.646128 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8881e34f-2f9d-479d-b8c2-f712e93def5a tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 1.168366 Oct 19 01:07:36.647078 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2269/4433] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:35 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:36.652458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "name": "network-vif-plugged", "status": "completed", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:36.678004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:36.681245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:36.681902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:36.716855 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] Creating event network-vif-plugged:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h1-master-1 Oct 19 01:07:36.730739 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5055286d-2786-4c8b-8929-cb034af2ebc5 req-90155de5-fb43-4045-ad08-d92a1e7b3a4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081318 Oct 19 01:07:36.732159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2270/4434] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:36.743011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed075090-4932-426a-a6fd-4a773fce4145", "name": "network-vif-deleted", "tag": "03828afd-d39c-43a9-8cc6-cd8aa2059bbb"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:36.799356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:36.800586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:36.801761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:36.838747 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] Creating event network-vif-deleted:03828afd-d39c-43a9-8cc6-cd8aa2059bbb for instance ed075090-4932-426a-a6fd-4a773fce4145 on n-h2-master-1 Oct 19 01:07:36.851749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3cd9c9c9-951d-4d40-8c1a-9290da075673 req-74f652a2-2187-4017-bcd2-0776d28223e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117963 Oct 19 01:07:36.862137 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2271/4435] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:36.886376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:36.887187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:36.938552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:36.939063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:36.939524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:36.958556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:36.959256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:36.959727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:37.538028 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:37.563871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-944846c9-13c4-4464-90b3-f3631ddb2d52 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1390 microversion: 2.1 time: 0.700397 Oct 19 01:07:37.564490 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2272/4436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:36 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1390 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:37.572553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:37.573244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:37.605226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:37.606003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:37.606636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:37.607563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:37.609219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:37.609867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:37.650616 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 HTTP/1.1 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ed075090-4932-426a-a6fd-4a773fce4145'} Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:37.670939 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:07:37.677683 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:37.679437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:37.689853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d5b871e-bf71-48d9-8c57-c6f7a363a391 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 404 len: 111 microversion: 2.1 time: 0.124286 Oct 19 01:07:37.690711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2273/4437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:37 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:07:37.710185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:37.711090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:37.723687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:37.738530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:37.740536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:37.744207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:37.744922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:37.745529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:38.726104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:38.782131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:38.798654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:38.805325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-861dd334-fb10-49f7-b19c-e066391ab735 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 1.108490 Oct 19 01:07:38.835955 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2274/4438] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:37 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:38.842390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:38.843299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:38.862959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:38.868250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:38.877959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:38.879184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:38.881292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:38.882307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:39.624932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:39.636990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:39.646264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:39.647355 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d8d113f-eea7-4b9a-8c39-b3c9ae2a915c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.810372 Oct 19 01:07:39.669838 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2275/4439] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:38 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:39.692229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:39.699843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:39.737817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:39.738499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:39.738956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:39.739761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:39.740241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:39.754683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:42.204087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:42.223953 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-264229f8-a2bf-431a-b298-23f558e460bc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 2.546084 Oct 19 01:07:42.225015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2276/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:39 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:42.294304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:42.295366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b124b538-ecad-415c-93a9-d3b09c0a8da8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1462 microversion: 2.1 time: 21.606196 Oct 19 01:07:42.296215 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2165/4441] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:20 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1462 bytes in 21608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:42.302352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:42.316183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:42.317239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:42.329469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:42.333521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:42.334125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:42.338198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:42.338831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:42.339394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:42.357675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:42.363068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:42.365469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:42.368060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:42.370944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:42.375357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.253546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.272957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.285850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.294893 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30ec23f9-09e3-4a04-8aed-695d3e0ddc8c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.997172 Oct 19 01:07:43.298164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.300420 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2166/4442] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:42 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:43.309818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5a67c2f-7ef0-4c45-9ef4-74034ea1c8bb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1563 microversion: 2.1 time: 1.057025 Oct 19 01:07:43.320645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:43.320645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:43.326495 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2277/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:42 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1563 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:43.333029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.334697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.341324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.342981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.344110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.344856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.367753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a71a1d4-f1d7-4403-8431-cc9eb145c09e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5544700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:43.475337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a71a1d4-f1d7-4403-8431-cc9eb145c09e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 200 len: 1462 microversion: 2.1 time: 0.144063 Oct 19 01:07:43.490674 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2278/4444] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:43 2022] GET /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:43.500985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44569073-b5b8-40cd-94ce-af2c62d19467 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44569073-b5b8-40cd-94ce-af2c62d19467 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 163 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": 12345, "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 12345 Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:07:43.513569 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44569073-b5b8-40cd-94ce-af2c62d19467 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:43.518361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44569073-b5b8-40cd-94ce-af2c62d19467 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.023268 Oct 19 01:07:43.524814 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2279/4445] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:43 2022] POST /compute/v2.1/servers => generated 127 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:07:43.534843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:43.535616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:43.585179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.586878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.587501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.588456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.589257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.589870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.707874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.720641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.741143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:43.745501 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50e7c0d6-5fa7-4776-b2dc-f7ba830ebecc tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.442345 Oct 19 01:07:43.749667 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2167/4446] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:43 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:43.759335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:43.761345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:43.782722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.783225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.794811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.797586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:43.798272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:43.804034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:43.967825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.000520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8d606fa-7b99-4b4f-a1fd-2623f36a0311 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1563 microversion: 2.1 time: 0.468099 Oct 19 01:07:44.004464 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2280/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:43 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1563 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:44.013041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:44.027703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:44.041152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.069479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.070096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.072824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.074244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.074845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.141080 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:44.485599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.492109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.499697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c72491c-13d4-4aa0-bca0-ecf899d1799c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1464 microversion: 2.1 time: 0.748695 Oct 19 01:07:44.503021 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e15e751-0e07-4ba1-80c4-46e64d6125cb tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.497106 Oct 19 01:07:44.522117 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2281/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:44 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:44.527985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2168/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:43 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1464 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:44.541572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:44.545449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:44.546778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:44.547404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:44.573186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.574316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.575656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.578716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.579448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.580280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.590091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.590579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.591029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.591768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:44.592212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:44.592664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:44.952198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.962500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.964186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:44.966546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b3e8d673-8c33-4624-a695-2730f30fbd31 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.443263 Oct 19 01:07:44.980076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2282/4450] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:44 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:44.993131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1356255164"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:44.996005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:45.003028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:45.003707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:45.004410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:45.005399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:45.006130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:45.006807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:45.092042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:45.113324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cbfa5e49-1550-4d0c-8db1-62b7ca0d5407 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.574749 Oct 19 01:07:45.114412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2169/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:44 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:45.137556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:45.138390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:45.146097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:45.146801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:45.147411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:45.148290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:45.148961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:45.149561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:45.456985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:45.473715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:45.477285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:45.480761 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-59f1d127-edb5-420b-a687-c7a7475ec8e0 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1738 microversion: 2.20 time: 0.347647 Oct 19 01:07:45.494017 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2170/4452] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:45 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1738 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:45.541347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ad4808e-e6b3-465d-9689-865f0716732c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "POST /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba/action" status: 202 len: 0 microversion: 2.1 time: 0.559330 Oct 19 01:07:45.544561 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2283/4453] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:07:44 2022] POST /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:07:45.559447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c20a3640-b9d2-4370-8cc0-b3279a1be871 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af936caf0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:45.660116 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c20a3640-b9d2-4370-8cc0-b3279a1be871 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.102719 Oct 19 01:07:45.665857 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2171/4454] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:45 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:45.998445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:45.999170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:46.020303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:46.020865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:46.022756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:46.023858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:46.025476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:46.025929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:46.512798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:46.513414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:46.528664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:46.529206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:46.529655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:46.532459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:46.533008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:46.533454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:46.566945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:46.609181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:46.611133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:46.612640 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-000cdc40-918a-4577-baf9-8bb4a2dee4ec tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.619224 Oct 19 01:07:46.617806 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2284/4455] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:45 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:46.680219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d87b4e34-366d-4e43-af95-cd7453dcee59 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af55440d0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:46.751658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d87b4e34-366d-4e43-af95-cd7453dcee59 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.075438 Oct 19 01:07:46.759535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2285/4456] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:46 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:47.083178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:47.098684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:47.104380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:47.106688 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-705d1bb9-d006-4d46-9495-529a834a6e5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1720 microversion: 2.20 time: 0.599706 Oct 19 01:07:47.120654 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2172/4457] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:46 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1720 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:07:47.563506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c5c2bc-3833-4752-8ad2-e93373a02c26", "name": "network-vif-unplugged", "status": "completed", "tag": "566fe953-5648-4dd1-80f8-a63e4b846ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:47.579942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:47.581323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:47.581960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:47.605713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] Creating event network-vif-unplugged:566fe953-5648-4dd1-80f8-a63e4b846ff7 for instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 on n-h1-master-1 Oct 19 01:07:47.611218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0599cf42-7cc0-473c-bc2f-5beb9f2f4f35 req-273f4271-6f55-4532-b451-6c8284138843 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055245 Oct 19 01:07:47.612601 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2286/4458] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:47.647643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:47.648793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:47.669545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:47.670115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:47.670577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:47.671316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:47.671785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:47.672224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:47.768612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9395f490-06f7-4763-82bb-f398e57f2634 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fb91f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:47.840915 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9395f490-06f7-4763-82bb-f398e57f2634 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.077250 Oct 19 01:07:47.842382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2287/4459] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:47 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:48.134159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:48.135043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:48.149023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:48.152130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:48.153073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:48.154200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:48.154995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:48.155680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:48.400522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.411787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.418961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.425159 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f01dee50-07d8-425d-a7fa-2ad37953ad9c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.784429 Oct 19 01:07:48.440144 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2173/4460] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:47 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:48.440144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d7f697b-dc6a-4d00-a318-fe6efad34029 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109287483", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cabeec2c-c546-485d-b60b-11f9973f34c1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:48.588946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1d7f697b-dc6a-4d00-a318-fe6efad34029 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d7f697b-dc6a-4d00-a318-fe6efad34029 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 357 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-109287483", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "cabeec2c-c546-485d-b60b-11f9973f34c1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: exception: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-109287483', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'cabeec2c-c546-485d-b60b-11f9973f34c1'}], 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:48.599773 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d7f697b-dc6a-4d00-a318-fe6efad34029 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Block Device cabeec2c-c546-485d-b60b-11f9973f34c1 is not bootable. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d7f697b-dc6a-4d00-a318-fe6efad34029 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.173138 Oct 19 01:07:48.608271 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2174/4461] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:48 2022] POST /compute/v2.1/servers => generated 110 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:07:48.612839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:48.622952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:48.639010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.640058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:48.640566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:48.642452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:48.643198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:48.643673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:48.652814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:48.656138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.657944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:48.659300 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4c9b4704-7657-4836-a2ec-71ef4df3e95f tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1720 microversion: 2.20 time: 0.529751 Oct 19 01:07:48.683051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2288/4462] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:48 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1720 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:48.859351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e48abb7-1bd8-42b0-8d58-f1725c2165e3 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fcddc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:48.952796 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e48abb7-1bd8-42b0-8d58-f1725c2165e3 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.099920 Oct 19 01:07:48.954734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2289/4463] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:48 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:49.057729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:49.074386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08a40826-e17b-4de0-8117-e26bbbe646f3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.466806 Oct 19 01:07:49.075423 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2175/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:48 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:49.105669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:49.106637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:49.117704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.118454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.119119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.129869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.134404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.135118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.285557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:49.286250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:49.298829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.299271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.302401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.303222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.303701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.305039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.587230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:49.607904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5537b9d-293f-438b-8fc6-2d55c69ec1d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.507444 Oct 19 01:07:49.611648 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2290/4465] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:49 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:49.617558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:49.664318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.673010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.675626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.712355 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] Creating event network-changed:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h1-master-1 Oct 19 01:07:49.732265 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2d731743-7d58-46d6-a123-22ea2c6bed75 req-22afde7f-42eb-486e-8775-c744e97e7735 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118986 Oct 19 01:07:49.739769 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2291/4466] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:49.759298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:49.764650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:49.777510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.781706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.782447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.783442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.784185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.787756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.836831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:49.851404 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae336ad3-db49-403d-b3e9-98d313dc966f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1563 microversion: 2.1 time: 0.565228 Oct 19 01:07:49.869351 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2176/4467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:49 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1563 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:49.890452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:49.891679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:49.908116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.908953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.910554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:49.913345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:49.914867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:49.918737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:50.679709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:50.698391 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:50.706829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:50.713132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b22a8658-73c4-402d-8bc3-00230428cde8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.969297 Oct 19 01:07:50.713987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2292/4468] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:49 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:50.732827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-96928e47-6400-439b-8504-f91672a67ce6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4fcdaf0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:50.808403 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-96928e47-6400-439b-8504-f91672a67ce6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.091141 Oct 19 01:07:50.809760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2293/4469] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:50 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:50.992520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:51.006428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:51.008078 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:51.009620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0cf739e6-9081-425a-bfc6-e908b2be026c tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1723 microversion: 2.20 time: 1.138479 Oct 19 01:07:51.010386 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2177/4470] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:49 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1723 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:51.040347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9025b0f3-20e1-4b2b-8199-bf9a738d111e"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:51.043283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:51.078346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:51.078855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:51.079310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:51.080040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:51.080506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:51.081000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:51.745969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:51.755730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:51.785189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:51.786004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:51.786657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:51.788140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:51.792435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:51.793201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:52.026995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-868e4a4c-5bd7-408f-9db7-877a3d7407da tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.990661 Oct 19 01:07:52.028220 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2294/4471] 10.222.0.27 () {62 vars in 1364 bytes} [Wed Oct 19 01:07:51 2022] POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments => generated 188 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:07:52.062178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3e224d9-7143-4e92-96bf-9c041d32e1ae tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af452a820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:52.154944 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3e224d9-7143-4e92-96bf-9c041d32e1ae tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.124877 Oct 19 01:07:52.165056 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2295/4472] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:52 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:52.165056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "99e14050-3458-4a6f-941f-fd4d097c5722"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:52.206414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:52.208356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:52.209335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:52.214278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:52.218842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:52.226158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:52.234099 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9faac4c5-a729-45a9-820b-bf044df48f62 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.493634 Oct 19 01:07:52.276132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] Creating event network-vif-plugged:99e14050-3458-4a6f-941f-fd4d097c5722 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:52.282308 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2178/4473] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:51 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:52.301344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-303b2739-1d16-4428-a695-04fca5e6ecf5 req-3f5e9bcc-8bd1-4673-a55d-649b0c0ed419 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138413 Oct 19 01:07:52.302734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2296/4474] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:52.357330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:52.358861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:52.378309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:52.380768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:52.381568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:52.385926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:52.387429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:52.388198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:52.694274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9dae761b-7810-4491-896e-45bb11be8032 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1184404068", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "destination_type": "local"}, {"source_type": "volume", "uuid": "22c05468-aaa8-49c1-a0c2-ff1e77d800d9", "destination_type": "invalid"}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9dae761b-7810-4491-896e-45bb11be8032 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 495 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1184404068", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "destination_type": "local"}, {"source_type": "volume", "uuid": "22c05468-aaa8-49c1-a0c2-ff1e77d800d9", "destination_type": "invalid"}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1184404068', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '22c05468-aaa8-49c1-a0c2-ff1e77d800d9', 'destination_type': 'invalid'}], 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'invalid' Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:52.700902 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9dae761b-7810-4491-896e-45bb11be8032 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:52.709031 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9dae761b-7810-4491-896e-45bb11be8032 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.020933 Oct 19 01:07:52.739259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2297/4475] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:52 2022] POST /compute/v2.1/servers => generated 155 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:07:52.750501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:52.751268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:52.807520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:52.812921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:52.817113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:52.822827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:52.823430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:52.825609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.076532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3bc3bf1-8e25-4541-9425-542739a85ed6 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments/9025b0f3-20e1-4b2b-8199-bf9a738d111e" status: 202 len: 0 microversion: 2.20 time: 0.723578 Oct 19 01:07:53.079373 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2179/4476] 10.222.0.27 () {60 vars in 1457 bytes} [Wed Oct 19 01:07:52 2022] DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments/9025b0f3-20e1-4b2b-8199-bf9a738d111e => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:07:53.172991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-113ba8ea-a124-4e9f-a44c-377682b174ee tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5c9df70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:53.281154 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-113ba8ea-a124-4e9f-a44c-377682b174ee tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.112797 Oct 19 01:07:53.283778 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2180/4477] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:53 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:53.295773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:53.299209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:53.317569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.318089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.318545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.319298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.319751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.320201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.549862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 01:07:53.681045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:53.690598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73197a8b-6e65-4a89-a366-028713ee1818 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.950134 Oct 19 01:07:53.710534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2298/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:52 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:53.747938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:53.749025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:53.768753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.780314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.786663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.789695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.791272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.793614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.869532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99456ab8-08e8-441e-a291-bbe882bbc587 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/action" status: 202 len: 0 microversion: 2.20 time: 0.581634 Oct 19 01:07:53.882219 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2181/4479] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 01:07:53 2022] POST /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:07:53.889869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:53.912511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:53.944899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.947522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.950240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.956973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:53.958698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:53.960786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:53.975611 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:55.664960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:55.683088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ed65262-cfc5-4ff2-b7b9-e26b1114adb6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 1.797216 Oct 19 01:07:55.683783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2182/4480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:53 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:55.710196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:55.710836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:55.719281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:55.720123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:55.721263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:55.723375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:55.724122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:55.724761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:55.764373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:55.786180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:55.793609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:55.807010 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b23897e1-dd77-4228-92f5-a744b5a521b3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 2.092523 Oct 19 01:07:55.813015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2299/4481] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:53 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 2102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:55.833105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc2fa2f7-0e00-44fd-ab98-2a943590f9a2 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af9374e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:55.982408 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc2fa2f7-0e00-44fd-ab98-2a943590f9a2 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.167966 Oct 19 01:07:55.985258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2300/4482] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:55 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:56.041577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "name": "network-vif-unplugged", "status": "completed", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "721aec34-2caf-4b3d-a272-ae4a9fff87e7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:56.088091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.088693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.089151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.147266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.compute.server_external_events [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Unable to find a host for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f. Dropping event network-vif-unplugged {{(pid=131449) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 01:07:56.158211 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] Creating event network-vif-plugged:721aec34-2caf-4b3d-a272-ae4a9fff87e7 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:56.174567 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-30bb8bd7-e1e5-45d3-835a-8e791d94be3e req-a360f9de-3996-48e5-a4e2-41d4a048c151 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.163053 Oct 19 01:07:56.175212 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2301/4483] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 189 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 01:07:56.198425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b8860c8-8e81-4e43-9d23-2be860aa46b6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-813891131", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b8860c8-8e81-4e43-9d23-2be860aa46b6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 491 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-813891131", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-813891131', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.229465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:56.233817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b8860c8-8e81-4e43-9d23-2be860aa46b6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:56.236436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b8860c8-8e81-4e43-9d23-2be860aa46b6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.050324 Oct 19 01:07:56.239407 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2302/4484] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:56 2022] POST /compute/v2.1/servers => generated 624 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:07:56.255806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:56.256712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:56.277713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:56.278692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.279211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.279663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.284105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.284607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.286223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.288909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:56.295349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:56.296960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df9a5475-ec74-43a6-99c6-d381b0ae0e53 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1671 microversion: 2.20 time: 0.603209 Oct 19 01:07:56.301970 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2183/4485] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:55 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1671 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:56.845636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:56.846363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:56.854245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.854743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.855182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.855896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.867897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:56.877165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.878021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.883883 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-185ff656-e69d-41d2-9da1-0f1066cdafd1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.642057 Oct 19 01:07:56.920495 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2303/4486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:56 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:56.934435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:56.935147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:56.967701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.968211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.968681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:56.977787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:56.978402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:56.978868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:57.552469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:57.561873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:57.564164 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:07:57.584361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17168a3d-822d-4be5-bc72-5cb86cc4d11f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.662595 Oct 19 01:07:57.594944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2304/4487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:56 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:57.594944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bbe6a69-1754-4822-b0b9-d6cae8e43859 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4e58280>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:57.595284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:57.595284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:57.595284 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-56ead44e-1c2d-48d9-bb10-ada900d52857 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.751744 Oct 19 01:07:57.595284 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2184/4488] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:56 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:57.611832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:57.613757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:57.635297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:57.636932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:57.637338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:57.640193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:57.641404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:57.644414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:57.685856 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bbe6a69-1754-4822-b0b9-d6cae8e43859 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.099318 Oct 19 01:07:57.703764 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2305/4489] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:57 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:57.713048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5356139e-ccc5-47c7-8373-0b6347887949 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5356139e-ccc5-47c7-8373-0b6347887949 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 416 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.717499 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:07:57.723457 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:57.732172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5356139e-ccc5-47c7-8373-0b6347887949 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:57.733418 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5356139e-ccc5-47c7-8373-0b6347887949 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.028588 Oct 19 01:07:57.734607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2306/4490] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:57 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:07:57.764813 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:57.765893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:57.777595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:57.783237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:57.783962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:57.787648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:57.788399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:57.789134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.130339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:58.136064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:58.169007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44ed589e-6d35-44e1-8f1f-00a204b2bcf6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.427520 Oct 19 01:07:58.171652 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2307/4491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:57 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:58.172577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:58.174798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:58.177266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae4ac53c-c737-48de-a716-06b25045a349 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.581849 Oct 19 01:07:58.178332 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2185/4492] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:57 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:58.200132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:58.201663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:58.215601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.219427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.220268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.221298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.226283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.227547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.562319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:58.581020 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37e082b9-d656-4539-b984-6dda6a1a5d0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.384861 Oct 19 01:07:58.582401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2308/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:58 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:58.629770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:58.630694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:58.665621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.666223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.666684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.667444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.667910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.678580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.703674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c91ebcc2-77e6-4780-870d-530b8aff3d4d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af93741f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:58.777446 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c91ebcc2-77e6-4780-870d-530b8aff3d4d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.079432 Oct 19 01:07:58.778346 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2309/4494] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:07:58 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:07:58.783671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e0dbc56-262c-4f10-b286-08efefa0466c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2134998938", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": -1, "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:58.815099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8e0dbc56-262c-4f10-b286-08efefa0466c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Flavor -1 could not be found. Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e0dbc56-262c-4f10-b286-08efefa0466c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 206 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2134998938", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": -1, "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: exception: Flavor -1 could not be found. Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2134998938', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': -1, 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:58.823334 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 19 01:07:58.828756 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:07:58.831848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e0dbc56-262c-4f10-b286-08efefa0466c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:07:58.840938 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e0dbc56-262c-4f10-b286-08efefa0466c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.053402 Oct 19 01:07:58.841878 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2310/4495] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:07:58 2022] POST /compute/v2.1/servers => generated 73 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 01:07:58.851262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:58.852182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:58.862487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.867757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.868671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:58.869705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:58.870346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:58.874340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:59.314075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:59.329814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:59.331721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:59.333663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e752473d-49ad-4dab-ba3b-a9370adc9dc8 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.708707 Oct 19 01:07:59.349405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2186/4496] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:58 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:07:59.358279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "efb6bc64-e058-4f7e-bee3-a9a36db12eb4"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "5fed55e1-6607-4d7f-aedd-c225114d151f"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "8e2e8ddf-967a-4d6e-b31d-f682369381c4"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "38f11a8d-d34c-40f5-9986-fb064f507f0b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:07:59.371443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:59.372399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:59.373095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:59.394211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:07:59.403450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-78c4f6a6-22b3-48a6-92ae-415b8ca2c274 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.557110 Oct 19 01:07:59.403736 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Creating event network-vif-plugged:efb6bc64-e058-4f7e-bee3-a9a36db12eb4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:59.405107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Creating event network-vif-plugged:5fed55e1-6607-4d7f-aedd-c225114d151f for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:59.406035 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Creating event network-vif-plugged:8e2e8ddf-967a-4d6e-b31d-f682369381c4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:59.406378 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2311/4497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:58 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:07:59.412089 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] Creating event network-vif-plugged:38f11a8d-d34c-40f5-9986-fb064f507f0b for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:07:59.415918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:59.417178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:59.430982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-54eb4cf0-b6f2-4af2-8f05-43b5ec420699 req-64e21988-857b-4a3b-9e53-674f6de6e648 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.079788 Oct 19 01:07:59.432599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2187/4498] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:07:59.438611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:59.439123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:59.439571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:59.440310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:59.440801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:59.445326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:59.447125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:07:59.447959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:07:59.463209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:59.464148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:59.464864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:07:59.465834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:07:59.469290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:07:59.470329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:00.308595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:00.325682 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd671c17-8b2c-4fa4-802b-14dc55db01d0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.890978 Oct 19 01:08:00.337801 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2188/4499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:07:59 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:00.345867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:00.361902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:00.366165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:00.370831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c73dbd31-262d-443d-b974-b57545dae096 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af42b50d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:00.372584 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-427c1144-346f-422c-9704-3e4f6674bcd8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.959489 Oct 19 01:08:00.385244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2312/4500] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:07:59 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:00.411368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:00.417020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:00.435378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:00.437106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:00.439276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:00.448174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:00.449287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:00.450176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:00.508738 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c73dbd31-262d-443d-b974-b57545dae096 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.168741 Oct 19 01:08:00.516793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2189/4501] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:00 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:00.516793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76457ace-66cf-4ec5-8036-d32ae90b6b1d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-921018204", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76457ace-66cf-4ec5-8036-d32ae90b6b1d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 172 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-921018204", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-921018204', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi -1 Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:08:00.535272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76457ace-66cf-4ec5-8036-d32ae90b6b1d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76457ace-66cf-4ec5-8036-d32ae90b6b1d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022848 Oct 19 01:08:00.541303 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2190/4502] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:00 2022] POST /compute/v2.1/servers => generated 145 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:08:00.560859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:00.568112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:00.590888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:00.592565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:00.593068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:00.596523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:00.597139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:00.600478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.050402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:01.061615 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3169c14-4493-4d49-b282-6bf4fa82081b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.507408 Oct 19 01:08:01.088361 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2191/4503] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:00 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:01.094854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:01.107126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.107941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.108787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.122424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] Creating event network-changed:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h2-master-1 Oct 19 01:08:01.128897 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-94d11778-5d62-4f61-917f-c5675cde2c90 req-b33ddcd8-94ab-4b7e-a6d4-1ca4ef8e7952 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038432 Oct 19 01:08:01.130343 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2192/4504] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:01.136095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:01.137107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:01.144843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.145655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.146371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.147332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.148034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.148860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.245068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:01.256264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:01.262474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:01.265273 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ed79167-4ec2-44e8-836d-cc68055213fe tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.869443 Oct 19 01:08:01.271915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2313/4505] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:00 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:01.407341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:01.407996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:01.415843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.417681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.421641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.422466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.422954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.423394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.527091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:01.540143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28f42007-f55e-4289-b5cc-0b87507afee5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.408283 Oct 19 01:08:01.544931 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2193/4506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:01 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:01.558936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fca9f607-ce33-478d-bf4c-79702df14918 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5c9d9d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:01.661706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fca9f607-ce33-478d-bf4c-79702df14918 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1453 microversion: 2.1 time: 0.115378 Oct 19 01:08:01.670700 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2194/4507] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:01 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:01.679502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-plugged", "status": "completed", "tag": "0da738a0-f0f8-4ef5-a13f-8bf8beb69f95"}, {"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-plugged", "status": "completed", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:01.709443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.709940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.710384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.746544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Creating event network-vif-plugged:0da738a0-f0f8-4ef5-a13f-8bf8beb69f95 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:08:01.747421 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] Creating event network-vif-plugged:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:08:01.755957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f63523b3-375c-4f39-9274-9da0e6057515 req-74a5b224-8957-4fb0-9293-58851bd6f5c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083893 Oct 19 01:08:01.757758 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2195/4508] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:01.763721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f4221c7-24ea-4360-8639-602dd5866a24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-208175027", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:01.771018 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3f4221c7-24ea-4360-8639-602dd5866a24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f4221c7-24ea-4360-8639-602dd5866a24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 215 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-208175027", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-208175027', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:01.773630 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 19 01:08:01.778022 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:01.781963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f4221c7-24ea-4360-8639-602dd5866a24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:01.783515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f4221c7-24ea-4360-8639-602dd5866a24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.024366 Oct 19 01:08:01.785214 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2196/4509] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:01 2022] POST /compute/v2.1/servers => generated 123 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:08:01.795047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:01.796233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:01.805689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.806636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.807341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:01.808563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:01.809291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:01.809973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:02.117629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.126219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.130704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.135308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-163ec816-f2a4-4f2d-9714-443b8588d5f9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.731851 Oct 19 01:08:02.137662 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2314/4510] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:01 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:08:02.211870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.233251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78898cf9-c5fe-44d6-836c-d812e0917e64 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.443493 Oct 19 01:08:02.234180 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2197/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:01 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:02.277052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:02.278521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:02.304256 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:02.305316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:02.314024 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=82 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:02.322657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:02.322999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:02.323713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:02.324355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:02.325947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:02.326186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:02.326811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:02.328338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:02.328846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:02.329536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:02.330179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:02.331735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:02.790526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.801415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.828568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:02.834519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d815b073-5643-4a03-893c-f4ce52f64437 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1874 microversion: 2.32 time: 0.531904 Oct 19 01:08:02.835999 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2198/4512] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:02 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1874 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:02.859691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e3244fa-c898-4ae2-b8e7-661ec8c9694b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4bf1af0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:02.992809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:03.006224 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf39b996-da9e-4163-a47e-19cd9b5c9069 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.743091 Oct 19 01:08:03.007902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2315/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:02 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:03.136935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-206030266", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-key-2029070749", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:12.312971 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:12.798975 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=65 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:13.001383 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=43 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:13.202635 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:16.407066 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e3244fa-c898-4ae2-b8e7-661ec8c9694b tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1462 microversion: 2.1 time: 13.567503 Oct 19 01:08:16.420711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] validate_networks() for [('231315bc-4360-4e98-8040-ec0c2c31211f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:08:16.432704 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2199/4514] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:02 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1462 bytes in 13596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:16.446063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:16.447400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:16.461554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:16.462345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:16.463086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:16.464143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:16.465156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:16.465829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:17.131865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:17.149686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:17.158759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:17.165745 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec9e62c7-8555-4061-be95-5279260f05eb tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.727325 Oct 19 01:08:17.169131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2200/4515] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:16 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:17.204790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:17.207855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:17.228638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:17.235722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:17.236557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:17.238091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:17.238802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:17.239472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:17.608490 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Invalid key_name provided. Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 246 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-206030266", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-key-2029070749", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid key_name provided. Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-206030266', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'key_name': 'tempest-key-2029070749', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2029070749 not found for user fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:17.615650 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 19 01:08:17.623953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:17.659500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid key_name provided. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:17.668443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1940bda-8da4-4fbc-820f-340407e96ee6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 14.532910 Oct 19 01:08:17.685162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2316/4516] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:03 2022] POST /compute/v2.1/servers => generated 70 bytes in 14545 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 19 01:08:17.702720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:17.714546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:17.756914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:17.758762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:17.759425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:17.761394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:17.765450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:17.766119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:17.959487 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5964690-6ffd-4e5e-91b9-11438061aafe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action" status: 200 len: 32636 microversion: 2.1 time: 0.269620 Oct 19 01:08:17.961963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2317/4517] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:17 2022] POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action => generated 32636 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:08:17.998703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5bb2926c-34bb-43aa-aa91-6dd4c7852e6d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af9374a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:18.078122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:18.110378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:18.114031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:18.116573 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c78e23f-d47e-467e-a269-5c922affd15a tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2827 microversion: 2.32 time: 0.944825 Oct 19 01:08:18.119264 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2201/4518] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:17 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2827 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:18.126194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5bb2926c-34bb-43aa-aa91-6dd4c7852e6d tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 200 len: 1462 microversion: 2.1 time: 0.152849 Oct 19 01:08:18.127373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2318/4519] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:17 2022] GET /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 1462 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:18.142011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:18.146024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:18.146741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:18.147212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:18.158240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.162744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.163442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.164382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.165951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.166907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.167233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.168042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.168584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.171610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.172556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.173602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.788802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:18.791893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:18.804059 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c33acee-d407-4bcd-9ee0-4d5cc6270ba4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.681015 Oct 19 01:08:18.806697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2202/4520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:18 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:18.821507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:18.823355 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:18.835335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.840589 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de12e27c-6317-48dd-8642-6acefdbd3576 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1467 microversion: 2.1 time: 0.699110 Oct 19 01:08:18.841268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.841756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.842506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.842776 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2319/4521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:18 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1467 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:18.846034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.846908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.856259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:18.857428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:18.876791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.877614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.882157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:18.883336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:18.883949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:18.888161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:19.304426 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab0d5679-68e9-4347-8c45-6148cb48de07 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.495406 Oct 19 01:08:19.329840 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2203/4522] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:08:18 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90/os-interface => generated 1832 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:19.337378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:19.339658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:19.358113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:19.360336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:19.362744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:19.365316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:19.367214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:19.368326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:20.193567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:20.206393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:20.211857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:20.217554 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22e18df5-f2bd-4912-b90a-433cc75e0cf9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 1.368627 Oct 19 01:08:20.226383 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2320/4523] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:18 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:20.245674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:20.249510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:20.266686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:20.266686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:20.266686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:20.268889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:20.269729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:20.270472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:21.547101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:21.556770 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62e008a6-8b8d-4cd0-8dbc-9f8d1764a6d4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 1.328983 Oct 19 01:08:21.573082 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2321/4524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:20 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:21.602796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-416a03b4-277c-42e2-9fa5-af593f996d5e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4528b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:21.824299 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-416a03b4-277c-42e2-9fa5-af593f996d5e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-10-19T01%3A05%3A58Z" status: 200 len: 2376 microversion: 2.1 time: 0.248936 Oct 19 01:08:21.838641 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2322/4525] 10.222.0.27 () {58 vars in 1199 bytes} [Wed Oct 19 01:08:21 2022] GET /compute/v2.1/images?changes-since=2022-10-19T01%3A05%3A58Z => generated 2376 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:21.849214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:21.849861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:21.864424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:21.864966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:21.865420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:21.866156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:21.866619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:21.870879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:21.890762 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e10fe39-94eb-4506-9ea8-f38ffe1772c7 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1833 microversion: 2.1 time: 2.559028 Oct 19 01:08:21.891973 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2204/4526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:19 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1833 bytes in 2561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:21.902986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-unplugged", "status": "completed", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:21.933330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:21.935380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:21.937381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:21.964906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] Creating event network-vif-unplugged:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:08:21.973143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-949fb91e-ee89-45fd-849a-cde86637a72d req-e6a652f4-aaf9-446c-a10f-8f024a6032a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079534 Oct 19 01:08:21.973767 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2205/4527] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:21.981276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839541716", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:22.279997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.security_group_api [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Neutron security group does_not_exist not found {{(pid=131450) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 19 01:08:22.281184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 258 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1839541716", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1839541716', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 19 01:08:22.294109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:22.303668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:22.317291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2fbeab4-15f4-4a41-ac7e-2c04190bc418 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.320657 Oct 19 01:08:22.317291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2206/4528] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:08:22.317291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9640f269-e17b-45e4-b695-e668b51ac631 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4865670>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:22.333582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:22.343983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:22.345719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:22.352007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c943a29a-1570-47e0-a16a-7e3645eb1cc8 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.509139 Oct 19 01:08:22.354477 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2323/4529] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:21 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:22.368130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:22.372184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:22.391410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:22.391917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:22.392365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:22.393114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:22.393580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:22.394174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:22.471530 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9640f269-e17b-45e4-b695-e668b51ac631 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1716052101" status: 200 len: 485 microversion: 2.1 time: 0.173103 Oct 19 01:08:22.475657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2207/4530] 10.222.0.27 () {58 vars in 1231 bytes} [Wed Oct 19 01:08:22 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1716052101 => generated 485 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:22.490775 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:22.494678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:22.509221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:22.509767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:22.510220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:22.510953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:22.511422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:22.511844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:22.905699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:22.915181 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fab78856-26bc-4f07-b8aa-6e989381ae15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.435248 Oct 19 01:08:22.919623 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2208/4531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:22 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:22.925307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2222c9a-3259-4532-bc80-1594228fdbd7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af497f940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.020083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:23.053171 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7b91fab-2d24-4b2e-905d-06a083e03683 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1682 microversion: 2.1 time: 0.697435 Oct 19 01:08:23.054708 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2324/4532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:22 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1682 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:23.066182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2222c9a-3259-4532-bc80-1594228fdbd7 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?server=a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 958 microversion: 2.1 time: 0.145371 Oct 19 01:08:23.067061 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2209/4533] 10.222.0.27 () {58 vars in 1209 bytes} [Wed Oct 19 01:08:22 2022] GET /compute/v2.1/images?server=a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 958 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:23.077447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.077447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:23.096096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58227b8d-fa98-426d-9522-6d4d9cdfbf0a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af46daca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.103026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.103534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.103982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.104739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.105301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.105611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.170167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58227b8d-fa98-426d-9522-6d4d9cdfbf0a tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 485 microversion: 2.1 time: 0.090268 Oct 19 01:08:23.171035 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2210/4534] 10.222.0.27 () {58 vars in 1317 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 485 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:23.196773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-403f452c-30a2-4e25-86f9-af66d5beb98c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4b52160>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.291054 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-403f452c-30a2-4e25-86f9-af66d5beb98c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 485 microversion: 2.1 time: 0.106953 Oct 19 01:08:23.297044 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2211/4535] 10.222.0.27 () {58 vars in 1303 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 485 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:23.310959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0f53380-ec6f-4417-b4e7-1a49e2b12c37 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4865af0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.484910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0f53380-ec6f-4417-b4e7-1a49e2b12c37 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.177732 Oct 19 01:08:23.493031 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2212/4536] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:23.499080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:23.501412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:23.525335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.525771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.526222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.526949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.527444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.527824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.620888 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-161bcc92-7d41-4733-8bcb-572e6acb604a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action" status: 200 len: 32636 microversion: 2.1 time: 0.125913 Oct 19 01:08:23.622710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2213/4537] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:23 2022] POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action => generated 32636 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:08:23.627837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.628896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:23.636704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.637459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.638083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.638968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.639583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.640179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.743385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:23.755357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f960198e-1e7f-4eab-8188-c3936dba837e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.696453 Oct 19 01:08:23.756915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2325/4538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:23.763573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fedcb902-a93d-4f65-af50-d9f5c3946727 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af50bd940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.859903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fedcb902-a93d-4f65-af50-d9f5c3946727 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.101646 Oct 19 01:08:23.869524 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2326/4539] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:23.869524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "tag": "38f11a8d-d34c-40f5-9986-fb064f507f0b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:23.878525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.879123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.879562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.894678 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] Creating event network-changed:38f11a8d-d34c-40f5-9986-fb064f507f0b for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:08:23.901009 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f6c8c212-b60d-4e97-a206-939ce4cb9529 req-eee2da14-d98f-44df-a0f8-0ad5b63dd8bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037391 Oct 19 01:08:23.902809 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2327/4540] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:23.908724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:23.909916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f6e755ed-e9e3-4e2e-8a10-0dd9480976c5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:23.917205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 HTTP/1.1 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f6e755ed-e9e3-4e2e-8a10-0dd9480976c5'} Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:23.926430 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:23.931952 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-708efd7a-3f28-4b69-8cfd-15a821ccd36c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f6e755ed-e9e3-4e2e-8a10-0dd9480976c5" status: 404 len: 111 microversion: 2.1 time: 0.025042 Oct 19 01:08:23.932753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2328/4541] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:08:23 2022] DELETE /compute/v2.1/servers/f6e755ed-e9e3-4e2e-8a10-0dd9480976c5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:23.956316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:23.957310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:23.967487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.968320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.968980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:23.969868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:23.976584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:23.977549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.038621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:24.047060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:24.053612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:24.054983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e43565c-5c32-4d68-8a2b-eab2a8dfce18 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.431273 Oct 19 01:08:24.073232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2214/4542] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:23 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:24.086218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a4678a6-b97a-4609-8486-c3f6b780adf3 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af9422700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:24.096520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0e9884a2aa304ed6b241e20dcbc852ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8fc0312ad4431da003046209628ef5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:24.098677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] flavor_id is None. Assuming migration. {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 01:08:24.099211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:08:24.155969 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a4678a6-b97a-4609-8486-c3f6b780adf3 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.080859 Oct 19 01:08:24.157346 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2215/4543] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 01:08:24 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:24.163563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:24.164420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:24.172367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.173209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.174011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.175543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.176177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.176829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.547460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:24.549092 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b8d69a6-f02b-489c-96bb-337d16d1aa6f tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action" status: 202 len: 0 microversion: 2.1 time: 0.614775 Oct 19 01:08:24.554236 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2329/4544] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:23 2022] POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:08:24.560965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3218ca9-ad20-43c7-9581-8494cf5fd2c0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af9374b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:24.577169 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0c42350-2d38-43a3-948f-9935e2b45c39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.411475 Oct 19 01:08:24.581603 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2216/4545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:24 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:24.598504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:24.600413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:24.620392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.629260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.631660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.635290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.636753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.637770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.737250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3218ca9-ad20-43c7-9581-8494cf5fd2c0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-10-19T01%3A05%3A51Z" status: 200 len: 6329 microversion: 2.1 time: 0.180379 Oct 19 01:08:24.759087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2330/4546] 10.222.0.27 () {58 vars in 1220 bytes} [Wed Oct 19 01:08:24 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-19T01%3A05%3A51Z => generated 6329 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:24.764136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:24.769121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:24.775988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.777022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.777663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:24.778791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:24.779430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:24.780300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:25.453276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:25.478304 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f149c498-bda6-4c02-bd0d-88f188d063fc tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.715059 Oct 19 01:08:25.480268 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2331/4547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:24 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:25.513398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6bbdb6ec-3cfc-4a61-aad4-82dd614d282e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5522a60>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:25.538492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:25.554618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9001c6c-1e21-49fa-b570-e2733388f9b3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1691 microversion: 2.1 time: 0.971544 Oct 19 01:08:25.557392 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2217/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:24 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1691 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:25.574149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:25.575733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:25.595201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:25.606190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:25.622403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:25.626158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:25.627034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:25.627569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:25.712754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6bbdb6ec-3cfc-4a61-aad4-82dd614d282e tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1716052101" status: 200 len: 665 microversion: 2.1 time: 0.231221 Oct 19 01:08:25.713413 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2332/4549] 10.222.0.27 () {58 vars in 1252 bytes} [Wed Oct 19 01:08:25 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1716052101 => generated 665 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:25.732768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:25.733285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 01:08:25.734023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9223372036854775808 could not be found. Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '9223372036854775808'} Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:25.738656 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:25.743401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:25.743401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:25.743401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:25.743401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 19 01:08:25.743401 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:25.748889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:25.750129 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e13a0fcc-2242-479f-bc72-d7831697342b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.035843 Oct 19 01:08:25.751528 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2333/4550] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Oct 19 01:08:25 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:08:25.762932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c531308e-cfc9-48ea-b7d3-5cbc559faa11 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af42a3af0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:25.934385 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c531308e-cfc9-48ea-b7d3-5cbc559faa11 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1465 microversion: 2.1 time: 0.181727 Oct 19 01:08:25.934996 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2334/4551] 10.222.0.27 () {58 vars in 1338 bytes} [Wed Oct 19 01:08:25 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:25.946577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:25.953659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:25.967075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:25.967899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:25.968912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:25.969853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:25.970561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:25.971435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:26.293013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:26.306177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:26.307922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:26.309981 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9301ef21-5127-420e-9f02-22a31a9a9257 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.748509 Oct 19 01:08:26.323258 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2218/4552] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:25 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:26.345698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6cd190a-b2bc-4d43-86a0-d7c7f3570482 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af48afee0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:26.490946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6cd190a-b2bc-4d43-86a0-d7c7f3570482 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1465 microversion: 2.1 time: 0.166450 Oct 19 01:08:26.496767 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2219/4553] 10.222.0.27 () {58 vars in 1324 bytes} [Wed Oct 19 01:08:26 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2F90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:26.514312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdec0d26-b5c4-4d07-b35d-309858fc86fa tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4240040>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:26.709303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:26.721661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c538a430-647c-4ddf-bc63-75e36522ea8a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.785005 Oct 19 01:08:26.736699 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2335/4554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:25 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:26.736699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:26.736699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:26.745883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bdec0d26-b5c4-4d07-b35d-309858fc86fa tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7104 microversion: 2.1 time: 0.235422 Oct 19 01:08:26.748282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:26.749280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:26.749735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:26.750465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:26.750920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:26.752144 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2220/4555] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 01:08:26 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7104 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:26.752947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:26.760176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:26.770623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:26.806389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:26.807133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:26.809093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:26.814216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:26.817424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:26.818823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:27.329698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:27.329698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7eb99607-c84c-4c99-ba66-61866af99bf9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1691 microversion: 2.1 time: 0.534028 Oct 19 01:08:27.329698 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2336/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:26 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1691 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:27.329698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-939042bf-3244-40b9-a17d-c6ec066d3ec8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af58c1820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-939042bf-3244-40b9-a17d-c6ec066d3ec8 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4371 microversion: 2.1 time: 0.107552 Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2337/4557] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 01:08:27 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:27.470656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:27.521470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:27.530332 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a740bdc8-eba4-4c57-8fab-4bfc21b32f81 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.775622 Oct 19 01:08:27.531006 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2221/4558] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:26 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:27.540850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15754b58-b1ec-4c55-b736-a6d04f798242 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af48af1f0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.628952 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15754b58-b1ec-4c55-b736-a6d04f798242 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340" status: 200 len: 784 microversion: 2.1 time: 0.091848 Oct 19 01:08:27.629802 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2222/4559] 10.222.0.27 () {58 vars in 1233 bytes} [Wed Oct 19 01:08:27 2022] GET /compute/v2.1/images/8df5ee37-9b8e-48da-9f04-6c7fec506340 => generated 784 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:27.635699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.636179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Failed to fetch instance by id -1 {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 19 01:08:27.640604 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance -1 could not be found. Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: exception: Instance -1 could not be found. Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '-1'} Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:27.649262 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:27.655631 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:27.655631 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:27.655631 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 19 01:08:27.655631 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:27.657369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:27.659254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7deb519c-ec8a-4ac8-a7bd-00a4d4cc6189 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.027333 Oct 19 01:08:27.660227 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2223/4560] 10.222.0.27 () {58 vars in 1137 bytes} [Wed Oct 19 01:08:27 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:08:27.665711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d75ecd01-faf0-4997-a4f0-9494b05e7799 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4d840d0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.818351 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d75ecd01-faf0-4997-a4f0-9494b05e7799 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.152202 Oct 19 01:08:27.819015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:27.820138 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2224/4561] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 01:08:27 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:27.831490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:27.833331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:27.834569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2106a442-34ed-4f86-a7c6-a618707f30fe tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.453914 Oct 19 01:08:27.838139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.838965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:27.840507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2338/4562] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:27 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:27.845310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-453b958a-b5e4-49f0-8e26-1a9beba84f37 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af42a38b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:27.846849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:27.847768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:27.848395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:27.849329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:27.849952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:27.850550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:28.136109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:28.148852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-48c43b50-3661-4ccb-8fe3-5cdadbcab784 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.326325 Oct 19 01:08:28.162257 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2225/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:27 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:28.175890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:28.176582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:28.185009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:28.185966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:28.186968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:28.187937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:28.188793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:28.190733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:28.874959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-453b958a-b5e4-49f0-8e26-1a9beba84f37 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce" status: 204 len: 0 microversion: 2.1 time: 1.033048 Oct 19 01:08:28.876353 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2339/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:27 2022] DELETE /compute/v2.1/images/b07245e1-3a7e-4b53-b614-3b5bf78853ce => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:28.883257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:28.884541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:28.894729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:28.895228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:28.896126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:28.897079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:28.897855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:28.898977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:29.250489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:29.258992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e95823d-9a04-4fa3-a560-fa54cbb03a42 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 1.087844 Oct 19 01:08:29.285567 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2226/4565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:28 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:29.290784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:29.291602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:29.298543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:29.299403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:29.300123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:29.301301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:29.302110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:29.302901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:29.572051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:29.577446 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-76479ca4-4d2b-42dc-a897-4ace30a93ca5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1691 microversion: 2.1 time: 0.699742 Oct 19 01:08:29.578382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2340/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:28 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1691 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:29.587688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25888861-dc70-4d68-85e5-247772e5b081 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af453b430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:29.843352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:29.861686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:29.866222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:29.869937 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd05c6d3-7dce-4aa6-967d-451f1a54fb93 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.582613 Oct 19 01:08:29.871745 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2227/4567] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:29 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:29.901284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "name": "network-vif-plugged", "status": "completed", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:29.926375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:29.927711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:29.928261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:29.991118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] Creating event network-vif-plugged:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h2-master-1 Oct 19 01:08:30.006408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-72c65173-19d1-40cf-9146-0ea0dd0b759a req-fc40e808-67a4-4e1d-90ff-44ce5a0aa2a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124002 Oct 19 01:08:30.007341 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2228/4568] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:30.017079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:30.020832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:30.028172 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7/action HTTP/1.1 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 19 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: {"forceDelete": {}} Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7', 'body': {'forceDelete': {}}} Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:30.036898 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:30.044381 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:30.044381 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:30.044381 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. Oct 19 01:08:30.044381 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:30.066945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:30.082646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-850602d5-d0d3-40b8-9785-b614b4c83104 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7/action" status: 404 len: 111 microversion: 2.1 time: 0.060944 Oct 19 01:08:30.086030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2229/4569] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:30 2022] POST /compute/v2.1/servers/3ff0bc77-e0fb-48cc-89d6-fefcfa4558b7/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:30.102725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:30.112234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:30.130957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:30.131472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:30.131938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:30.137381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:30.142873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:30.144219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:30.578589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:30.585758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25888861-dc70-4d68-85e5-247772e5b081 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5" status: 204 len: 0 microversion: 2.1 time: 1.006194 Oct 19 01:08:30.586671 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2341/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:29 2022] DELETE /compute/v2.1/images/024304df-667f-4594-958a-6c98a937cdf5 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:30.594583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04ed8f75-ad07-4d29-a705-de49540ff39c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4e7f160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:30.596340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22d3efa6-ace3-4577-a88e-6f8cfee28a9e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.505103 Oct 19 01:08:30.597574 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2230/4571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:30 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:30.609790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:30.610793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:30.621528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:30.622422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:30.623714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:30.628427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:30.629664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:30.630343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:30.664053 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:31.210938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:31.225813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2bd0461d-9b05-4cdd-9f8d-e616e342a693 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.623540 Oct 19 01:08:31.228512 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2231/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:30 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:31.240679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:31.241697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:31.264344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.266160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.266908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.269631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.271097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.271553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.499181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04ed8f75-ad07-4d29-a705-de49540ff39c tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51" status: 204 len: 0 microversion: 2.1 time: 0.908443 Oct 19 01:08:31.500029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2342/4573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:30 2022] DELETE /compute/v2.1/images/4dc69303-dc41-4b3e-ba72-4f77debd9a51 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:08:31.505434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:31.506276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:31.525625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.526155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.526980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.528085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.531308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.531845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.823593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:31.867922 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2c2bb89-ec63-4131-9ccc-3165ced6211b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.637055 Oct 19 01:08:31.873479 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2232/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:31 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:31.892475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:31.895041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:31.913541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.914531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.915166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.916794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:31.917535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:31.918148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:31.954194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:08:32.031186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:32.057785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:32.068811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:32.072604 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1ad21b4-8482-40f2-ab76-0dd48a9d4564 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1729 microversion: 2.20 time: 0.571411 Oct 19 01:08:32.074654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2343/4575] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:31 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1729 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:32.088657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:32.093463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed60b9e9-dd9b-40a2-bab1-1e048422a5b2] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:32.100607 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ed60b9e9-dd9b-40a2-bab1-1e048422a5b2/action HTTP/1.1 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 39 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: {"os-getConsoleOutput": {"length": 10}} Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ed60b9e9-dd9b-40a2-bab1-1e048422a5b2', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:32.113220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. Oct 19 01:08:32.118780 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:32.121654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed60b9e9-dd9b-40a2-bab1-1e048422a5b2 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:32.123279 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9d33610-6328-46f0-84f0-b53879634db3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/ed60b9e9-dd9b-40a2-bab1-1e048422a5b2/action" status: 404 len: 111 microversion: 2.1 time: 0.046705 Oct 19 01:08:32.128055 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2344/4576] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:32 2022] POST /compute/v2.1/servers/ed60b9e9-dd9b-40a2-bab1-1e048422a5b2/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:32.144813 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:32.145749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:32.157841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.158533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.159256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.160281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.161007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.161651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.172784 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f060bd9-af81-40bd-bf83-9efc8a7e55e4 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 204 len: 0 microversion: 2.1 time: 0.297841 Oct 19 01:08:32.173388 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2233/4577] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:08:31 2022] DELETE /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:32.188158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:32.189068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:32.226559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.227071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.227514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.228236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.228716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.229149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.711864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:32.719601 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:32.736169 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c8b18913-2c8c-4e74-ba59-4489d6f6af39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.603290 Oct 19 01:08:32.741578 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2345/4578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:32.762271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:32.780751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:32.824612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.826471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.827091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.831457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.832170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.832852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.856926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:32.866039 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-338a0e53-20a8-45b4-86ee-875f11dc08e0 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1470 microversion: 2.1 time: 0.685588 Oct 19 01:08:32.877098 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2234/4579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:32 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1470 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:32.898147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:32.898853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:32.915693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.916230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.917420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:32.918175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:32.921687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:32.923096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.417072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.425783 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55697f03-513d-48e9-bacd-2a15ed5117f6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.546980 Oct 19 01:08:33.429468 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2235/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:33.441694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:33.442983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:33.453647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.461003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.461586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.462044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.462769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.463238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.463680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.466681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09b2a9e9-2498-4bda-8393-3e0ac74c36d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.722044 Oct 19 01:08:33.467400 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2346/4581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:32 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:33.477327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:33.480415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: d005113d-aefd-449d-94b5-2afe8ba92260] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:33.498718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d005113d-aefd-449d-94b5-2afe8ba92260 HTTP/1.1 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd005113d-aefd-449d-94b5-2afe8ba92260'} Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:33.502178 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:33.508700 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:33.508700 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:33.508700 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:33.508700 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. Oct 19 01:08:33.508700 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:33.515340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance d005113d-aefd-449d-94b5-2afe8ba92260 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:33.516920 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b029a3cc-4adc-4ffc-a70d-4edc8ef45f26 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/d005113d-aefd-449d-94b5-2afe8ba92260" status: 404 len: 111 microversion: 2.1 time: 0.043681 Oct 19 01:08:33.518517 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2347/4582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:33 2022] GET /compute/v2.1/servers/d005113d-aefd-449d-94b5-2afe8ba92260 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:33.531047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:33.531928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:33.546236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.546915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.547720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.548938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.549523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.550229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.841855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.856335 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13637f2e-cbfd-4be1-af2a-c1e324819e24 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.332857 Oct 19 01:08:33.857281 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2348/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:33 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:33.891184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:33.891396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.891941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:33.906899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.909254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:33.910608 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c928c381-448f-4fde-a648-c044055ee58e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1716 microversion: 2.20 time: 0.478290 Oct 19 01:08:33.912863 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2236/4584] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:33 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1716 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:33.924960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.934192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.934996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:33.935943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.936756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:33.938980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.941306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.943172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.947231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.948843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.949587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:33.950649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:33.951488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:33.952195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:34.374974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:34.389866 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e34b672-ef2f-4405-89a4-debd01cbf79f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.506119 Oct 19 01:08:34.391140 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2349/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:33 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:34.495309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:34.496886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:34.513289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:34.515303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:34.515808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:34.518644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:34.519427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:34.524003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:34.595489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:34.615262 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70efcc90-7a16-4bc6-8806-e5c5bcd7ea47 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1470 microversion: 2.1 time: 0.696831 Oct 19 01:08:34.618031 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2237/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:33 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1470 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:34.683321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-432f3e23-8367-428d-a46d-d3d7e71747e5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138743820", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-432f3e23-8367-428d-a46d-d3d7e71747e5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 237 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-138743820", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-138743820', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.708448 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 19 01:08:34.714670 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:34.722715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-432f3e23-8367-428d-a46d-d3d7e71747e5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:34.723886 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-432f3e23-8367-428d-a46d-d3d7e71747e5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.044842 Oct 19 01:08:34.724973 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2238/4587] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 19 01:08:34.735262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:34.736980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:34.762192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:34.764384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:34.765836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:34.768501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:34.769852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:34.770924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.143317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:35.158406 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a822baa-0160-4c60-8b87-2e2b11da20a9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.428469 Oct 19 01:08:35.159578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2239/4588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:34 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:35.164567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c5c2bc-3833-4752-8ad2-e93373a02c26", "name": "network-vif-deleted", "tag": "566fe953-5648-4dd1-80f8-a63e4b846ff7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:35.181579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.182081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.183111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.196169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:35.211010 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] Creating event network-vif-deleted:566fe953-5648-4dd1-80f8-a63e4b846ff7 for instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 on n-h1-master-1 Oct 19 01:08:35.219358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5bfc1f0-1f16-4a18-963b-b8e2266b2596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.728002 Oct 19 01:08:35.233029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2350/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:34 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:35.236854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-741546b5-15d2-4a7e-919b-f7b5473dfa2c req-7716b8c2-7384-4997-bcbc-6717cac8ef10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074352 Oct 19 01:08:35.237984 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2240/4590] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:35.244371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:35.245101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:35.256920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.257522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.257931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.258700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.259232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.259666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.541467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:35.560773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-da45252d-69da-4568-bd84-b4555e21649b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.318958 Oct 19 01:08:35.563171 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2351/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:35 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:35.645480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:35.650359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:35.670532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da39d0bb-9712-4c20-9fa0-af1d36c3550d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113717424", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da39d0bb-9712-4c20-9fa0-af1d36c3550d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 235 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1113717424", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1113717424', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.678423 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da39d0bb-9712-4c20-9fa0-af1d36c3550d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:35.684606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-da39d0bb-9712-4c20-9fa0-af1d36c3550d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.013628 Oct 19 01:08:35.687108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.687108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.687108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.687411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.687621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.691268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.696459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2352/4592] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:35 2022] POST /compute/v2.1/servers => generated 133 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:08:35.711139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:35.717669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:35.739334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.739847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.740304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.741051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.744548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.745045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.807386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:35.807904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:35.808346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:35.808852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lazy-loading 'fault' on Instance uuid 90c5c2bc-3833-4752-8ad2-e93373a02c26 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:08:35.944050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:35.960882 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce7a5ab3-7cf1-47de-a2f8-df9c3da85481 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 200 len: 1304 microversion: 2.1 time: 0.322297 Oct 19 01:08:35.961839 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2241/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:35 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 1304 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:36.115743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:36.147842 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf8d7f45-9731-4805-b8ed-2d693ac75616 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.450123 Oct 19 01:08:36.161062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2353/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:35 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:36.172641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:36.173418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:36.181436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.182024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.182875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.183696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.184262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.184993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.250970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:36.252839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:36.262787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.263918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.264592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.265541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.266216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.266818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.552470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:36.564469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:36.569309 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-abe21016-0f12-41c5-9a4b-21202f39d41e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.400981 Oct 19 01:08:36.571366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2242/4595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:36 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:36.590447 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc93ddbe-b368-41cf-b04f-cf4648757056 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.344373 Oct 19 01:08:36.591401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2354/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:36 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:36.592930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:36.593678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 38ca2e2c-3170-4fa1-8114-c7aabcc64d50] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:36.600319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/38ca2e2c-3170-4fa1-8114-c7aabcc64d50/action HTTP/1.1 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 13 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: {"pause": {}} Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '38ca2e2c-3170-4fa1-8114-c7aabcc64d50', 'body': {'pause': {}}} Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:36.609164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 38ca2e2c-3170-4fa1-8114-c7aabcc64d50 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:36.615859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b7182d0-1bd8-429b-9199-781723076da2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/38ca2e2c-3170-4fa1-8114-c7aabcc64d50/action" status: 404 len: 111 microversion: 2.1 time: 0.021907 Oct 19 01:08:36.617138 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2243/4597] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:36 2022] POST /compute/v2.1/servers/38ca2e2c-3170-4fa1-8114-c7aabcc64d50/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:08:36.620198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:36.621033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:36.633856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.635475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.636093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.638057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.639006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.640955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.851191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:36.872441 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5be5961b-cd40-4768-a531-dfa67ac34249 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.256182 Oct 19 01:08:36.878576 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2355/4598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:36 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:36.906664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:36.907399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:36.916722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.917217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.917658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.918374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:36.918890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:36.919323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:36.992188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:36.993825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: 90c5c2bc-3833-4752-8ad2-e93373a02c26] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.007830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.008329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.008836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.009726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.010351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.010970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.056111 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] HTTP exception thrown: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Request method failure captured: Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 HTTP/1.1 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT01u01HHehrWlla5GMinRv4vbOTznzaHXfetgmYLsQQwYNh91E3p_IMRq1RZhg38fh3cCGOxtwWGlLopy9oM3OWs2gGaSp7JJybNu1vLhMD0lMOqXJ8HIub8qRauzvKm1_yGAKFBOUC15z3GB6CTbyDBd62Vcjutmgkm7_k2RoJweRw Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 979214475e474053bef7b2daaf4ae6fc Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979214475e474053bef7b2daaf4ae6fc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979214475e474053bef7b2daaf4ae6fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979214475e474053bef7b2daaf4ae6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979214475e474053bef7b2daaf4ae6fc"}]}] Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 979214475e474053bef7b2daaf4ae6fc Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListImageFiltersTestJSON-930450512-project Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 314b17e8914f48e985e90481cd3c3a3d Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListImageFiltersTestJSON-930450512-project Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '90c5c2bc-3833-4752-8ad2-e93373a02c26'} Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:37.073795 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. Oct 19 01:08:37.079614 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:37.081397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Returning 404 to user: Instance 90c5c2bc-3833-4752-8ad2-e93373a02c26 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:37.083089 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb8f1c7f-5f7c-4350-81ae-76bf60af5d0f tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26" status: 404 len: 111 microversion: 2.1 time: 0.100538 Oct 19 01:08:37.092446 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2356/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:36 2022] GET /compute/v2.1/servers/90c5c2bc-3833-4752-8ad2-e93373a02c26 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:37.113186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:37.115305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.132540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.133429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.134099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.136484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.137301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.137941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.175077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:08:37.213843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:37.228190 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b14435e0-73c5-4ac3-8308-034fef8aba5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.327268 Oct 19 01:08:37.230474 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2244/4600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:36 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:37.288900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:37.290942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.311295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.311972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.312763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.314001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.316837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.317487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.350509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1e27800-084c-4152-8d33-0d7ed4a680c1 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 204 len: 0 microversion: 2.1 time: 0.256591 Oct 19 01:08:37.353105 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2357/4601] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:08:37 2022] DELETE /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:37.364314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:37.370766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.394693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.395559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.396178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.400147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.400856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.401618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.474178 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67005be4-9e91-4711-9f5f-79c4ecc3fda1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.199166 Oct 19 01:08:37.475861 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2245/4602] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:37 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:08:37.513148 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:37.514668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.524942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.526002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.526655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.527549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.528222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.528913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.798576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:37.812430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe4e043f-52c6-48ec-b390-f77cf2ea00ed tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1473 microversion: 2.1 time: 0.454767 Oct 19 01:08:37.828015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2358/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:37 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1473 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:37.834287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:37.834939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:37.841652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.842206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.842665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:37.843465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:37.843941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:37.844530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:38.024337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:38.033496 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-221552c3-04c1-4952-a91a-6e7795e8a117 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1509 microversion: 2.1 time: 0.541944 Oct 19 01:08:38.034891 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2246/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:37 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:38.128954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:38.139903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e64193-89b6-42e5-8f1b-3e8ad11c2ba3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.310563 Oct 19 01:08:38.151430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2359/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:37 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:38.835218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:38.836421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:38.849932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:38.850306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:38.850830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:38.851444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:38.861759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:38.862258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.061990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:39.063797 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:39.074332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.075149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.075790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.079107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.082777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.083500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.127607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:39.143835 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:39.151772 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ca37aa9-c449-402e-a618-d099700d9233 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1473 microversion: 2.1 time: 0.320393 Oct 19 01:08:39.153741 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2247/4606] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:38 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1473 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:39.183568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:39.186286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:39.195563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.196562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.197263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.198199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.198903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.199526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.490550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:39.514560 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9eb17a02-6c4c-449c-a0d7-18a3c64e0dc2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1489 microversion: 2.1 time: 0.456619 Oct 19 01:08:39.521926 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2360/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:39 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1489 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:39.547191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:39.548007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:39.556418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.557716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.559080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.560228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.560888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.561479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.576440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:39.593317 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b0a984d-e4d1-40ef-bc5f-d63baccdff19 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.424031 Oct 19 01:08:39.628657 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2248/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:39 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:39.637451 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'pause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state paused Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 13 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: {"pause": {}} Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'pause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state paused Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'pause': {}}} Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state paused. Cannot pause while the instance is in this state. Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state paused Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:39.639356 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state paused Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'pause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state paused {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a074350-68f1-4d0e-b1bf-0558efdebe80 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 143 microversion: 2.1 time: 0.098011 Oct 19 01:08:39.649190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2361/4609] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:39 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 143 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:08:39.650423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:39.650982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:39.666408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.667173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.667593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.668599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.669120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.669563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.752387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-79bc0c79-214e-4bcf-a237-98f8baa99fef tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.105133 Oct 19 01:08:39.754110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2249/4610] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:39 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:08:39.769523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:39.770336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:39.795035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.795675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.795892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:39.799306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:39.807836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:39.809587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:40.087317 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:40.109411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c3590ef-fac4-4912-b7b5-30e08c496615 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1496 microversion: 2.1 time: 0.350013 Oct 19 01:08:40.110021 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2362/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:39 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:40.191193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:40.192863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:40.203106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:40.204468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:40.205687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:40.206424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:40.206888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:40.207390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:40.449817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:40.465167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-506ffbc6-3c4a-4f3a-89ca-a88041354901 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1473 microversion: 2.1 time: 0.289876 Oct 19 01:08:40.465773 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2250/4612] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:40 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1473 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:40.637949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:40.638741 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:40.655859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:40.670891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:40.670891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:40.670891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:40.670891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:40.670891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:40.888565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:40.892506 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:40.904424 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-acc709d6-ffa4-4ee2-828f-30fc5690f66e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.273904 Oct 19 01:08:40.916459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2363/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:40 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:40.991063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba", "name": "network-vif-deleted", "tag": "3e7164e3-7868-413d-969b-c2b590780f5d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:41.016901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.018004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.034295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.067118 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] Creating event network-vif-deleted:3e7164e3-7868-413d-969b-c2b590780f5d for instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba on n-h2-master-1 Oct 19 01:08:41.091004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-72eaf0be-051a-42cb-be88-18bde3c1ef56 req-267375b0-5da7-4549-8938-6f7a9428da40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103692 Oct 19 01:08:41.108605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2251/4614] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:41.135690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:41.136315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:41.153308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.153809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.154247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.156390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.158467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.164248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.474662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:41.495727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:41.496453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:41.500458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-53566f8a-87ed-49ec-8daa-09293af1d65a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.368120 Oct 19 01:08:41.512849 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2364/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:41 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:41.516660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.530255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:41.531606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:41.535169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.541622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.545722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.546473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.547113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.555001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.555966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.557277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.569763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.581452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.582203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.685944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.686748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.687367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.688045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lazy-loading 'fault' on Instance uuid a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:08:41.887842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '314b17e8914f48e985e90481cd3c3a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '979214475e474053bef7b2daaf4ae6fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:41.904209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39c77476-c047-4118-adcc-4efa3b1a3962 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 200 len: 1307 microversion: 2.1 time: 0.415533 Oct 19 01:08:41.908674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2252/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:41 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 1307 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:41.930861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:41.931611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:41.940689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.941195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.941636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:41.942348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:41.942807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:41.943232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.000903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:42.017751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73cb6951-b9c2-47d3-a872-0db254869e87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.491656 Oct 19 01:08:42.019000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2365/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:41 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:42.047018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:42.052059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.076019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.077897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.078619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.080769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.081413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.082790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.114477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action HTTP/1.1 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 28 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: {"reboot": {"type": "SOFT"}} Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ed075090-4932-426a-a6fd-4a773fce4145', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:42.117875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:42.123554 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.127740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:42.129395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42956429-8da7-45f1-b793-4a0de5451c2d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action" status: 404 len: 111 microversion: 2.1 time: 0.086650 Oct 19 01:08:42.133836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2366/4618] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:42 2022] POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:42.140370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:42.141100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.149481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.149972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.150412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.151119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.151574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.151991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.194003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:42.204263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-401ee941-f245-4ae8-aadc-b5155f7ce9bc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.277777 Oct 19 01:08:42.205528 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2253/4619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:41 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:42.400092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:42.414228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec58bfc9-888a-4136-b94d-81fe107f44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.277066 Oct 19 01:08:42.415258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2367/4620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:42 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:42.438992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:42.440367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.450194 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:42.456790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.457543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.458682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.459743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.460239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.460689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.724472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:42.734838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60dccd6e-fba9-4176-873e-2258bbdb6db1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.300533 Oct 19 01:08:42.735639 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2254/4621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:42 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:42.760063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:42.774507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 6c3cf9ff-e123-44aa-8786-7ea25a132067] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.781759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/6c3cf9ff-e123-44aa-8786-7ea25a132067/action HTTP/1.1 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 28 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: {"reboot": {"type": "SOFT"}} Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6c3cf9ff-e123-44aa-8786-7ea25a132067', 'body': {'reboot': {'type': 'SOFT'}}} Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. Oct 19 01:08:42.785055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. Oct 19 01:08:42.791521 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.794688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 6c3cf9ff-e123-44aa-8786-7ea25a132067 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:42.795917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8684471-94cb-4d31-aa11-83cff2d740c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/6c3cf9ff-e123-44aa-8786-7ea25a132067/action" status: 404 len: 111 microversion: 2.1 time: 0.041951 Oct 19 01:08:42.797339 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2368/4622] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:42 2022] POST /compute/v2.1/servers/6c3cf9ff-e123-44aa-8786-7ea25a132067/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:42.807068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:42.808063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.818369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.819158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.819865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.821379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.822060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.822759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.930088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:42.931087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] [instance: a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:42.943985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.946172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.946829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.947966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:42.949127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:42.949899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:42.967712 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] HTTP exception thrown: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Request method failure captured: Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba HTTP/1.1 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT01u01HHehrWlla5GMinRv4vbOTznzaHXfetgmYLsQQwYNh91E3p_IMRq1RZhg38fh3cCGOxtwWGlLopy9oM3OWs2gGaSp7JJybNu1vLhMD0lMOqXJ8HIub8qRauzvKm1_yGAKFBOUC15z3GB6CTbyDBd62Vcjutmgkm7_k2RoJweRw Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 979214475e474053bef7b2daaf4ae6fc Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_979214475e474053bef7b2daaf4ae6fc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979214475e474053bef7b2daaf4ae6fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/979214475e474053bef7b2daaf4ae6fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/979214475e474053bef7b2daaf4ae6fc"}]}] Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 979214475e474053bef7b2daaf4ae6fc Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-930450512 Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ListImageFiltersTestJSON-930450512-project Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 314b17e8914f48e985e90481cd3c3a3d Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ListImageFiltersTestJSON-930450512-project Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: exception: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba'} Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:42.969718 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. Oct 19 01:08:42.982510 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:42.984920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Returning 404 to user: Instance a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:42.987566 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce23c6d0-08d8-49c3-a576-28770fa457a6 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba" status: 404 len: 111 microversion: 2.1 time: 0.060479 Oct 19 01:08:42.989006 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2369/4623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:42 2022] GET /compute/v2.1/servers/a17d7ec0-d705-4e9c-8bb1-ea29bb1dd5ba => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:43.004231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c7f3ad8-102a-40f7-a3aa-0c534ab52536 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af579cd30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:43.103107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:43.112345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39f8ce66-9003-4044-b680-2f298037a830 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.309666 Oct 19 01:08:43.137337 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2255/4624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:42 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:43.150147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:43.151147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:43.157863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.158742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.159007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.159713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.160181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.160757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.428052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:43.443476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-413c6758-a233-4564-a714-66c896e00b0b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.295548 Oct 19 01:08:43.456938 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2256/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:43 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:43.480945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:43.482629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:43.502642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.504836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.505374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.506247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.507708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.512200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.700076 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c7f3ad8-102a-40f7-a3aa-0c534ab52536 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f" status: 204 len: 0 microversion: 2.1 time: 0.706270 Oct 19 01:08:43.701490 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2370/4626] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:42 2022] DELETE /compute/v2.1/images/e137c3f9-87d0-45d7-b5e5-1a6505b7ce3f => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:43.708590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:43.713846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:43.740779 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:43.744270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.745307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.746324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.748993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:43.749653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:43.750673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:43.778737 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action HTTP/1.1 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 65 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ed075090-4932-426a-a6fd-4a773fce4145', 'body': {'rebuild': {'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340'}}} Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 01:08:43.780875 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a945279-8de0-463e-aec3-3d714b63c1d6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action" status: 404 len: 111 microversion: 2.1 time: 0.079590 Oct 19 01:08:43.786301 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2371/4627] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:43 2022] POST /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:43.791044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c2f6fd6-6dcc-4dba-a66e-1a572434de95 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af5082dc0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:44.047683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:44.091343 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d80e5fd-92c7-4815-b7aa-9c7556783736 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.628437 Oct 19 01:08:44.095324 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2257/4628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:43 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:44.127720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:44.128534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:44.148924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:44.149794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:44.151929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:44.153160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:44.153899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:44.154813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:44.264039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c2f6fd6-6dcc-4dba-a66e-1a572434de95 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc" status: 204 len: 0 microversion: 2.1 time: 0.479011 Oct 19 01:08:44.264916 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2372/4629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:43 2022] DELETE /compute/v2.1/images/277c0115-fe53-4364-985d-cba2d0e0a3dc => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:44.274367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b94df77a-31c2-440d-b9a3-ccd164c19664 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] Calling method '.version_select at 0x7f2af4e58040>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:44.483855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:44.496386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18acd577-1907-4df1-8418-c28aca86d71a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.390581 Oct 19 01:08:44.497029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2258/4630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:44 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:44.531149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:44.532269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:44.541748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:44.542487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:44.543240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:44.544300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:44.545076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:44.545680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:44.793240 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b94df77a-31c2-440d-b9a3-ccd164c19664 tempest-ListImageFiltersTestJSON-930450512 tempest-ListImageFiltersTestJSON-930450512-project] 10.222.0.27 "DELETE /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352" status: 204 len: 0 microversion: 2.1 time: 0.523110 Oct 19 01:08:44.794972 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2373/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:44 2022] DELETE /compute/v2.1/images/308f0270-f39c-45e0-af9b-5f5b106aa352 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:08:44.888953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:44.900368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb5d6cec-e1a1-4622-a847-f46f7e7b1bfd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.374250 Oct 19 01:08:44.904560 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2259/4632] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:44 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:44.951966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:44.963901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 6e98be3f-f2aa-4bee-ba91-6444f9ea897a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:44.997563 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/6e98be3f-f2aa-4bee-ba91-6444f9ea897a/action HTTP/1.1 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 65 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6e98be3f-f2aa-4bee-ba91-6444f9ea897a', 'body': {'rebuild': {'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340'}}} Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 19 01:08:44.999282 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. Oct 19 01:08:45.012263 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:45.015997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 6e98be3f-f2aa-4bee-ba91-6444f9ea897a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:45.018883 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-78a1bd1b-08d3-4111-8909-adf4cb97d73c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/6e98be3f-f2aa-4bee-ba91-6444f9ea897a/action" status: 404 len: 111 microversion: 2.1 time: 0.081135 Oct 19 01:08:45.020183 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2374/4633] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:44 2022] POST /compute/v2.1/servers/6e98be3f-f2aa-4bee-ba91-6444f9ea897a/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:45.028795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:45.029651 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:45.042005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.042572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.043053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.043832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.044379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.044806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.150167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:45.150823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:45.159061 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:08:45.159249 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 (ip 10.222.0.27) !!! Oct 19 01:08:45.182654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.183155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.183619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.186306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.186886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.190309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.633305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:45.644711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51222b27-0847-42f9-b6a8-626cf56109c1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.619978 Oct 19 01:08:45.645667 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2260/4634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:45 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:45.672575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:45.674650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:45.684359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.685582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.686230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.687200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:45.687757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:45.688196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:45.745379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:45.762009 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8294365c-5a0a-4c47-bcac-e41b139a00bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.644402 Oct 19 01:08:45.764511 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2375/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:45 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:46.328893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:46.337472 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9be6d212-be63-44b3-ba13-61cb95e90573 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.669644 Oct 19 01:08:46.338412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2261/4636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:45 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:46.375752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:46.380059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 8cb597f6-b241-45bb-adfb-b8c71d1770af] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:46.391869 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/8cb597f6-b241-45bb-adfb-b8c71d1770af/action HTTP/1.1 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: {"restore": {}} Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8cb597f6-b241-45bb-adfb-b8c71d1770af', 'body': {'restore': {}}} Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:46.398582 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:46.405764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:46.405764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:46.405764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. Oct 19 01:08:46.405764 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:46.405764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 8cb597f6-b241-45bb-adfb-b8c71d1770af could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:46.407959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-287f4dc0-3851-48d2-bbba-063816ae0d5f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/8cb597f6-b241-45bb-adfb-b8c71d1770af/action" status: 404 len: 111 microversion: 2.1 time: 0.036561 Oct 19 01:08:46.413159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2376/4637] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:46 2022] POST /compute/v2.1/servers/8cb597f6-b241-45bb-adfb-b8c71d1770af/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:46.430272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:46.431140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:46.444409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.445417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.445717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:46.446546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.447204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.447642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:46.772437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:46.783454 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-88d90a08-047f-4749-a296-6aff17ea3dc5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.368732 Oct 19 01:08:46.784063 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2262/4638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:46 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:46.793457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:46.794146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:46.814482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:46.815424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:46.815941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.816692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.817374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:46.818182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.818660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.819102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:46.825731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.826680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.827317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:46.828275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:46.828975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:46.829644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.257874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:47.261853 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:47.269456 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4aea01a-91fa-4203-a080-ca318ac9d2b3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.465453 Oct 19 01:08:47.275762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2263/4639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:46 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:47.279677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:47.292968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6706d453-0bb8-4a48-a7a7-a8b230127bbc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.506394 Oct 19 01:08:47.295623 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2377/4640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:46 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:47.316303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:47.317244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:47.338178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.339346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.340323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.344162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.346102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.346597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.392053 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'restore' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 15 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: {"restore": {}} Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'restore' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'restore': {}}} Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state active. Cannot restore while the instance is in this state. Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:47.394659 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:47.400745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:47.400745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:47.400745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:47.400745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:47.400745 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:08:47.402261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'restore' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:47.403518 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4cd84980-2514-4ce6-aaa7-2c836d1010a8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 145 microversion: 2.1 time: 0.092431 Oct 19 01:08:47.404730 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2264/4641] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:47 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:08:47.415559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:47.416255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:47.427463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.428753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.430856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.431934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.432782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.434571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.667325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:47.682612 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1f8381a3-2a26-4530-b52f-80d59b57a4c3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.271362 Oct 19 01:08:47.703058 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2378/4642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:47 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:47.742849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:47.749902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:47.771037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.772289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.773976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:47.775424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:47.776136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:47.777550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.168975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:48.184176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e7955c6-8d56-4fa1-a557-5f868526010e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.477636 Oct 19 01:08:48.185655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2265/4643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:47 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:48.221990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:48.222592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 5518b280-0363-4bc6-b4e6-ace3de7f4be8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:48.229867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/5518b280-0363-4bc6-b4e6-ace3de7f4be8/action HTTP/1.1 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 14 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: {"resume": {}} Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5518b280-0363-4bc6-b4e6-ace3de7f4be8', 'body': {'resume': {}}} Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:48.246246 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 5518b280-0363-4bc6-b4e6-ace3de7f4be8 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b296a0fd-fe8e-4482-99be-d0259a7ff480 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/5518b280-0363-4bc6-b4e6-ace3de7f4be8/action" status: 404 len: 111 microversion: 2.1 time: 0.035247 Oct 19 01:08:48.252682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2379/4644] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:48 2022] POST /compute/v2.1/servers/5518b280-0363-4bc6-b4e6-ace3de7f4be8/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:48.258276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:48.258881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:48.282848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.283388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.284172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.285603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.286367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.288407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.325323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:48.326546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:48.352368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.353100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.353960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.354955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.355653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.356320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.704561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:48.714990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:48.719446 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbaa2f7e-fcca-435a-be87-3f927656925f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.465895 Oct 19 01:08:48.734098 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2266/4645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:48 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:48.760451 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5fafd9b0-132a-4024-a694-cea3d6ae12b0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.440462 Oct 19 01:08:48.781034 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2380/4646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:48 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:48.787109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:48.788987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:48.812710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.813217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.813758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:48.815602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:48.816182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:48.816575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.730779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:49.745603 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4167cc3a-2eb0-4a61-b801-1d109fd083b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.989340 Oct 19 01:08:49.769546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2267/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:48 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:49.780610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:49.781257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:49.796264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.798000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:49.799518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.800411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:49.800777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.802004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.802640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.821675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.873804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.882171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.883074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.885211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.888151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.889183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.902452 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'resume' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 14 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: {"resume": {}} Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'resume' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'resume': {}}} Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state active. Cannot resume while the instance is in this state. Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:49.908415 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'resume' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b406166-5c85-4829-8c5e-ac469bf1837c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 144 microversion: 2.1 time: 0.142740 Oct 19 01:08:49.917159 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2381/4648] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:49 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 144 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:08:49.925967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:49.927657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:49.947103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.949376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.951659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:49.953844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:49.956319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:49.958445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:50.205731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:50.216310 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-102f9b6e-8ea0-4b45-84b7-70d28d63ec1b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.425400 Oct 19 01:08:50.217089 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2268/4649] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:49 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:50.312812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:50.321922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8152729f-b843-4b98-8ae3-9c4dec1cb171 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.404333 Oct 19 01:08:50.322808 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2382/4650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:49 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:50.347157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:50.347784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:50.355858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:50.356352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:50.356825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:50.360903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:50.361647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:50.362113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:50.638370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:50.651992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c5c63b7-ad7f-4884-92d3-5908d4b8393b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.309466 Oct 19 01:08:50.655816 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2269/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:50 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:50.826134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43364eed-2b37-4ab8-b6eb-271b14c39e5e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43364eed-2b37-4ab8-b6eb-271b14c39e5e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 160 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "231315bc-4360-4e98-8040-ec0c2c31211f"}]}} Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': '', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'networks': [{'uuid': '231315bc-4360-4e98-8040-ec0c2c31211f'}]}}} Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '' Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:08:50.832772 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:08:50.837725 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:50.841800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43364eed-2b37-4ab8-b6eb-271b14c39e5e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:50.842995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43364eed-2b37-4ab8-b6eb-271b14c39e5e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021630 Oct 19 01:08:50.847208 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2383/4652] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:08:50 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:08:50.855005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:50.855715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:50.872093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:50.872633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:50.875441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:50.878444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:50.878982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:50.880600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.241153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:51.241861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:51.265378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.265661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.266172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.272650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.275599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.276433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.311848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:51.326944 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b8cae99-b452-404d-a1d3-7a42b2e30aff tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.478418 Oct 19 01:08:51.327883 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2270/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:50 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:51.356914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:51.358544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:51.369986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.371106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.372990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.373920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.375293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.376763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.674509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:51.689741 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d682e10-4e76-451c-902b-e58f59e18dac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1696 microversion: 2.1 time: 0.453490 Oct 19 01:08:51.710486 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2384/4654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:51 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1696 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:51.743528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:51.758951 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-15c52aca-053b-4123-81f0-3cd2e96d0d8b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.404260 Oct 19 01:08:51.765015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2271/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:51 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:08:51.792944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:51.793599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: b133a73e-66ca-4460-8eba-0f393a853f07] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:51.802882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/b133a73e-66ca-4460-8eba-0f393a853f07/action HTTP/1.1 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 14 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: {"shelve": {}} Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b133a73e-66ca-4460-8eba-0f393a853f07', 'body': {'shelve': {}}} Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:08:51.807822 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:08:51.818843 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:08:51.818843 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:08:51.818843 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. Oct 19 01:08:51.818843 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:08:51.822091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance b133a73e-66ca-4460-8eba-0f393a853f07 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:08:51.823012 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b8c8392-c4ab-4475-91e8-2bf98c5e3db9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/b133a73e-66ca-4460-8eba-0f393a853f07/action" status: 404 len: 111 microversion: 2.1 time: 0.035682 Oct 19 01:08:51.824660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2385/4656] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:51 2022] POST /compute/v2.1/servers/b133a73e-66ca-4460-8eba-0f393a853f07/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:08:51.838733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:51.840830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:51.850859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.851707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.852159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:51.853711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:51.855951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:51.856573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.140686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:52.157005 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c98a17b3-9f29-4f62-9eda-7f42a2bb6938 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.323062 Oct 19 01:08:52.157980 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2272/4657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:51 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:52.192909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:52.193668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:52.217109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.217917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.218546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.221260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.224888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.226914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.708731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:52.723102 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de2ff846-3f9c-454c-940e-de4b1748be74 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.536340 Oct 19 01:08:52.723600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:52.724233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:52.727922 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2386/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:52 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:52.753760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:52.754724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:52.756165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.756982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.757680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.758823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.759545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.760500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.767738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.768258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.774807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.775983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:52.776562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:52.777061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:52.843860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lazy-loading 'flavor' on Instance uuid f2c5f362-ba87-46c6-ab65-01d1db187934 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:08:53.150551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:53.167730 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7bd1f92a-2c0d-49e7-8340-8efdf09f624e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1695 microversion: 2.1 time: 0.449975 Oct 19 01:08:53.170487 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2273/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:52 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1695 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:53.200779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-600fe508-40de-4910-864b-0c290768a9fa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.452648 Oct 19 01:08:53.202477 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2387/4660] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:08:52 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:08:53.213118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:53.214336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:53.237548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:53.243008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:53.245506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:53.248315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:53.249661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:53.251251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:53.591724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:53.622308 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e605bf6d-6c24-4ac7-90bd-f456ae95a4b1 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.413837 Oct 19 01:08:53.625175 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2274/4661] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:53 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:54.200467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:54.201465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:54.219849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:54.220532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:54.221093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:54.221890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:54.222350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:54.222782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:54.648203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:54.648868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:54.662901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:54.663514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:54.663986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:54.664755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:54.665253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:54.665740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:54.946400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:54.963527 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a9cc811-d665-4b0d-8312-47dc58500581 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1695 microversion: 2.1 time: 0.768916 Oct 19 01:08:54.964398 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2388/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:54 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1695 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:54.978415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "name": "network-vif-unplugged", "status": "completed", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:55.011419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:55.012224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:55.014485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:55.047022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Creating event network-vif-unplugged:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h2-master-1 Oct 19 01:08:55.072453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:08:55.109013 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d56b020b-98c3-469b-9071-341a1263bcbb req-f68f8e97-c6f4-4129-9426-217cb0c88c77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.141795 Oct 19 01:08:55.117716 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2389/4663] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:08:55.118215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:55.135928 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ce83c6a-45d6-45a7-9fa4-a569c7d79bf7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.490401 Oct 19 01:08:55.138846 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2275/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:54 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:55.811889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:55.813298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:55.826578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:55.831191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:55.831866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:55.835828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:55.836563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:55.837369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:55.852368 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:08:55.988429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:55.989716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:56.002857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.005326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.006013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:56.011607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.012288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.012976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:56.308955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:56.328840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:56.339718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:56.343906 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29f8f619-ec97-4417-82c5-c8a3a21f9687 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2945 microversion: 2.32 time: 0.538167 Oct 19 01:08:56.361095 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2390/4665] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:08:55 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2945 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:56.387206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:56.388102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:56.428429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.429722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.430876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:56.431630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.432092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.432525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:56.899716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:56.909926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d9d8153-c7c0-455b-8bd0-f03db6f00aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1695 microversion: 2.1 time: 0.925630 Oct 19 01:08:56.911344 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2276/4666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:55 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1695 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:56.927816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:56.928329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:56.946135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.946937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.947603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:56.948567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:56.949230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:56.949835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:57.007237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:57.023696 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbd0c26d-3fbf-450e-ac0e-6c35a604fb8c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.665890 Oct 19 01:08:57.024828 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2391/4667] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:56 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:57.163476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:08:57.201644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:57.203635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:57.207079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:57.239981 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Creating event network-changed:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h2-master-1 Oct 19 01:08:57.257262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:08:57.293495 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b63e1e7f-9bf7-4e03-897b-d04313a8bc73 req-bff547a1-380d-4a89-b1bf-c8d9f54a8729 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124431 Oct 19 01:08:57.294662 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2392/4668] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:08:57.295417 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f957954b-b4dd-4cbc-8442-deb8aaeeaa08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.382267 Oct 19 01:08:57.296026 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2277/4669] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:08:56 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90/os-interface => generated 1832 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:08:57.939235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:57.939966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:57.970390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:57.970868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:57.975995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:57.976814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:57.982673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:57.983192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:58.055708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:58.056387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:58.071216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:58.071721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:58.072159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:58.079758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:58.081366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:58.082045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:58.892227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:58.911670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee7e5b0e-5c91-411d-b0dd-5c521d7d63c5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1695 microversion: 2.1 time: 0.979680 Oct 19 01:08:58.916125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2393/4670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:57 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1695 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:58.925800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:08:58.939141 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66dc5660-49ce-4829-9b05-abd480324517 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.889813 Oct 19 01:08:58.942392 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2278/4671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:58 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:08:59.949646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:59.950113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:59.968372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:08:59.969189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:08:59.988944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:59.989486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:59.990002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:59.991995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:59.992741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:59.994986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:08:59.996151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:08:59.997305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:08:59.999500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:00.003265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:00.008668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:00.015666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:00.654237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:00.664728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57b2de56-dc51-4cfa-9a92-8b7f34d7872a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1693 microversion: 2.1 time: 0.725129 Oct 19 01:09:00.669696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2394/4672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:59 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1693 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:00.672369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:00.684447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30019d21-a049-4412-8263-93a04af8d8f4 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.720821 Oct 19 01:09:00.690750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2279/4673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:08:59 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:01.121638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-526ea081-1249-437d-a840-7529cd7bf2ee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: .version_select at 0x7f2af4528ee0>, body: {"keypair": {"name": "tempest-keypair-259284986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzSSJMEh7jU4SOw/hbnpxCHtnG0ngemvczysCBpSh+iStaqct3cMhDA7cE2gs8Sl2ZHYX6RFhmzl5PfVcDSTkbqKkHVTVBaQomF0TVuEThhvTb8qONhX0vq/MeXvTwH9A=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:01.175076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-526ea081-1249-437d-a840-7529cd7bf2ee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:09:01.197121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-526ea081-1249-437d-a840-7529cd7bf2ee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:09:01.269784 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-526ea081-1249-437d-a840-7529cd7bf2ee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.435924 Oct 19 01:09:01.270794 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2395/4674] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:09:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:01.693960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:01.694645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:01.715837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:01.716337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:01.720915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:01.721349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:01.721558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:01.727215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:01.728123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:01.729124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:01.741934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:01.742438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:01.742883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:01.743720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:01.752006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:01.753016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:02.600308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:02.616489 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61855176-9fa7-4fa4-8398-ec7b30c6d316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.901662 Oct 19 01:09:02.620077 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:02.625432 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2396/4675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:01 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:02.635617 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a2563c9e-9042-48d9-875f-0a07d5793aa8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1690 microversion: 2.1 time: 0.945670 Oct 19 01:09:02.636869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2280/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:01 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1690 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:02.668933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:02.669768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:02.699705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:02.702993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:02.703743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:02.707073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:02.707794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:02.708887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:02.825478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d947678e-7a77-4128-bab6-ef84e7bb9c2b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action" status: 204 len: 0 microversion: 2.1 time: 0.160832 Oct 19 01:09:02.828064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2397/4677] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:09:02 2022] POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:09:02.849628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:02.850533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:02.865970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:02.868071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:02.869128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:02.872615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:02.875232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:02.879779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:02.984514 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:03.652924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:03.653736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:03.670270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:03.671745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:03.674493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:03.676301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:03.677103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:03.690437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:04.176967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:04.203640 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f15f1b74-0262-47cc-b386-b381dabf4ea2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1690 microversion: 2.1 time: 1.360325 Oct 19 01:09:04.210040 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2281/4678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:02 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1690 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:04.216706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "name": "network-vif-plugged", "status": "completed", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:04.241605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:04.242086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:04.242519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:04.278475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Creating event network-vif-plugged:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h2-master-1 Oct 19 01:09:04.294675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:09:04.317878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e40a7742-4c60-4758-959a-1808e7493c44 req-58d6c69d-a4f0-4386-b269-66d8ebbd7bf2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104731 Oct 19 01:09:04.326141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2282/4679] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:04.920295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:04.971927 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-70a51a6e-162e-4e0c-a2c3-d50c2887149d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 1.320714 Oct 19 01:09:05.001694 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2398/4680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:03 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:05.230524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:05.232473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:05.246761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:05.251340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:05.251862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:05.255915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:05.256533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:05.257024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:06.009720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:06.011018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:06.021622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:06.022488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:06.023218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:06.024125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:06.024924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:06.026080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:06.133672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:06.142457 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-23329da4-546f-4962-b16e-bd1bdfcf8ca6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1690 microversion: 2.1 time: 0.916512 Oct 19 01:09:06.162926 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2283/4681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:05 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1690 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:06.863400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:06.883969 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e4db7d9-02eb-43c2-ac20-c55bc3a55c40 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1531 microversion: 2.1 time: 0.880940 Oct 19 01:09:06.887471 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2399/4682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:05 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1531 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:07.173474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:07.175366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:07.215914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.216435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.216920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.248068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:07.251304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:07.251565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.252080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.253580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.273060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.273060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.273060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.273813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.275050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.277469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.350542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15107c01-9cee-41c2-8080-7f58220b78b5 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.107632 Oct 19 01:09:07.356325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2400/4683] 10.222.0.27 () {60 vars in 1343 bytes} [Wed Oct 19 01:09:07 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:07.571631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:07.572141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:07.578558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.579642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.580074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.580819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.581457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.582062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.665874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:09:07.862500 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c2048561-b8dc-4509-b118-ca9c6d43eca9 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 204 len: 0 microversion: 2.20 time: 0.294755 Oct 19 01:09:07.868351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2401/4684] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:09:07 2022] DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:09:07.881409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:07.883595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:07.895314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.895652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.896346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:07.898173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:07.898915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:07.900411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:08.912255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:08.934837 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93b5cb1f-795c-45d4-a558-fed4865b93c3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1690 microversion: 2.1 time: 1.767005 Oct 19 01:09:08.936990 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2284/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:07 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1690 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:08.947058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:08.965162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:08.984174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:08.991545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:08.992345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:08.993443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:08.995112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:08.997507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:09.615030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:09.652917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:09.657360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:09.658699 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb9b5bd9-b7e9-4552-afd0-0dabad96ef65 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1722 microversion: 2.20 time: 1.787774 Oct 19 01:09:09.659349 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2402/4686] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:07 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1722 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:09:09.834250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:09.844110 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-320c8410-5bd3-44f5-ae81-5bb8a31767b2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.905757 Oct 19 01:09:09.844867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1691835503", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69976232-9b57-4354-be5a-f2d785e4a03d"}], "security_groups": [{"name": "tempest-securitygroup--575568818"}], "key_name": "tempest-keypair-259284986", "user_data": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:09.877958 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2285/4687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:08 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:09.963952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:09.964557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:09.984207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:09.984753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:09.985900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:09.986495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:09.986978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:09.987409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:10.878261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:10.899157 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1080d963-8039-464f-a14d-d5d967ad71d3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1682 microversion: 2.1 time: 0.939709 Oct 19 01:09:10.901000 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2286/4688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:09 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1682 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:10.918722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:10.919344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:10.935402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] validate_networks() for [('69976232-9b57-4354-be5a-f2d785e4a03d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:09:10.961348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:10.961854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:10.962300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:10.963023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:10.963479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:10.963909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:11.226440 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:11.561221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:11.580594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:11.585503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:11.597695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0246f467-604b-4ef6-8d84-31811630a766 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1654 microversion: 2.20 time: 0.690662 Oct 19 01:09:11.601248 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2287/4689] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:10 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1654 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:09:11.615900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:11.619637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:11.630017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:11.630931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:11.631662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:11.632888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:11.633590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:11.635515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.373185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:12.395844 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b589667e-268f-4476-8f32-7d09e696d34a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.792431 Oct 19 01:09:12.397416 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2288/4690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:11 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:12.406804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "name": "network-vif-plugged", "status": "completed", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:12.421070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.421882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.423983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.447926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] Creating event network-vif-plugged:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h1-master-1 Oct 19 01:09:12.463959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3d9f4920-ed39-428c-bd25-d769362395bf req-2b97af22-b357-487c-b363-9324f640adf3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064808 Oct 19 01:09:12.465242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2289/4691] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:12.494757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd58bab4-c8ff-4a0a-a972-7fc97c1f942f", "name": "network-vif-deleted", "tag": "d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:12.525603 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=72 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:12.546706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.555327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.561182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.625076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] Creating event network-vif-deleted:d8d8923c-d2f2-4b4d-9fbe-92e8b12e3a64 for instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f on n-h2-master-1 Oct 19 01:09:12.645802 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-62892d60-280f-4ba9-9b60-0ad37762fbdb req-e4a5f9a9-ef46-4ae2-9ae2-947e5006d08c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165452 Oct 19 01:09:12.646615 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2290/4692] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:12.651831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:12.652545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:12.674310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.678685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.679140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.679883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.680347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.684096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.782026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.782602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.783048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.790072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lazy-loading 'fault' on Instance uuid dd58bab4-c8ff-4a0a-a972-7fc97c1f942f {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:09:12.823219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:09:12.827006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:09:12.827924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:09:12.828841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:09:12.830776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:09:12.878590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.879144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.880758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.886844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:12.887488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:12.888002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:12.948894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:09:12.959665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:09:12.992990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:13.018680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:13.020194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e3d4cc70eeca421585fabdb682af7caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58b0d66fb5304e7ba517c2f714a7ccac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:13.021439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ae91aee-3f8e-4ba9-b6c0-4fa10ef652d2 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 200 len: 1369 microversion: 2.20 time: 0.373676 Oct 19 01:09:13.024136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:09:13.029091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:09:13.038084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2291/4693] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:12 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 1369 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:09:13.228225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-beebc6c8-891d-4fc5-baa5-4c3f219a7937 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.385316 Oct 19 01:09:13.244949 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2403/4694] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:09:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 3405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:09:13.247178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3787539b-d6c9-4057-be79-bffe2aecc21b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:13.251996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3787539b-d6c9-4057-be79-bffe2aecc21b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:13.424906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:13.425552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:13.448814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:13.449639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:13.461231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:13.462239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:13.465322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:13.465779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:13.478508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3787539b-d6c9-4057-be79-bffe2aecc21b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:13.488323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3787539b-d6c9-4057-be79-bffe2aecc21b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1238 microversion: 2.1 time: 0.247597 Oct 19 01:09:13.492809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2292/4695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:13 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1238 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:14.072427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:14.073087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:14.077559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:14.105564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8d8f401-6b49-4749-b9ed-809f9ff6e43a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.687376 Oct 19 01:09:14.106261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2404/4696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:13 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:14.108451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:14.108880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:14.109321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:14.110629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:14.111088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:14.111516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:14.152438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f HTTP/1.1 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dd58bab4-c8ff-4a0a-a972-7fc97c1f942f'} Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:14.176502 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:14.181902 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:14.186057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:14.189993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46306ff2-4e5a-4b0e-94cb-b628e68c4b6e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 404 len: 111 microversion: 2.20 time: 0.121671 Oct 19 01:09:14.192122 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2293/4697] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:14 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 01:09:14.207898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a9f52c2-b46e-4102-84ac-00268f0d9615 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '.version_select at 0x7f2af934ab80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:14.225997 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:14.248066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a9f52c2-b46e-4102-84ac-00268f0d9615 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-87234931" status: 204 len: 0 microversion: 2.20 time: 0.048376 Oct 19 01:09:14.249492 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2405/4698] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 01:09:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-87234931 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 19 01:09:14.525122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:14.525755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:14.547824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:14.554547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:14.555712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:14.556670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:14.557311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:14.557941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:14.741372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:14.759485 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:09:14.761157 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e (ip 10.222.0.27) !!! Oct 19 01:09:14.772075 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78ce56f9-6a5a-4245-941b-29268cd7aaf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1234 microversion: 2.1 time: 0.254653 Oct 19 01:09:14.780167 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2294/4699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:14 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1234 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:15.136046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:15.136778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:15.170305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:15.171891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:15.174243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:15.175709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:15.193105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:15.199817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:15.664519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:15.688950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd4917ff-840a-4e55-8e3a-8bbe1058be86 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.551751 Oct 19 01:09:15.690419 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2406/4700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:15 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:15.799741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:15.801276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:15.818047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:15.820262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:15.822393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:15.825632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:15.826422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:15.827100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:16.025331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:16.037872 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5d1fe8e-0e0f-43e3-880c-59d19b618c88 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1308 microversion: 2.1 time: 0.243093 Oct 19 01:09:16.053445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2295/4701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:15 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:16.721392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:16.723107 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:16.747622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:16.748288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:16.760897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:16.761959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:16.770357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:16.771105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:16.786763 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:17.063791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:17.064422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:17.076589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:17.085920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:17.086389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:17.087171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:17.087644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:17.088076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:17.441062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:17.456523 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9ecd31a-a813-4fd6-8bfc-d9cd47176ed5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1296 microversion: 2.1 time: 0.396421 Oct 19 01:09:17.476288 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2296/4702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:17 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1296 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:17.593076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:17.608453 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2169e1fd-ef1b-4bd2-b396-de085bb3d9c2 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.892019 Oct 19 01:09:17.609351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2407/4703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:16 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:18.483446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:18.486271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:18.503594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:18.504104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:18.504552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:18.507083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:18.507566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:18.508013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:18.635714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:18.637179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:18.666978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:18.669623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:18.671737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:18.673398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:18.675760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:18.677591 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41570203-80d0-4702-955f-ae8654d3f6d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1296 microversion: 2.1 time: 0.198081 Oct 19 01:09:18.678124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:18.678258 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2297/4704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:18 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1296 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:18.685608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:19.349150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:19.362661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5132a4b-687f-4708-9e7d-9f9077671b2f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.726195 Oct 19 01:09:19.367785 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2408/4705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:18 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:19.702103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:19.703949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:19.717419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:19.723081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:19.723724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:19.724703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:19.725388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:19.727169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:20.387927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:20.388770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:20.404501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:20.405470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:20.406501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:20.407555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:20.408246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:20.408931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:20.491093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:20.499280 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b6312301-4d3c-4aa6-85bc-ddb9e24c4ecc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.800834 Oct 19 01:09:20.503211 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2298/4706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:19 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:20.967948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:20.981977 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7cd00bfb-247e-4d4c-bd8d-4673402e1d87 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.598379 Oct 19 01:09:21.012567 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2409/4707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:20 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:21.472997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:21.474134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:21.486025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.493846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.509463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.512934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.515239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.517642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.527001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:21.528397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:21.544898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.548035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.549809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.550833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.554037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.555657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.558554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f HTTP/1.1 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dd58bab4-c8ff-4a0a-a972-7fc97c1f942f'} Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:21.560133 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.566869 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.598443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:21.599550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d70a125b-2990-4aa6-8431-115471ff7a5e tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 404 len: 111 microversion: 2.20 time: 0.132301 Oct 19 01:09:21.605249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2299/4708] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:09:21 2022] DELETE /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:09:21.613267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:21.613931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: dd58bab4-c8ff-4a0a-a972-7fc97c1f942f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:21.655703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.662888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.663515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.665372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:21.665860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:21.666305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:21.698444 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f HTTP/1.1 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: exception: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'dd58bab4-c8ff-4a0a-a972-7fc97c1f942f'} Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.703979 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance dd58bab4-c8ff-4a0a-a972-7fc97c1f942f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec272b71-dcd5-43d5-92f9-07040efba934 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f" status: 404 len: 111 microversion: 2.20 time: 0.095479 Oct 19 01:09:21.711257 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2300/4709] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:21 2022] GET /compute/v2.1/servers/dd58bab4-c8ff-4a0a-a972-7fc97c1f942f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:09:22.018510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:22.019142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:22.035032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:22.035546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:22.036002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:22.039419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:22.039419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:22.039419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:22.437981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:22.461221 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e8314b0-d94a-4988-9cbd-77fb84ce8080 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.939675 Oct 19 01:09:22.462282 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2410/4710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:22.469527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:22.513911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:22.514393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:22.514833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:22.558147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] Creating event network-changed:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:09:22.574599 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-aaeeb2a5-b4ea-46ac-8bc6-482303218792 req-1f7d9366-3fb8-407c-93c6-de828f408d6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109132 Oct 19 01:09:22.575256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2411/4711] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:22.776180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:22.796008 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-908a221f-178c-47a8-bef9-43847b9a6a7b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.782156 Oct 19 01:09:22.829836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2301/4712] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:22 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:23.487751 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:23.489655 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:23.499392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:23.501613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:23.530151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:23.530663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:23.531730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:23.532543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:23.533045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:23.533488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:23.854178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:23.854786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:23.867492 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:23.869186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:23.869723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:23.870145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:23.870874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:23.871336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:23.875901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:23.888327 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:24.800735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:24.814717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-be0eec56-7c5b-4287-957f-35f3b05bc831 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.964300 Oct 19 01:09:24.829468 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2302/4713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:23 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:24.861126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:24.874100 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-667b473d-a411-4987-9d1b-336567b73cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 1.387234 Oct 19 01:09:24.879101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2412/4714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:23 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:25.133173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:25.135471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:25.158757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.159522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.160149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:25.161123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.161762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.162372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:25.234198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cfea73c2-0f5a-48be-8bdb-730305dec605 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action" status: 200 len: 24528 microversion: 2.1 time: 0.104785 Oct 19 01:09:25.235700 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2303/4715] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:09:25 2022] POST /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32/action => generated 24528 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:09:25.846854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:25.847486 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:25.861139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.861845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.862116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:25.863484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.866967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.867669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:25.919598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:25.920839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:25.951490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.960013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.960836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:25.961799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:25.966382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:25.970183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:26.605143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:26.639495 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0698fb2b-7156-423b-a942-c69380e9ab79 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.737149 Oct 19 01:09:26.658518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2304/4716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:25 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:26.720522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:26.731162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28ed68f6-2357-40e2-aa66-02fceab69880 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.889240 Oct 19 01:09:26.745661 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2413/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:25 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:27.678784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:27.679517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:27.698463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:27.701606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:27.702082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:27.703769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:27.704259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:27.704734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:27.777355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:27.780788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:27.807449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:27.807954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:27.808369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:27.829600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:27.830167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:27.830619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:28.166185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:28.185324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-457a87bc-07e3-4eee-ac76-b36c1e11358b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.508392 Oct 19 01:09:28.186219 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2305/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:28.319338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:28.328930 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1c6644f-02a1-477a-b295-097b25fbe4b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.562488 Oct 19 01:09:28.332814 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2414/4719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:27 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:29.216993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:29.217447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:29.231150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:29.231661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:29.235464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:29.237834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:29.240982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:29.242519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:29.356128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:29.357120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:29.366488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:29.367436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:29.368490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:29.369450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:29.370343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:29.371075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:29.925292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:29.935485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6fd8b498-b412-44b0-8c1b-99b23ce89a63 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.584005 Oct 19 01:09:29.947988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:29.953441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2415/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:29 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:29.970071 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f91cadbd-613a-4b63-8cd4-25138c57642c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.758277 Oct 19 01:09:29.972974 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2306/4721] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:29 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:30.927567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:30.928990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:30.947811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:30.950274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:30.951863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:30.954222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:30.955442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:30.956539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:30.976465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:30.977719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:30.987094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:30.987935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:30.990155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:30.991201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:30.992327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:30.993051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:30.993191 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 HTTP/1.1 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0d3db501-5534-43da-a1da-262169ee3c87'} Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:30.996559 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8ca61b1-3a72-4e03-84a4-6507c92101b3 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 404 len: 111 microversion: 2.20 time: 0.077849 Oct 19 01:09:31.002236 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2416/4722] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:09:30 2022] DELETE /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:09:31.012541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:31.013202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:31.021190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.021730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.022174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.022883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.023333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.024035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.483123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:31.493458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e96a1d73-7465-4e73-a46b-6aada9f89eba tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.486764 Oct 19 01:09:31.497106 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2417/4723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:31 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:31.500114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:31.507150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:31.507911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] [instance: 0d3db501-5534-43da-a1da-262169ee3c87] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:31.509974 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffb68e34-e297-4611-85bf-acd115109c92 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.538426 Oct 19 01:09:31.512861 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2307/4724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:30 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:31.531715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.532219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.533778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.534781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.535422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.536059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.571047 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] HTTP exception thrown: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Request method failure captured: Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 HTTP/1.1 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0xbVRbt8SacyWOdJOmAYXTDrf7CZ9t9kGvx2d9IP7aB2OLMq_WwTo8JBBfvh8SbTC5R1j3CKru02UjYbc1mtLgYIN9W48wGq0Xd3zq6HCAVoZFlsxZDmqYGU7h34TLsLGnaA4lIV1FkPA63Kks54BUjs3wQ5BAx1Fuu3lXknCVjVwY Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.20 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_58b0d66fb5304e7ba517c2f714a7ccac", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/58b0d66fb5304e7ba517c2f714a7ccac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/58b0d66fb5304e7ba517c2f714a7ccac"}]}] Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 58b0d66fb5304e7ba517c2f714a7ccac Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1881317240 Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: e3d4cc70eeca421585fabdb682af7caf Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1881317240-project Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0d3db501-5534-43da-a1da-262169ee3c87'} Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.573211 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. Oct 19 01:09:31.579473 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:09:31.581191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] Returning 404 to user: Instance 0d3db501-5534-43da-a1da-262169ee3c87 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:31.582466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11e0210b-f958-480b-8329-c78a8aa18dc4 tempest-AttachVolumeShelveTestJSON-1881317240 tempest-AttachVolumeShelveTestJSON-1881317240-project] 10.222.0.27 "GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87" status: 404 len: 111 microversion: 2.20 time: 0.082296 Oct 19 01:09:31.583256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2418/4725] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:09:31 2022] GET /compute/v2.1/servers/0d3db501-5534-43da-a1da-262169ee3c87 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:09:31.615417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:31.616159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:31.629514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.632407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.634048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.638857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.642448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.644278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:31.937835 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bcc40ea8-05e1-4c9f-91be-6f656ed926ca tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1833 microversion: 2.1 time: 0.325965 Oct 19 01:09:31.949079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2308/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:31 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1833 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:31.968103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-plugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:31.992590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:31.993333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:31.995228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:32.028722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] Creating event network-vif-plugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:09:32.046531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-69d40269-0285-4ef3-86d5-4888477acfe0 req-a494f5d4-828d-437a-af06-2f385f75ac94 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082408 Oct 19 01:09:32.052244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2419/4727] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:09:32.519338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:32.519958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:32.541603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:32.542339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:32.548977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:32.549480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:32.549922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:32.550640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:32.551098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:32.551526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:32.554564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:32.555181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:32.555602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:32.556157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:32.556612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:32.557062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:33.293115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:33.302704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b1fcf39-9c9e-4aba-8d43-1dd44518fb56 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1363 microversion: 2.1 time: 0.787196 Oct 19 01:09:33.307098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:33.309338 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2309/4728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:32 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1363 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:33.332578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d09e5c15-3b24-4f8f-9bc2-5757c32ef8e7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1526 microversion: 2.1 time: 0.795043 Oct 19 01:09:33.355900 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2420/4729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1526 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:34.334488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:34.335188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:34.345014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:34.345901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:34.346602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:34.347564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:34.348313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:34.349277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:34.363507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:34.364133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:34.371138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:34.381412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:34.382174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:34.383106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:34.383730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:34.384336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.205229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:35.205626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:35.234069 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2d2b5a52-1ff7-4a1a-8b00-8341baf79156 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1508 microversion: 2.1 time: 0.874723 Oct 19 01:09:35.234954 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-88fbb108-0697-4cb1-9ba9-b980780991a7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1550 microversion: 2.1 time: 0.906997 Oct 19 01:09:35.236318 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2310/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:34 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1550 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:35.236565 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2421/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:34 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1508 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:35.279665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:35.280321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:35.290065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.314561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.315454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.318291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.322681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.323868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.345712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:35.345712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:35.367342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.367840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.368282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.369047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.369476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.369900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.424232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:09:35.605598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b69dd0a-3356-4710-a36e-d576c6193150 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.329175 Oct 19 01:09:35.608035 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2422/4732] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:09:35 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/os-interface => generated 285 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:35.630305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c9f6404-18f9-4063-bcf0-cf0a7647ab35 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 204 len: 0 microversion: 2.1 time: 0.289259 Oct 19 01:09:35.632366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2311/4733] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:09:35 2022] DELETE /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:09:35.649604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:35.651721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:35.669168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.669723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.670411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.672597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.674442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.675107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.911553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:35.941164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:35.941593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:35.943389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:35.979416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] Creating event network-changed:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h2-master-1 Oct 19 01:09:35.992263 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-26b922a5-83d9-4ded-b25e-d7296f689665 req-bf53ef59-d9cb-412a-82b5-4246cfecb937 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.382437 Oct 19 01:09:35.993701 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2423/4734] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:36.275675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:36.276667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:36.278254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:36.286639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-75dfe826-70b6-41e0-a3a3-4c084d018e22 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1688 microversion: 2.1 time: 0.648187 Oct 19 01:09:36.287823 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2312/4735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:35 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1688 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:36.295646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:36.299788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:36.300664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:36.302643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:36.303653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:36.304968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:37.018094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:37.041779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ffa0169-af7e-4c07-8d85-be571f273d02 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1508 microversion: 2.1 time: 0.770665 Oct 19 01:09:37.063544 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2424/4736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:36 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1508 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:37.314225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:37.314841 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:37.328383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:37.329158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:37.337423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:37.338425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:37.345433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:37.346096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:37.861023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "name": "network-vif-unplugged", "status": "completed", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:37.888764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:37.889276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:37.889668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:37.945740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] Creating event network-vif-unplugged:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h1-master-1 Oct 19 01:09:37.964475 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2cff8e0a-4de2-4d55-9e07-996bcb193765 req-e4f4ea79-e935-4142-8493-292669d1556d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107464 Oct 19 01:09:37.965180 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2425/4737] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:09:38.076560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:38.078474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:38.091617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:38.092320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:38.096592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:38.097558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:38.098193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:38.098763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:38.861469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:38.869646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b77b2db-2d36-4ddf-ad98-a230ca8a00ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1688 microversion: 2.1 time: 1.559987 Oct 19 01:09:38.885884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:38.887236 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2313/4738] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:37 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1688 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:38.893685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cae36ab1-6fc7-4182-a43b-1bca8b79b2db tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1511 microversion: 2.1 time: 0.822648 Oct 19 01:09:38.894868 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2426/4739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:38 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1511 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:38.920062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:38.920839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:38.945029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:38.945795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:38.946720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:38.947580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:38.948114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:38.948615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:39.894629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:39.895257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:39.912943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:39.913435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:39.913872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:39.914585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:39.915068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:39.915472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:39.985915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:39.998195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6437a688-9ea9-4099-95cb-e9b87e9c5d27 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1451 microversion: 2.1 time: 1.082154 Oct 19 01:09:39.999869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2314/4740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:38 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1451 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:40.120279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:40.121277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:40.140546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.143184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.144794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.150514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.151195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.153843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.221764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:40.271597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2fdcdcb1-e59d-47c2-bbe6-852eb2a686bf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1621 microversion: 2.1 time: 0.369006 Oct 19 01:09:40.296733 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2427/4741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:39 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1621 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:40.321172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f7e64c-699f-4cc8-99bb-8b0d424f9e32", "name": "network-vif-deleted", "tag": "61d8eba6-16a4-4b3f-828d-1dc754833ff7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:40.330851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lazy-loading 'flavor' on Instance uuid f2c5f362-ba87-46c6-ab65-01d1db187934 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:09:40.394201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.396111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.396949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.415140 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:40.441223 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'shelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state shelved_offloaded Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 14 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: {"shelve": {}} Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'shelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state shelved_offloaded Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'shelve': {}}} Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:09:40.450846 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state shelved_offloaded Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state shelved_offloaded Oct 19 01:09:40.458251 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:40.470341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'shelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state shelved_offloaded {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:40.476538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] Creating event network-vif-deleted:61d8eba6-16a4-4b3f-828d-1dc754833ff7 for instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 on n-h2-master-1 Oct 19 01:09:40.477242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fbc946d-2c72-4cfc-843b-7c24d6f64f39 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 155 microversion: 2.1 time: 0.356927 Oct 19 01:09:40.478278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2315/4742] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:09:40 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 155 bytes in 363 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 01:09:40.503932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:40.508084 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a60409b3-de74-4fd3-8f69-6836c9cf7bae req-151e23ad-6813-4391-af4b-ccee5b0b52ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208874 Oct 19 01:09:40.511003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:40.518500 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2428/4743] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:40.548901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.549888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.550552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.576503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.578024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.578880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.730941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:40.814982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 01:09:40.837995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:40.847044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:40.848192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:40.939233 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] Creating event network-changed:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:09:40.965746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9c9fbb9d-1925-4be1-b853-a2223fa2e43d req-d390b098-aee2-40b6-b0c1-13410e6b9fe7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244225 Oct 19 01:09:40.971369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2429/4744] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:09:41.023484 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:41.121294 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9129feed-4b07-4db5-ae5b-18e7651ed9d7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.630848 Oct 19 01:09:41.123878 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2316/4745] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:09:40 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:09:41.135535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:41.136408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:41.152329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:41.169667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:41.171413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:41.173480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:41.174572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:41.186967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:41.301608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:41.304221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:41.333087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:41.333841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:41.334613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:41.335469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:41.342587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:41.344031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:41.442455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:41.448283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:41.466198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:41.467345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lazy-loading 'fault' on Instance uuid a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:09:41.917837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:41.927287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-632e8552-d0b7-402a-b9fe-19cee6420202 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 200 len: 1355 microversion: 2.1 time: 0.628574 Oct 19 01:09:41.927287 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2317/4746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:41 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 1355 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:42.659955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:42.674421 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-500750c7-58a1-4b1c-a17b-73a3c614ac89 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1459 microversion: 2.1 time: 1.543494 Oct 19 01:09:42.678223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2430/4747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:41 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1459 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:42.953969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:42.955183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: a7f7e64c-699f-4cc8-99bb-8b0d424f9e32] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:42.958985 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:42.975170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:42.975725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:42.985454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:42.986216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:42.986886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:42.987492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:43.027857 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] HTTP exception thrown: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Request method failure captured: Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 HTTP/1.1 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02PfvuF5FK-lBYAeCKONFvpt4ZHToQuDk2Ar_tRRoKUn6i4vEK-w4vv0Sk1lxhkD_gGcWdlOyz8JKtAAQyEGgNfJq1EbZcdieQDaH9mkE4sZDd0stSc0B369XZ8beaQ5Lc-s6ZeewsCa6jSUIHxJw6m_iVfHGPRK_ACVNpPPcRODpg Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44453298a7d04311bd64354938bf2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}] Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2052fd7bb1ee432cb3ca4ec07698292c Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: exception: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'a7f7e64c-699f-4cc8-99bb-8b0d424f9e32'} Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:09:43.034477 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Returning 404 to user: Instance a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2486b8c-a7d4-4a2a-bd56-8194177c8942 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32" status: 404 len: 111 microversion: 2.1 time: 0.086766 Oct 19 01:09:43.037700 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2318/4748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:42 2022] GET /compute/v2.1/servers/a7f7e64c-699f-4cc8-99bb-8b0d424f9e32 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:09:43.706447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:43.709390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:43.722025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:43.726388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:43.727040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:43.727936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:43.728714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:43.729290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:44.161568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:44.175655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-669a5ab0-7c80-4b25-b18e-d7aa1d4f4d38 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.473800 Oct 19 01:09:44.177440 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2431/4749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:43 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:45.207530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:45.208831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:45.223415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:45.224191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:45.224841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:45.225733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:45.227236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:45.231333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:45.386770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:09:45.414885 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:09:45.418196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:45.419010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:45.419996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:45.457982 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] Creating event network-changed:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h2-master-1 Oct 19 01:09:45.467473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-447556a7-3787-4f25-8d94-4b2f8971647f req-698482e3-a928-4d22-b248-7d37b159e244 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084506 Oct 19 01:09:45.468809 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2432/4750] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:09:45.604413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:45.619251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f38a5d9-465c-4c81-862c-0d61d6b8e4af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.416389 Oct 19 01:09:45.628599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2319/4751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:45 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:46.652940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:46.653776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:46.669968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:46.671832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:46.672660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:46.676068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:46.677241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:46.678308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:47.450201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:47.466954 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94402d3a-0d11-4026-9d66-b0ea47783dc6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.820234 Oct 19 01:09:47.468297 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2433/4752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:46 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:48.501262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:48.504393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:48.536333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:48.557699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:48.559972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:48.560801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:48.561913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:48.575593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:50.082057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:50.098324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce80ed7c-22e9-44b3-84e3-ae35ded5ed32 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 1.603064 Oct 19 01:09:50.100387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2320/4753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:48 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:51.131148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:51.132858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:51.153514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:51.161337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:51.163285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:51.173914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:51.174878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:51.176925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:53.053043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:53.063252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ebefb046-55f0-4a7f-bb70-62247c080b43 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 1.939283 Oct 19 01:09:53.071461 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2434/4754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:51 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:54.099304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:54.100762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:54.111513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:54.113284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:54.138397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:54.139849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:54.144710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:54.145404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:55.301704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:55.312196 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7588dc66-6871-4e90-a3eb-f41fb685d6e6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 1.216577 Oct 19 01:09:55.334067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2321/4755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:54 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:09:56.348208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:56.348864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:56.357728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:56.365027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:56.368884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:56.370267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:56.375276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:56.376263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:57.523748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:57.549181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-884da5f1-1aa3-4c8e-a0dc-824924435065 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 1.205420 Oct 19 01:09:57.549795 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2435/4756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:56 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:09:58.585327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:09:58.587089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:09:58.606610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:58.612259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:58.622957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:58.627606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:09:58.630946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:09:58.632151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:09:59.671869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:09:59.697883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d43ecb50-6b94-4aa9-afd2-1345701f3af9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 1.116944 Oct 19 01:09:59.699497 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2322/4757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:09:58 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:00.567714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9b6c7dc-7476-4c81-9b2c-ab17c163e59b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '.version_select at 0x7f2af4218550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:00.647645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9b6c7dc-7476-4c81-9b2c-ab17c163e59b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-324832320" status: 202 len: 0 microversion: 2.1 time: 0.084803 Oct 19 01:10:00.653727 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2436/4758] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 01:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-324832320 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:10:00.704250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-70461380-b6d4-4a4a-bfcc-93b37fe09f3b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: .version_select at 0x7f2aefe59e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-559336120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoPDineJOpiXpryRaifrdC6e19ncWjhraGuuhUN336Ale35scMnu5WN/jOoNG9IE6H2VdGlKFpkEN50d9aqxRFvkdi+fYVrcS4xva6+CRx8p5d7BmZTfVsM2EWXsUeLBw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:00.727887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:00.728805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:00.748602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:00.750755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:00.753890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:00.755211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:00.758243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:00.760507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-70461380-b6d4-4a4a-bfcc-93b37fe09f3b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:10:00.761225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:00.790927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-70461380-b6d4-4a4a-bfcc-93b37fe09f3b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:10:00.883469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-70461380-b6d4-4a4a-bfcc-93b37fe09f3b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.191466 Oct 19 01:10:00.884109 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2323/4759] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:10:00 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:10:01.164148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:01.173760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-82da2797-ab40-490b-987a-6bbaf94d0caa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.449664 Oct 19 01:10:01.178307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2437/4760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:00 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:02.204682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:02.206038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:02.222611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:02.226354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:02.228223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:02.234279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:02.235725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:02.239726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:02.676961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:02.692543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8aacd608-5448-4769-a465-7f3c6aa7d15e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.488310 Oct 19 01:10:02.716112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2324/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:02 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:03.724820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:03.725718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:03.749966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:03.751413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:03.774564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:03.776532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:03.780761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:03.782328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:04.588919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:04.610165 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a21acdfb-baf0-411a-9f4a-b7cbb1c14392 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.890367 Oct 19 01:10:04.611541 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2438/4762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:03 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:05.637610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:05.638244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:05.682946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:05.688897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:05.689488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:05.692488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:05.694944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:05.695399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:06.287544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:06.302609 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e626b26a-3657-4e35-89cb-937125cab7ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.669086 Oct 19 01:10:06.307904 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2325/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:05 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:07.337154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:07.337917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:07.354379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:07.354919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:07.369874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:07.371660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:07.375760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:07.376297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:07.732081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:07.748921 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28de2561-5d02-4473-9c15-11ac99522e0d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.411624 Oct 19 01:10:07.750311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2439/4764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:07 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:08.773612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:08.775177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:08.790464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:08.791341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:08.792009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:08.793354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:08.793985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:08.796044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:09.065379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:09.075124 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9cbde2a7-66e2-4fce-b8a4-6abf2d72a99a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.306266 Oct 19 01:10:09.080269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2326/4765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:08 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:10.103660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:10.105392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:10.124449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:10.126204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:10.129743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:10.130720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:10.131371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:10.140470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "name": "network-vif-plugged", "status": "completed", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:10.147304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:10.179516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:10.180381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:10.180381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:10.224669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] Creating event network-vif-plugged:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h2-master-1 Oct 19 01:10:10.240405 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-dbe58489-a3d0-42e8-a7ea-b424e5084457 req-8a31b560-dc47-4ca9-b019-82d303f5c9d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104429 Oct 19 01:10:10.246763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2327/4766] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:10:10.516995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:10.524609 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=58 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:10.551773 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e17e489a-99a1-4df6-8d98-6f255a9ead15 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.450013 Oct 19 01:10:10.553097 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2440/4767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:10 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:11.572923 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:11.579759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:11.580404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:11.594661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:11.595186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:11.595631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:11.596359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:11.596844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:11.597274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:11.635678 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:11.929938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:11.956847 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f4e6330-2b19-4200-8d18-110b5c9043c7 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.383578 Oct 19 01:10:11.960291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2328/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:11 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:12.985662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:12.986304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:13.007813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:13.014068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:13.014861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:13.016050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:13.016767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:13.019197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:13.354549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:13.372793 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b60a183-4d05-46ef-96fc-4cc075929100 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1517 microversion: 2.1 time: 0.391845 Oct 19 01:10:13.373547 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2441/4769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:12 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1517 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:14.196997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:14.198703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:14.207699 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:14.230945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.231467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.231917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.242686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.243216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.243671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.402167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:14.405374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:14.431349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.431847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.432290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.435987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.439322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.440025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.806437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:14.817383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6536af7-3200-4833-8224-07013dba6452 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.422300 Oct 19 01:10:14.822651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2442/4770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:14 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:14.843315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:14.844361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:14.854114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:14.855266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.855982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.856724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.858416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.859106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.859822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.869620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-09504fa3-1888-4d9a-bb1e-6d72978ac339 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.678126 Oct 19 01:10:14.870961 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2329/4771] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:14 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:14.908982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:14.909917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:14.918894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.919898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.920530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:14.922354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:14.923034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:14.923760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:15.275845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:15.284358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d54f380-99e2-4886-b0e1-7b97274ee5f8 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.446206 Oct 19 01:10:15.288198 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2443/4772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:14 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:15.317624 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:15.318558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:15.331627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:15.335798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:15.336432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:15.337393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:15.338005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:15.341170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:15.391790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:15.411438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd4ee007-15a9-426a-af3c-aafdad83bc2e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.514795 Oct 19 01:10:15.413229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2330/4773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:14 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:15.442206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:15.443011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:15.478442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:15.480995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:15.483033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:15.485978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:15.487964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:15.488443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:15.977814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:16.011571 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b073e30-01bf-4f6f-9615-3066cb24dbbf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.695545 Oct 19 01:10:16.013020 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2444/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:15 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:16.040105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ae7a740-d394-49ce-b76f-08252af4d449 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:16.040537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:16.052985 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:16.056782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0ae7a740-d394-49ce-b76f-08252af4d449 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. Oct 19 01:10:16.063003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f771774-d673-4401-8180-50b86f20cfee tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.624991 Oct 19 01:10:16.064218 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2331/4775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:15 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ae7a740-d394-49ce-b76f-08252af4d449 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/aacd33c4-d2bf-4ab6-a572-1e93feaf37da/action HTTP/1.1 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: {"os-stop": {}} Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: exception: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'aacd33c4-d2bf-4ab6-a572-1e93feaf37da', 'body': {'os-stop': {}}} Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:16.083509 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. Oct 19 01:10:16.087558 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:16.101687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ae7a740-d394-49ce-b76f-08252af4d449 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance aacd33c4-d2bf-4ab6-a572-1e93feaf37da has no mapping to a cell. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:16.102605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-239394261"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:16.102991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ae7a740-d394-49ce-b76f-08252af4d449 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/aacd33c4-d2bf-4ab6-a572-1e93feaf37da/action" status: 404 len: 117 microversion: 2.1 time: 0.067276 Oct 19 01:10:16.103891 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2445/4776] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:16 2022] POST /compute/v2.1/servers/aacd33c4-d2bf-4ab6-a572-1e93feaf37da/action => generated 117 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:16.106673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:16.114287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:16.115864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.116558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.117318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.117440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:16.118711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.120029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.120679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.141839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.143245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.143979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.147714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.148317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.149069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.773169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:16.786465 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00f83de5-dd66-49be-b7d3-f836a05b6420 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.676212 Oct 19 01:10:16.801600 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2446/4777] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:16 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:16.821062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:16.821852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:16.829075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.829737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.830327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.831446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:16.832438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:16.845034 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e41ff8b6-64a6-44fc-8edd-2776b768aa19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.756193 Oct 19 01:10:16.848377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:16.849533 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2332/4778] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:16 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 01:10:17.791751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:17.802079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61f13aa4-8ba7-4c58-93f2-c1702593ea44 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.986080 Oct 19 01:10:17.803090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2447/4779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:16 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:17.838881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:17.839752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: cf4b3653-b1a6-4263-948c-3d48e7823a3b] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:17.859920 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/cf4b3653-b1a6-4263-948c-3d48e7823a3b/action HTTP/1.1 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 15 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: {"suspend": {}} Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: exception: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'cf4b3653-b1a6-4263-948c-3d48e7823a3b', 'body': {'suspend': {}}} Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:17.865912 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:17.873679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:17.873679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:17.873679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. Oct 19 01:10:17.873679 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:17.877186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance cf4b3653-b1a6-4263-948c-3d48e7823a3b could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:17.879101 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a63bf6df-1528-401e-ae89-4bf888155871 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/cf4b3653-b1a6-4263-948c-3d48e7823a3b/action" status: 404 len: 111 microversion: 2.1 time: 0.048923 Oct 19 01:10:17.879592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2333/4780] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:17 2022] POST /compute/v2.1/servers/cf4b3653-b1a6-4263-948c-3d48e7823a3b/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:17.887289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:17.887992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:17.924372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:17.925053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:17.937293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:17.940515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:17.941162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:17.941814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.209164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:18.221386 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1e81401-553e-41bc-a2f4-f9b87a853a3c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.338004 Oct 19 01:10:18.222280 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2448/4781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:17 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:18.258159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:18.259214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:18.272150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.272980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.274145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.275016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.275613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.276207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.595610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:18.606887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d80aa358-ac34-4433-af13-2a9088e2243e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.358886 Oct 19 01:10:18.608598 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2334/4782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:18 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:18.644349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:18.644937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:18.665700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.666203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.666641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.672682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.673139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.673576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.721387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lazy-loading 'flavor' on Instance uuid f2c5f362-ba87-46c6-ab65-01d1db187934 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:10:18.844354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf0acdce-6caf-4c96-8fd6-30d6162c0028 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.212977 Oct 19 01:10:18.846049 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2449/4783] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:18 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:10:18.862810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:18.887337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:18.924087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.924587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.926017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:18.926974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:18.927447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:18.927883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:19.273417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:19.289846 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-27f4184c-cf5b-4a93-832e-333aa958fd6c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1512 microversion: 2.1 time: 0.437182 Oct 19 01:10:19.292454 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2335/4784] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:18 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:20.318965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:20.320753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:20.343508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:20.344043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:20.347957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:20.350265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:20.353020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:20.353676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:20.701160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-998555193", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "34764633-cd72-44d7-a8a5-b6afaf7589e0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-559336120", "security_groups": [{"name": "tempest-secgroup-smoke-287283435"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:20.865073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:20.881476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-961f36ec-f182-49f4-9f5d-5c606fdfccaa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1495 microversion: 2.1 time: 0.569771 Oct 19 01:10:20.882439 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2450/4785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:20 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1495 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:20.915219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:20.915777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:20.929878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:20.930387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:20.933762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:20.934523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:20.935570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:20.936183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:20.962599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lazy-loading 'flavor' on Instance uuid f2c5f362-ba87-46c6-ab65-01d1db187934 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:10:20.980247 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'suspend' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state suspended Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: {"suspend": {}} Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'suspend' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state suspended Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'suspend': {}}} Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 19 01:10:20.985055 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state suspended Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state suspended Oct 19 01:10:20.990737 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:20.994311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'suspend' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state suspended {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:20.995620 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-deb8fc52-a30a-40b5-bb0f-a3a626a3a32e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 148 microversion: 2.1 time: 0.084773 Oct 19 01:10:20.998152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2451/4786] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:20 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 148 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 01:10:21.007624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] validate_networks() for [('34764633-cd72-44d7-a8a5-b6afaf7589e0', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:10:21.014655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:21.017065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:21.035481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:21.035986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:21.036611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:21.037507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:21.043860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:21.044952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:21.173107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37a6c269-2494-4814-b13b-66864371b33e tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 202 len: 0 microversion: 2.1 time: 0.167325 Oct 19 01:10:21.173991 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2452/4787] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:21 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:10:21.199989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:21.201079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:21.219949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:21.220825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:21.221543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:21.223669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:21.224246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:21.225811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:21.866186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:21.879494 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5b181a9-f0de-4638-a6e8-1dea48c65805 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1501 microversion: 2.1 time: 0.700583 Oct 19 01:10:21.892796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2453/4788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:21 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1501 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:22.491028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:10:22.491484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:10:22.491932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:10:22.492376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:10:22.492783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:10:22.515097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:22.516085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:22.516994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:22.518303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:22.519294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:22.521181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:22.547815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:10:22.573513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:10:22.602128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:10:22.606470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:10:22.733677 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4e6a3ac-c3ed-4af1-b138-c5a2c49993d4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.036431 Oct 19 01:10:22.734703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2336/4789] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:10:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:10:22.746588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a99e2f73-b38d-4eb4-8e65-d3f583bbd21d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:22.747217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a99e2f73-b38d-4eb4-8e65-d3f583bbd21d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:22.913283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:22.913923 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:22.925956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a99e2f73-b38d-4eb4-8e65-d3f583bbd21d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:22.945318 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a99e2f73-b38d-4eb4-8e65-d3f583bbd21d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1265 microversion: 2.1 time: 0.200078 Oct 19 01:10:22.951142 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2454/4790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:22 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:22.964403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:22.965421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:22.968355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:22.969330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:22.974319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:22.976785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:23.580162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:23.590147 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11f9059b-f3bc-40b8-8a23-d45c2fd14941 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1501 microversion: 2.1 time: 0.683783 Oct 19 01:10:23.593794 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2337/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:22 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1501 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:23.973702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b886b17b-eb3a-4983-8e80-71b247803001 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:23.975138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b886b17b-eb3a-4983-8e80-71b247803001 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:24.168417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b886b17b-eb3a-4983-8e80-71b247803001 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:24.186527 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b886b17b-eb3a-4983-8e80-71b247803001 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1265 microversion: 2.1 time: 0.217268 Oct 19 01:10:24.193207 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2455/4792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:23 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:24.623402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:24.627446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:24.650589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:24.655112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:24.659402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:24.660454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:24.663285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:24.666590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.229930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:25.238891 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6cf3db3e-8a9d-416f-b747-1da0ef9b8b9b tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.621897 Oct 19 01:10:25.243389 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2338/4793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:24 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:25.272532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:25.277741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:25.286443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:25.287304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:25.291802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.292989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:25.293814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:25.294984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.490782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:25.505720 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df7f365d-80aa-43af-aa18-bb2441d309d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1317 microversion: 2.1 time: 0.257296 Oct 19 01:10:25.506826 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2339/4794] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:25 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:25.520777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:25.521707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:25.537517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:25.545944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:25.548734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.549682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:25.550155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:25.550592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.781414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-plugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:25.813866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:25.815596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:25.816193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:25.869123 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] Creating event network-vif-plugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:10:25.890368 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9f42059c-cddd-4509-9e3a-ae2028fc89a9 req-9d449c1c-5cf9-4dfc-94db-0230668d5891 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.062679 Oct 19 01:10:25.891317 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2456/4795] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:10:26.482489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:26.491992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d1a96d6-27b7-46cd-bb98-5e37a611794f tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.982434 Oct 19 01:10:26.498559 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2340/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:25 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:26.523047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:26.524585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:26.532500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:26.533510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:26.542997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:26.546264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:26.547506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. Oct 19 01:10:26.548186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/8eb3e1d7-3c1b-48a3-a44a-621f37e60a13/action HTTP/1.1 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: {"unpause": {}} Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8eb3e1d7-3c1b-48a3-a44a-621f37e60a13', 'body': {'unpause': {}}} Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:26.550351 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:26.553783 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:26.553783 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:26.553783 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. Oct 19 01:10:26.553783 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:26.557015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:26.557872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:26.558603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:26.559514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 8eb3e1d7-3c1b-48a3-a44a-621f37e60a13 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:26.564159 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79620ae8-b237-421d-877e-43286a10ee08 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/8eb3e1d7-3c1b-48a3-a44a-621f37e60a13/action" status: 404 len: 111 microversion: 2.1 time: 0.046495 Oct 19 01:10:26.565096 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2457/4797] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:26 2022] POST /compute/v2.1/servers/8eb3e1d7-3c1b-48a3-a44a-621f37e60a13/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:26.580172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:26.585695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:26.600896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:26.602373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:26.604473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:26.607708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:26.608422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:26.609116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.000265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:27.017380 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80be8e40-633c-4743-829d-d438efa98354 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1323 microversion: 2.1 time: 0.485280 Oct 19 01:10:27.021485 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2341/4798] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:26 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:27.210182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:27.225444 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-553740ee-8f39-475d-ba28-fca3cf53c1be tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.655473 Oct 19 01:10:27.230422 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2458/4799] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:26 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:27.255116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:27.255751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:27.275121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.275629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.276081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.285684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.286184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.286641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.690427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:27.700747 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aef759fd-5ed3-41f6-9b0c-00f55c2d0635 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.451728 Oct 19 01:10:27.706570 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2342/4800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:27 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:27.735443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:27.736239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:27.748360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.749086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.749803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.750702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.751315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.752481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.782289 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:27.789383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'unpause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: {"unpause": {}} Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'unpause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'unpause': {}}} Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state active. Cannot unpause while the instance is in this state. Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:27.791171 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:27.798814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:27.798814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:27.798814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:27.798814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:27.798814 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:27.801261 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'unpause' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:27.802478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c287306f-9df1-4c34-a5da-e5f90cf265b5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 145 microversion: 2.1 time: 0.073072 Oct 19 01:10:27.806536 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2459/4801] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:27 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 145 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:10:27.812425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:27.813397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:27.823375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.832155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.832981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:27.834002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:27.834685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:27.835348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:28.058874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:28.060129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:28.081459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:28.098279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:28.100020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:28.101932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:28.103820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:28.106074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:28.307553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:28.316007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:28.324985 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-50b35f9c-1616-46e6-b6db-604b26462d1c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1323 microversion: 2.1 time: 0.270772 Oct 19 01:10:28.329441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2460/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:28 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:28.346787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63da510c-37a1-4dbd-a181-bb318a3a3894 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.539008 Oct 19 01:10:28.347950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2343/4803] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:27 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:28.375265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:28.376555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:28.385630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:28.386369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:28.387278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:28.388905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:28.389531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:28.390118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:29.143335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:29.159822 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c2cd5563-84a9-4bce-9a4d-c4f53382b3af tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.789344 Oct 19 01:10:29.174506 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2461/4804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:28 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:29.186357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:29.186985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ee836a9c-8bb6-4449-9450-86ca0376e0ea] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:29.203723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/ee836a9c-8bb6-4449-9450-86ca0376e0ea/action HTTP/1.1 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 18 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: {"unshelve": null} Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ee836a9c-8bb6-4449-9450-86ca0376e0ea', 'body': {'unshelve': None}} Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:29.215966 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ee836a9c-8bb6-4449-9450-86ca0376e0ea could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:29.220442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91e0542d-5a8c-44c1-b226-90ce2a5fbdd6 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/ee836a9c-8bb6-4449-9450-86ca0376e0ea/action" status: 404 len: 111 microversion: 2.1 time: 0.038641 Oct 19 01:10:29.221134 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2344/4805] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:29 2022] POST /compute/v2.1/servers/ee836a9c-8bb6-4449-9450-86ca0376e0ea/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:29.232071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:29.232887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:29.252998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:29.253524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:29.253980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:29.260007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:29.260544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:29.266352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:29.354985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:29.355629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:29.375641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:29.390096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:29.390900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:29.393239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:29.395725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:29.396411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:29.849332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:29.868347 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7a83ba5-1ca7-4361-890b-1cf650bfee7e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.513757 Oct 19 01:10:29.888193 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2345/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:29 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:29.933777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:29.942442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c9869e9-4ef6-4acd-a88b-77e1ed011afa tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.716870 Oct 19 01:10:29.947528 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2462/4807] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:29 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:29.973666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:29.974288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:30.006746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.007703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.009396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.015075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.015672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.016128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.062071 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:30.468157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:30.485242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b178734-b1e3-4e6d-8753-aa01e3c6c93a tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.515333 Oct 19 01:10:30.485853 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2346/4808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:29 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:30.511786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:30.513204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:30.523068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.536139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.537299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.538445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.539669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.540942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.613366 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Cannot 'unshelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action HTTP/1.1 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 18 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: {"unshelve": null} Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'unshelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'unshelve': None}} Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 in vm_state active. Cannot unshelve while the instance is in this state. Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:10:30.619859 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 409 to user: Cannot 'unshelve' instance f2c5f362-ba87-46c6-ab65-01d1db187934 while it is in vm_state active {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:30.627183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25ce49e4-9ffb-4daa-a959-ed4c3bee8951 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action" status: 409 len: 146 microversion: 2.1 time: 0.113839 Oct 19 01:10:30.630434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:30.630973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:30.632824 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2463/4809] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:30 2022] POST /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934/action => generated 146 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:10:30.639177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.639676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.640118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.640863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.641327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.641767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.898772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:30.899372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:30.911302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.911796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.912238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:30.914936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:30.916781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:30.917262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:31.309299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:31.328541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d79bd120-ede7-4196-a41e-6586d0c754ee tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.701853 Oct 19 01:10:31.352476 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2347/4810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:30 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:31.374476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:31.378200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:31.421387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:31.429856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:31.435927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:31.443174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:31.447443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:31.450990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:31.591702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:31.605698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-01253184-a8b9-4676-861a-39a64604eb74 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.711167 Oct 19 01:10:31.607942 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2464/4811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:30 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:32.063440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:32.108670 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47068d3a-6fe9-4579-834e-86b5d5143423 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.754156 Oct 19 01:10:32.110051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2348/4812] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:31 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:32.134961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1338360101_updated"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:32.139321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: 3353f71d-d54d-492e-983f-f3f9ba9b3c83] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:32.146680 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: request: PUT /compute/v2.1/servers/3353f71d-d54d-492e-983f-f3f9ba9b3c83 HTTP/1.1 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 81 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1338360101_updated"}} Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3353f71d-d54d-492e-983f-f3f9ba9b3c83', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1338360101_updated'}}} Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 19 01:10:32.148698 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. Oct 19 01:10:32.152269 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:32.155119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance 3353f71d-d54d-492e-983f-f3f9ba9b3c83 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:32.156260 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b096afda-f3de-4ea2-aa29-78d7ac5cbda5 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "PUT /compute/v2.1/servers/3353f71d-d54d-492e-983f-f3f9ba9b3c83" status: 404 len: 111 microversion: 2.1 time: 0.025817 Oct 19 01:10:32.157386 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2465/4813] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 01:10:32 2022] PUT /compute/v2.1/servers/3353f71d-d54d-492e-983f-f3f9ba9b3c83 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:32.169558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:32.170834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:32.178135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:32.178832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:32.179430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:32.180320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:32.180996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:32.181571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:32.534252 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:32.549058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:32.573942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37d3613a-4a65-4e81-b8f4-ba96ca81c03d tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.412103 Oct 19 01:10:32.578831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2349/4814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:32.601966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:32.603927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:32.636138 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:32.640891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:32.642709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:32.643800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:32.645231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:32.650001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:32.650761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:32.886459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:32.916880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:32.917382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:32.917826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:32.963306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] Creating event network-changed:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:10:32.975906 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e39717c9-2201-4b45-8e5f-62ca6fdae67b req-d4df28bb-92fb-462d-bb41-110352a91e68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.725544 Oct 19 01:10:32.977035 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2466/4815] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:10:32.993601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:32.995653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:33.006158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.006806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.007486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:33.008218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.008837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.009373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:33.263383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:33.274623 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d964bb2-ede4-4fb3-bc80-335c60d1a948 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.677754 Oct 19 01:10:33.277194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2350/4816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:32 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:33.302568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19b5437b-2aeb-402b-aede-43a330568726 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19b5437b-2aeb-402b-aede-43a330568726 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 HTTP/1.1 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 280 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.312303 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 19 01:10:33.315491 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:33.323369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19b5437b-2aeb-402b-aede-43a330568726 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:33.338222 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19b5437b-2aeb-402b-aede-43a330568726 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 400 len: 619 microversion: 2.1 time: 0.032111 Oct 19 01:10:33.343977 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2351/4817] 10.222.0.27 () {60 vars in 1257 bytes} [Wed Oct 19 01:10:33 2022] PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 619 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:10:33.365332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:33.367293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:33.396443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.398963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.400798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:33.402112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.405084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.409565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:33.806699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:33.817332 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e88ce935-c384-4c55-8ad6-75e8ccd29494 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.839054 Oct 19 01:10:33.825862 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2467/4818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:32 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:33.916384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:33.929090 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8085b7c-a573-4428-a9e7-48c8ffe86b21 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.581122 Oct 19 01:10:33.930249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2352/4819] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:33 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:33.960455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:33.961946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:33.977973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.982096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.982885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:33.984033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:33.985904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:33.987039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:34.181442 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:34.479725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:34.492117 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6778bf89-8135-4138-8a3b-916d0aae9090 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.538316 Oct 19 01:10:34.493375 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2468/4820] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:33 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:34.520534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dad78c6-04b2-44b3-8cc6-9648d5b6aad3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dad78c6-04b2-44b3-8cc6-9648d5b6aad3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: request: PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 HTTP/1.1 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 24 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": ""}} Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934', 'body': {'server': {'name': ''}}} Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi '' Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:10:34.535854 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 19 01:10:34.540384 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:34.546564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dad78c6-04b2-44b3-8cc6-9648d5b6aad3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:34.549819 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7dad78c6-04b2-44b3-8cc6-9648d5b6aad3 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 400 len: 108 microversion: 2.1 time: 0.033300 Oct 19 01:10:34.555358 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2353/4821] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 01:10:34 2022] PUT /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:10:34.563369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:34.564065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:34.574832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:34.575727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:34.580974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:34.581836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:34.582327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:34.582786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:34.853627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:34.854531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:34.874423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:34.880806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:34.884265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:34.886066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:34.891891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:34.893955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:34.942449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:34.953037 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2747a83-cc4e-4ab4-9dd8-eb955b1ea1b9 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1504 microversion: 2.1 time: 0.394594 Oct 19 01:10:34.954318 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2469/4822] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:34 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:36.586447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:36.600717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81831200-c0c3-43d2-b40d-69f9c3d2e552 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 1.746997 Oct 19 01:10:36.601384 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2354/4823] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:34 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:37.801756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:37.802409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:37.829220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:37.829887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:37.830347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:37.831111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:37.842350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:37.842826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:38.215352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:38.230553 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9e8cea1-0789-4c0e-8577-705af4215984 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.432840 Oct 19 01:10:38.240428 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2470/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:37 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:39.272739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:39.275780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:39.300469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:39.302221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:39.302844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:39.304279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:39.304939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:39.307337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:39.614953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:39.644296 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18fddedd-5f92-4dd2-a8da-0d951c805ffe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.389141 Oct 19 01:10:39.650694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2355/4825] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:39 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:40.041807 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-plugged", "status": "completed", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:40.070705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:40.071453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:40.072581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:40.106798 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] Creating event network-vif-plugged:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:10:40.121101 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d1384e3a-dc95-4466-878f-41cdfe86223f req-d944059e-d542-42e5-8558-fe6dd8800ccc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081921 Oct 19 01:10:40.122860 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2471/4826] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:10:40.678748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:40.683028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:40.745415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:40.757886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:40.768224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:40.772532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:40.780075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:40.781014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:41.339371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:41.355552 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b56ba6ce-c122-49b7-8027-aeae8e287bc2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1390 microversion: 2.1 time: 0.687011 Oct 19 01:10:41.358492 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2356/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:40 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1390 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:42.391132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:42.392439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:42.412315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:42.425362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:42.426041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:42.429087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:42.432800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:42.437287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:42.907359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:42.923317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-35ed7d43-ed67-4999-bc8c-e127091b2a11 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1561 microversion: 2.1 time: 0.530228 Oct 19 01:10:42.924162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2472/4828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:42 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1561 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:42.963853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:42.966204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:42.991814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:42.992738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:42.994198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:42.996259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:42.996816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:42.997286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:43.419741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:43.429078 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-10ea9a8e-e477-44f3-ad62-862a325738d5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1561 microversion: 2.1 time: 0.469441 Oct 19 01:10:43.429880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2357/4829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:42 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1561 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:46.929567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:46.930135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:46.947197 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=60 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:46.963567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:46.964086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:46.964541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:46.965360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:46.965951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:46.966392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.035909 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 HTTP/1.1 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ed075090-4932-426a-a6fd-4a773fce4145'} Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:47.037664 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.042032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:47.081650 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ab7438da-2f49-4fac-ba46-e758ea77fc5c tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 404 len: 111 microversion: 2.1 time: 0.121341 Oct 19 01:10:47.083281 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2473/4830] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:10:46 2022] DELETE /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:47.098732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:47.099430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: ed075090-4932-426a-a6fd-4a773fce4145] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:47.102524 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:47.120649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.127317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.130388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.131544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.134569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.137355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.194037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 HTTP/1.1 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: exception: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'ed075090-4932-426a-a6fd-4a773fce4145'} Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:47.203466 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. Oct 19 01:10:47.207750 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:10:47.224783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance ed075090-4932-426a-a6fd-4a773fce4145 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:47.225917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1e21ac85-8190-4f61-bf13-2c51d5bc9edf tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145" status: 404 len: 111 microversion: 2.1 time: 0.131421 Oct 19 01:10:47.226595 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2358/4831] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:47 2022] GET /compute/v2.1/servers/ed075090-4932-426a-a6fd-4a773fce4145 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:47.235944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:47.238918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:47.248586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.249339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.249933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.254459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.255546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.256227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.354447 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:10:47.617306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-684d17a8-bc8b-4de0-97e2-3b707b8eda60 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 204 len: 0 microversion: 2.1 time: 0.384956 Oct 19 01:10:47.619044 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2474/4832] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:10:47 2022] DELETE /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:10:47.627770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:47.628612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:47.641259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.643216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.645061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:47.648340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:47.653444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:47.654348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:48.279017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:48.280646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:48.296958 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:48.308209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-174ce881-4be7-4e7e-9f15-981c098596ca tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.684205 Oct 19 01:10:48.313644 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2359/4833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:47 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:48.314064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:48.316471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:48.320133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:48.326334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:48.335099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:48.339700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:48.357172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:48.381598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:48.382088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:48.382968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:48.425873 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] Creating event network-changed:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:10:48.441362 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f9d3ba99-3c58-499f-bff0-31f7ca29154d req-6cda335d-ca5f-4415-8498-71098c1e7d1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111374 Oct 19 01:10:48.441990 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2360/4834] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:10:49.257819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:49.268605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-642363dd-5c5b-4f6f-9bf3-04a44cb4a131 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1561 microversion: 2.1 time: 0.994872 Oct 19 01:10:49.269722 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2475/4835] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:48 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1561 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:10:49.343344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:49.344055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:49.368482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:49.369027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:49.369498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:49.370209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:49.370681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:49.371163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:50.042284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:50.061641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a509d0d6-ee89-4e04-9a3e-b72f1f375316 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1510 microversion: 2.1 time: 0.723888 Oct 19 01:10:50.078923 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2361/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:49 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1510 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:50.925850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c5f362-ba87-46c6-ab65-01d1db187934", "name": "network-vif-deleted", "tag": "38012c3b-a28c-46dd-8106-a52c7402a24a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:50.994348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:51.002849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:51.014914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:51.087188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:51.088337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:51.098123 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] Creating event network-vif-deleted:38012c3b-a28c-46dd-8106-a52c7402a24a for instance f2c5f362-ba87-46c6-ab65-01d1db187934 on n-h2-master-1 Oct 19 01:10:51.126001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:51.128557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2cdd36e5-719a-4fb3-99a3-6172addff258 req-960ca5eb-8fc2-4ff4-9feb-2980490f752d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212606 Oct 19 01:10:51.129145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:51.129898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:51.130919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:51.131614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:51.138309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:51.138936 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2476/4837] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:10:51.306563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:51.309766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:51.311277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:51.314175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lazy-loading 'fault' on Instance uuid f2c5f362-ba87-46c6-ab65-01d1db187934 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:10:51.557134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1f3b94587e468d8c6dd9f134665691', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6213a887b044f49207f366ca8f5980', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:51.587674 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b4d65dd-696c-4a7f-9f6e-9bb205a5aebd tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 200 len: 1306 microversion: 2.1 time: 0.500431 Oct 19 01:10:51.588369 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2362/4838] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:51 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 1306 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:52.617436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:52.618732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] [instance: f2c5f362-ba87-46c6-ab65-01d1db187934] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:52.638338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:52.655297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:52.656478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:52.656605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:52.667403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:52.668503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:52.742296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] HTTP exception thrown: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Request method failure captured: Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 HTTP/1.1 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02Wj5rwqan0RteJEpDbFbPhn7T0kPt86R5BIZ_kTieD_tk-XTsT445SaAM_JidM8MANh_akQDsKZUMptGruVcml1l3D3_ocE1ok3pABDYDaJzDv0ap7dk-D5Hth4HlEuppvOat5uJOIxBkzFFgWW9-c_XHYtKYfrWO1Zkwayi2FyVc Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f6213a887b044f49207f366ca8f5980", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f6213a887b044f49207f366ca8f5980"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f6213a887b044f49207f366ca8f5980"}]}] Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 7f6213a887b044f49207f366ca8f5980 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1720111669 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fa1f3b94587e468d8c6dd9f134665691 Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-1720111669-project Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f2c5f362-ba87-46c6-ab65-01d1db187934'} Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:10:52.744223 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. Oct 19 01:10:52.749267 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:10:52.750561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] Returning 404 to user: Instance f2c5f362-ba87-46c6-ab65-01d1db187934 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:10:52.751707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5a30b012-d7d0-4087-9087-9170511a44b0 tempest-ServersNegativeTestJSON-1720111669 tempest-ServersNegativeTestJSON-1720111669-project] 10.222.0.27 "GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934" status: 404 len: 111 microversion: 2.1 time: 0.138700 Oct 19 01:10:52.752745 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2477/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:52 2022] GET /compute/v2.1/servers/f2c5f362-ba87-46c6-ab65-01d1db187934 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:10:55.378731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:55.380111 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:55.400424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:55.401503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:55.401959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:55.403279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:55.405000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:55.406010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:55.804451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:55.816217 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-400103fb-35dc-4e1a-a43c-32fe2df19bc0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.441279 Oct 19 01:10:55.817502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2363/4840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:55 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:56.847029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:10:56.848409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:56.905344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:56.906595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:56.907201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:56.910752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:56.913623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:56.932515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:57.374837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:10:57.392819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d36ef97-d1d1-45b7-bf0f-e5373aa2164e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.550346 Oct 19 01:10:57.395801 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2478/4841] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:10:56 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:10:57.429137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-954319481"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:10:57.432736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:10:57.451459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:57.453156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:57.453773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:57.456594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:10:57.458659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:10:57.459330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:10:57.908589 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:10:57.962263 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4deef82-04a5-4813-856e-54aec6425e6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.541344 Oct 19 01:10:57.966209 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2364/4842] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:10:57 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 01:11:00.235484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-unplugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:00.251924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:00.257365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:00.271620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:00.277287 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:00.310316 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] Creating event network-vif-unplugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:11:00.337288 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-abf5611f-0a5a-44e1-bc76-34bcf4ab522f req-95fba1cd-9839-4bad-8a11-85eb0a323a2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102736 Oct 19 01:11:00.338203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2479/4843] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:03.965800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-plugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:03.978452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:03.979210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:03.980953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:03.998063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] Creating event network-vif-plugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:11:04.003485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b9cf97e6-74de-4688-ab68-4dc1dd956855 req-b5cd8f79-f5d0-48cb-9c5b-9638e2bc7555 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044627 Oct 19 01:11:04.004292 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2480/4844] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:04.145887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:04.151266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:04.158676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:04.159357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:04.159795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:04.161595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:04.162212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:04.162899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:04.205048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:11:04.303513 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-412fe87a-e435-4fc0-847d-3ee7bf0c1d28 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 204 len: 0 microversion: 2.32 time: 0.553353 Oct 19 01:11:04.305084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2365/4845] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:11:03 2022] DELETE /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:11:04.314230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:04.315156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:04.322416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:04.322796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:04.323230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:04.325451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:04.326142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:04.326675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:04.624884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:04.634564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:04.636022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:04.637459 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2951 microversion: 2.32 time: 0.327533 Oct 19 01:11:04.638032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2481/4846] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:04 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2951 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:05.666358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:05.667152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:05.679849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:05.680352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:05.680841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:05.688572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:05.689470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:05.690176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:06.103512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:06.125081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:06.127062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:06.129137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2951 microversion: 2.32 time: 0.467126 Oct 19 01:11:06.135036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:06.135813 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2366/4847] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:05 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2951 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:06.136445 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001344 Oct 19 01:11:06.136924 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2482/4848] 10.222.0.27 () {56 vars in 886 bytes} [Wed Oct 19 01:11:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 01:11:06.145755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:06.147282 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002312 Oct 19 01:11:06.147971 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2367/4849] 10.222.0.27 () {54 vars in 1035 bytes} [Wed Oct 19 01:11:06 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 19 01:11:06.156910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:06.158172 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80df38d2-1dbd-4ef4-aa9d-17f50d6b43e2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001998 Oct 19 01:11:06.159014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2483/4850] 10.222.0.27 () {54 vars in 1041 bytes} [Wed Oct 19 01:11:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:06.168760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:06.170360 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-100fb7bf-a4da-4034-b549-83add1897a1d tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001968 Oct 19 01:11:06.171178 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2368/4851] 10.222.0.27 () {56 vars in 886 bytes} [Wed Oct 19 01:11:06 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 19 01:11:07.179701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:07.179701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:07.184576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:07.195690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:07.201557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:07.204152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:07.204716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:07.205176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:07.932491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:07.954291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:07.957431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:07.959282 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf673beb-0126-43fe-b828-7656f14bb336 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2951 microversion: 2.32 time: 0.796229 Oct 19 01:11:07.961729 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2484/4852] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:07 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2951 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:08.998000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:08.999574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:09.013283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:09.017600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:09.037800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:09.050510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:09.053954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:09.055816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:09.674940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:09.724012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:09.741881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:09.751260 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b41ba68-a95e-4f63-a98d-032410d08c11 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2951 microversion: 2.32 time: 0.756811 Oct 19 01:11:09.754880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2369/4853] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:08 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2951 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:10.787923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:10.788560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:10.819644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:10.821184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:10.825258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:10.828330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:10.828912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:10.832186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:11.289241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:11.300998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:11.303484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:11.312317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57427df4-cb2f-4497-a474-4c039b6dd7fb tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2909 microversion: 2.32 time: 0.528385 Oct 19 01:11:11.333226 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2485/4854] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:10 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2909 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:12.352518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:12.353219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:12.364072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-unplugged", "status": "completed", "tag": "99e14050-3458-4a6f-941f-fd4d097c5722"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:12.399971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:12.400496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:12.409455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:12.413339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:12.413855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:12.416768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:12.418360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:12.422597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:12.423068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:12.495970 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] Creating event network-vif-unplugged:99e14050-3458-4a6f-941f-fd4d097c5722 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:12.515308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e96cc7a6-d711-4afa-b5f9-3923e557d4c3 req-d89cc2ac-f9fc-41a2-a7ab-f4e82f1e5871 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154827 Oct 19 01:11:12.522199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2486/4855] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:12.718396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:12.723237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:12.748314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:12.755180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:12.755769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:12.760241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:12.762270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:12.763609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:12.949398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ebe688a7-9748-4961-a9e1-96a49958e286 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action" status: 200 len: 24564 microversion: 2.1 time: 0.238593 Oct 19 01:11:12.950071 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2487/4856] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:11:12 2022] POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action => generated 24564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 01:11:13.166215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:13.197596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:13.204053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:13.217724 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e2bc94f-98bf-4d65-96d7-e955cc1d06fa tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2909 microversion: 2.32 time: 0.865189 Oct 19 01:11:13.222110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2370/4857] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:12 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2909 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:14.280649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:14.289156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:14.367928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:14.382122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-deleted", "tag": "38f11a8d-d34c-40f5-9986-fb064f507f0b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:14.386978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:14.388338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:14.393686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:14.400490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:14.407921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:14.462726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:14.463263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:14.463718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:14.536160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] Creating event network-vif-deleted:38f11a8d-d34c-40f5-9986-fb064f507f0b for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:14.564676 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f1f30c4a-d89f-409b-9e71-080ba1c41d33 req-ad395a27-4491-43ca-b8ad-c980228e9a79 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191300 Oct 19 01:11:14.571558 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2371/4858] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 19 01:11:14.700884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-unplugged", "status": "completed", "tag": "efb6bc64-e058-4f7e-bee3-a9a36db12eb4"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-unplugged", "status": "completed", "tag": "5fed55e1-6607-4d7f-aedd-c225114d151f"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2e8ddf-967a-4d6e-b31d-f682369381c4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:14.726491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:14.726491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:14.726839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:14.790492 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Creating event network-vif-unplugged:efb6bc64-e058-4f7e-bee3-a9a36db12eb4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:14.791018 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Creating event network-vif-unplugged:5fed55e1-6607-4d7f-aedd-c225114d151f for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:14.791529 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] Creating event network-vif-unplugged:8e2e8ddf-967a-4d6e-b31d-f682369381c4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:14.817422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff28ec24-0abb-4290-823e-94d0e74465e5 req-a75c508a-dfad-49eb-b21d-b5d2a6a1e94f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.125931 Oct 19 01:11:14.828384 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2372/4859] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:15.193824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:15.213523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:15.217601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:15.221600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4972d89e-8fe2-418e-98b0-b4aa8d8ebac0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2863 microversion: 2.32 time: 0.975748 Oct 19 01:11:15.224472 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2488/4860] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:14 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2863 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:15.773252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cac08499-ca6a-40ea-b514-06fc74f53425 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2aefe2d700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:15.922057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cac08499-ca6a-40ea-b514-06fc74f53425 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/b1609c24-d2dc-4971-b67b-96e4e36bb621" status: 200 len: 351 microversion: 2.1 time: 0.153594 Oct 19 01:11:15.922843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2373/4861] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:11:15 2022] GET /compute/v2.1/os-volumes/b1609c24-d2dc-4971-b67b-96e4e36bb621 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:16.270300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:16.272711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:16.283442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:16.299173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:16.303003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:16.306265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:16.306955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:16.308425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:17.178821 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-deleted", "tag": "8e2e8ddf-967a-4d6e-b31d-f682369381c4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:17.185604 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:17.245653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:17.252009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:17.252588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:17.340549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] Creating event network-vif-deleted:8e2e8ddf-967a-4d6e-b31d-f682369381c4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:17.379107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8c868c31-2355-4257-810b-f7367063e12a req-a87caab3-8ae0-42b4-becf-f3b5ed9c6c2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198783 Oct 19 01:11:17.385202 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2374/4862] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:18.385105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:18.408611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:18.426502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:18.441740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eec7f2cf-aa7b-41ea-9a19-9c8c482a9a7c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2531 microversion: 2.32 time: 2.179403 Oct 19 01:11:18.445410 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2489/4863] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:16 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2531 bytes in 2189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:19.489764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:19.493546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:19.497793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-deleted", "tag": "5fed55e1-6607-4d7f-aedd-c225114d151f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:19.516098 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:19.529200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:19.534438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:19.536746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:19.539480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:19.543105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:19.544247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:19.546232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:19.546880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:19.550333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:19.596988 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] Creating event network-vif-deleted:5fed55e1-6607-4d7f-aedd-c225114d151f for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:19.611967 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f4138f2c-99ac-46f5-8764-f709cc37fdd0 req-64477b3e-aac3-4c71-b24d-e01b4d43fe2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135222 Oct 19 01:11:19.624962 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2375/4864] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:20.195105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:20.213604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:20.225817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:20.228861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-335cfe59-dff0-4958-87ed-86c53d60c904 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 2325 microversion: 2.32 time: 0.742117 Oct 19 01:11:20.229054 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2490/4865] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:19 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 2325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:21.265459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:21.266170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:21.299117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:21.299657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:21.300102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:21.301224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:21.301687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:21.302125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:21.672244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:21.684596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:21.715155 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:21.721999 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c59ca56-dd2a-49cd-9b6d-17f004e80c39 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.462007 Oct 19 01:11:21.741448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2376/4866] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:21 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:21.751897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-deleted", "tag": "efb6bc64-e058-4f7e-bee3-a9a36db12eb4"}, {"server_uuid": "e0b7a587-8537-4ae7-86bb-4170fc802c90", "name": "network-vif-deleted", "tag": "99e14050-3458-4a6f-941f-fd4d097c5722"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:21.774560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:21.779115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:21.779669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:21.832122 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Creating event network-vif-deleted:efb6bc64-e058-4f7e-bee3-a9a36db12eb4 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:21.841536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] Creating event network-vif-deleted:99e14050-3458-4a6f-941f-fd4d097c5722 for instance e0b7a587-8537-4ae7-86bb-4170fc802c90 on n-h2-master-1 Oct 19 01:11:21.861839 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-549b54b4-f972-4a9a-8153-99ecc675c627 req-f68ed873-f47f-482f-a2fb-cbe9b893287b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114010 Oct 19 01:11:21.862531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2491/4867] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:21.927745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58bd299b-5d98-44c5-adc0-4cafe79b034e tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2aefe3a940>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:22.087334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58bd299b-5d98-44c5-adc0-4cafe79b034e tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/eb09b1b3-b877-4c0b-81ec-61aef4a6103d" status: 200 len: 350 microversion: 2.1 time: 0.164791 Oct 19 01:11:22.100535 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2377/4868] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:11:21 2022] GET /compute/v2.1/os-volumes/eb09b1b3-b877-4c0b-81ec-61aef4a6103d => generated 350 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:22.761351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:22.762409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:22.791580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:22.796006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:22.796787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:22.797964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:22.800369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:22.801296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:23.113878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:23.137006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:23.141619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:23.150088 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73f2d835-5412-485b-b991-ac402d00309b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.395960 Oct 19 01:11:23.217957 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2492/4869] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:22 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:23.908612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:23.909949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:23.927103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:23.929106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:23.931135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:23.932187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:23.935300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:23.937433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:24.211293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:24.211927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:24.248602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:24.249231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:24.249688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:24.250443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:24.250901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:24.251329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:24.335638 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2da0ad24-0768-4026-9af1-5c2b90ab879c tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1831 microversion: 2.1 time: 0.431056 Oct 19 01:11:24.340744 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2378/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:23 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1831 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:24.364652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:24.372922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:24.408682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:24.412409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:24.415947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:24.420270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:24.423674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:24.427059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:24.444281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:24.468886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:24.473192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:24.481643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6286d464-2cad-44d6-91aa-94ad62380757 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.269870 Oct 19 01:11:24.482983 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2493/4871] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:24 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:25.160512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:25.165879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bdb2f266-d27d-450f-ab5d-8fde241e5ea8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1680 microversion: 2.1 time: 0.805154 Oct 19 01:11:25.166674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2379/4872] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:24 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1680 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:11:25.513019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:25.513649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:25.532276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:25.534009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:25.534666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:25.535816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:25.538467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:25.539144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:25.740152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:25.749969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:25.751448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:25.769607 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-851ffa90-9bac-4c37-8229-ec079e9ff7a3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.244112 Oct 19 01:11:25.770350 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2380/4873] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:25 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:25.914827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:25.920061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:25.941127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:25.941621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:25.947065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:25.948121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:25.961057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:25.961962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:26.086464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f57c368-ddce-46d8-9e3f-3c660bbd08e4 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2aefd8bc10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:26.113060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f674c3f-8908-4a0a-9db9-43208484f5f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action" status: 200 len: 32640 microversion: 2.1 time: 0.689446 Oct 19 01:11:26.115651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2494/4874] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:11:25 2022] POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action => generated 32640 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:11:26.261445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f57c368-ddce-46d8-9e3f-3c660bbd08e4 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ac163e5e-9162-4763-ac09-a949924db3e6" status: 200 len: 351 microversion: 2.1 time: 0.153214 Oct 19 01:11:26.261445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2381/4875] 10.222.0.27 () {58 vars in 1245 bytes} [Wed Oct 19 01:11:26 2022] GET /compute/v2.1/os-volumes/ac163e5e-9162-4763-ac09-a949924db3e6 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:26.281722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5ddf6301-2fda-427c-921b-07beb572fa1d tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af4348700>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:26.288130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:26.289993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:26.320536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:26.326086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:26.327410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:26.333633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:26.335481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:26.336454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:26.575328 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5ddf6301-2fda-427c-921b-07beb572fa1d tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.303146 Oct 19 01:11:26.576584 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2495/4876] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 01:11:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:26.593438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb9013e7-8910-4f64-bda5-4aaa590deffd tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af4770940>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:26.707105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0e9884a2aa304ed6b241e20dcbc852ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c8fc0312ad4431da003046209628ef5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:26.708321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] flavor_id is None. Assuming migration. {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 19 01:11:26.709089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:11:26.912357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb9013e7-8910-4f64-bda5-4aaa590deffd tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.324764 Oct 19 01:11:26.912984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2496/4877] 10.222.0.27 () {58 vars in 1149 bytes} [Wed Oct 19 01:11:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:26.931887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:26.933624 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:26.988472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:26.991424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:26.991904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:26.998215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:26.999178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:27.002471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:27.328062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:27.357876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:27.361204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:27.367665 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21622959-d1a3-49e2-873d-0a4387a4b3b2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.450465 Oct 19 01:11:27.369178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2497/4878] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:26 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:27.381012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6533fe87-9f8f-4829-bf6c-16dca0bbb993 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af428c3a0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:27.401243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d953ad97-3344-4cb7-87a2-9c44ed27e6cc tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action" status: 202 len: 0 microversion: 2.1 time: 1.114478 Oct 19 01:11:27.407282 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2382/4879] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:11:26 2022] POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:11:27.431673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:27.441276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:27.489214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:27.490742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:27.499414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:27.502887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:27.504493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:27.507961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:27.648461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6533fe87-9f8f-4829-bf6c-16dca0bbb993 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.277601 Oct 19 01:11:27.657728 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2498/4880] 10.222.0.27 () {58 vars in 1134 bytes} [Wed Oct 19 01:11:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:27.665047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c24f69e-7709-45cf-b8be-c75ae5c52758 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af440bb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:27.905696 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c24f69e-7709-45cf-b8be-c75ae5c52758 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.246400 Oct 19 01:11:27.906732 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2499/4881] 10.222.0.27 () {58 vars in 1167 bytes} [Wed Oct 19 01:11:27 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:27.923968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e9adb20-84a5-4ce2-8fa9-d3d632a1501e tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2aefca81f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:27.989010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:27.996605 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:28.015507 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a776e413-9486-4bfb-b0e0-799cbad53926 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1689 microversion: 2.1 time: 0.605701 Oct 19 01:11:28.036916 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2383/4882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:27 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1689 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:28.211510 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e9adb20-84a5-4ce2-8fa9-d3d632a1501e tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.293431 Oct 19 01:11:28.213068 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2500/4883] 10.222.0.27 () {58 vars in 1170 bytes} [Wed Oct 19 01:11:27 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:28.231177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc8e34e6-bbf5-4474-b528-07bd6b0a6a7b tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2aefe01280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:28.401411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:28.402218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:28.431160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:28.432935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:28.433602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:28.439685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:28.441170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:28.441820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:28.660421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:28.671347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:28.675856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:28.681972 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-75e8acff-ba43-40ee-a7fd-a8c93d5deaf5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.281502 Oct 19 01:11:28.685768 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2501/4884] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:28 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:28.738673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc8e34e6-bbf5-4474-b528-07bd6b0a6a7b tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.513551 Oct 19 01:11:28.748062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2384/4885] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 01:11:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:28.756677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-96331cac-8633-479a-abcc-ac2a869c94cf tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af440b430>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:29.045269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:29.046167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:29.057810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:29.058505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:29.058966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:29.059741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:29.060214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:29.061956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:29.090588 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-96331cac-8633-479a-abcc-ac2a869c94cf tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.340889 Oct 19 01:11:29.092396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2502/4886] 10.222.0.27 () {58 vars in 1188 bytes} [Wed Oct 19 01:11:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:29.108945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e79f1846-2f1f-474d-8aca-fac27450ca25 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] Calling method '.version_select at 0x7f2af6b4e310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:29.377569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e79f1846-2f1f-474d-8aca-fac27450ca25 tempest-VolumesTestJSON-197626858 tempest-VolumesTestJSON-197626858-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.273600 Oct 19 01:11:29.378466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2503/4887] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 01:11:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:29.573293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:29.581890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7f566a9-0cb1-40d2-bb82-4c7adfd555a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1689 microversion: 2.1 time: 0.541076 Oct 19 01:11:29.582489 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2385/4888] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:29 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1689 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:29.718738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:29.721831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:29.762148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:29.768579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:29.769365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:29.771917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:29.774188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:29.778077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:30.074751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:30.129600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:30.139280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:30.148440 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7a998fb-a784-4e80-a3ff-0b9845bd9962 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.440223 Oct 19 01:11:30.151458 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2504/4889] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:29 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:30.620674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:30.623120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:30.648499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:30.649680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:30.650440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:30.653347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:30.657456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:30.658192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:31.180880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:31.183008 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:31.191089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:31.192021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:31.195459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:31.196725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:31.200911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:31.201629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:31.429246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:31.455995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:31.463189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:31.464820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c56eb548-86fb-4416-a46d-47f9d2318f56 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.288486 Oct 19 01:11:31.471997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2505/4890] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:31 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:31.597336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:31.607015 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f49f3c8-cb9e-438b-917b-db43bd6a002e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1689 microversion: 2.1 time: 0.999978 Oct 19 01:11:31.607544 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2386/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:30 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1689 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:32.501829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:32.503170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:32.515821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:32.529671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:32.537303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:32.538092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:32.538570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:32.539005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:32.634636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:32.636076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:32.649656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:32.656326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:32.659587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:32.681489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:32.682275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:32.682900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:33.110414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:33.123169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:33.133997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:33.140950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-169f0114-4234-45df-8ccf-5cdcdaa125a0 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.643020 Oct 19 01:11:33.175602 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2506/4892] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:32 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:33.455423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:33.474434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54314d3d-cf9c-4104-9d4f-a4d7bedf563a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1689 microversion: 2.1 time: 0.840850 Oct 19 01:11:33.481256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2387/4893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:32 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1689 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:34.189140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:34.189758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:34.214958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:34.215548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:34.216005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:34.216792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:34.217263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:34.217693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:34.296559 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=94 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:34.384659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:34.396282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:34.405775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:34.413924 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52a73fe9-3527-461c-bc4a-3e1e1b49c8d6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.228743 Oct 19 01:11:34.421430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2507/4894] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:34 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:34.506990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:34.508200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:34.521977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:34.522759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:34.523440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:34.526530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:34.527244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:34.527897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:34.935754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:34.948182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b6235526-ebdc-4aab-838d-5ef047a6f958 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.445001 Oct 19 01:11:34.955747 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2388/4895] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:34 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:35.451378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:35.451993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:35.462225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:35.469389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:35.473312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:35.474321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:35.474955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:35.475540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:35.633944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:35.654468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:35.657442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:35.666176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-975ec49e-4df5-4b1d-8090-54a9585e89a2 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.218716 Oct 19 01:11:35.685002 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2508/4896] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:35 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:35.984253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:35.985525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:35.994685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:36.000260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:36.001454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:36.002429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:36.003088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:36.008954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:36.415815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:36.458741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-00e197fb-f1bd-49e7-8272-cb674f1d567f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.444984 Oct 19 01:11:36.458741 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2389/4897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:35 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:36.703795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:36.705145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:36.722534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:36.723028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:36.723464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:36.724178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:36.724645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:36.735568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:36.875191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:36.891702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:36.892920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:36.894151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8884aae-ed66-4576-aee3-d173479e0e48 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.195281 Oct 19 01:11:36.910523 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2509/4898] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:36 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:37.487189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:37.488749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:37.505938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:37.509253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:37.510599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:37.513258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:37.514669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:37.517114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:37.922782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:37.924117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:37.950771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:37.951912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:37.954584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:37.958457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:37.971551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:37.972437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:38.016268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:38.033503 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fdd0df5d-7ac8-4da9-9d21-285c91520a64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.552605 Oct 19 01:11:38.035072 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2390/4899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:37 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:38.218252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:38.251788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:38.262062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:38.264355 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-168c6d1c-c17f-4de2-9149-1460fe6ca882 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.345113 Oct 19 01:11:38.265027 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2510/4900] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:37 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:39.061207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:39.061588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:39.077091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.077948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.078584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:39.079465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.082557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.083173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:39.293010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:39.293646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:39.303495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.308529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.309420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:39.313397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.327188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.327927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:39.720607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:39.738525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:39.743784 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:39.747754 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad5b0aba-abde-4ba7-aba7-87b409dd562f tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.458143 Oct 19 01:11:39.750236 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2511/4901] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:39 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:39.764144 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:39.765209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:39.783947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.784475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.786849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:39.788407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:39.790880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:39.792144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.058954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:40.073418 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b17293c4-b955-4fd6-ba0e-d1a4a5a11d64 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 1.016470 Oct 19 01:11:40.088893 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2391/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:39 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:40.104213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:40.116119 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b95ad04d-cdc0-45df-85e8-87053897fed7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.361074 Oct 19 01:11:40.117502 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2512/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:39 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:40.142006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1248006113"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:40.144409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:40.152165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.152686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.153141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.153879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.154348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.154787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.581055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f2625a4-2827-4fdc-b510-57ca156b9eb1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.442634 Oct 19 01:11:40.591058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:40.592417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:40.600293 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2392/4904] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:11:40 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 19 01:11:40.607040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.607852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.609291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.610549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.611295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.611988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.781099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:40.781829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:40.798486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.799072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.800984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.801766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:40.803200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:40.803383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:40.936438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:40.949801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:40.955802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:40.957863 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2abaf14-35c7-41e9-8e2a-e826cd765c57 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.183030 Oct 19 01:11:40.958615 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2393/4905] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:40 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:41.016902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:41.028334 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0468859-b3e3-4ca7-9c6e-bc386994ae8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.441344 Oct 19 01:11:41.030042 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2513/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:40 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:41.105090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:41.105751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:41.122630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:41.123136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:41.123584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:41.127377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:41.127822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:41.128275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:41.516223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:41.527868 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f38a886-e23e-42c1-af01-f29d4fa446ae tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.428744 Oct 19 01:11:41.551754 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2394/4907] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:41 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:41.987663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:41.988923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:42.012207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.014093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.014946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.018390 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.019081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.020938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.072420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:42.073104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:42.105990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.117592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.122568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.125980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.128986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.131180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.367754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:42.382944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:42.384450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:42.385723 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ea96fdd-2051-4dd2-a127-26dd56725fcd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.402213 Oct 19 01:11:42.386304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2514/4908] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:41 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:42.560051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:42.560701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:42.570813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.571310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.571752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.572533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:42.573021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:42.573452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:42.589535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:42.600241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6b4a483-6bc0-4f0d-82df-efa53a223f4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.540979 Oct 19 01:11:42.604721 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2395/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:42 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:11:42.923517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:42.940025 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc2b9956-8465-4421-aedc-83b4c965d90b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.384510 Oct 19 01:11:42.943335 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2515/4910] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:42 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:43.415254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:43.417212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:43.433258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.435456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.436097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:43.437635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.440753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.442153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:43.543372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:43.567120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:43.571029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:43.579111 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da34e6cb-b885-43c3-9dd8-0dda5485581e tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.169416 Oct 19 01:11:43.579908 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2396/4911] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:43 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:43.633674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:43.635803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:43.650161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.653260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.656204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:43.657139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.663041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.663665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:43.952204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:43.960849 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-834383b7-e086-4b2b-a314-adef5c9d509a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1687 microversion: 2.1 time: 0.330864 Oct 19 01:11:43.964885 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2516/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:43 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1687 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:43.973819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:43.974693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:43.983463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.984199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.984883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:43.985917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:43.986807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:43.987476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:44.408663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:44.422858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-unplugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:44.428374 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-75087e26-0693-4b64-8089-20f934add0a0 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.459667 Oct 19 01:11:44.431391 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2397/4913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:43 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:44.446366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:44.449217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:44.449829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:44.477871 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] Creating event network-vif-unplugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:11:44.490846 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-11bbb1cc-ad3e-42aa-a69d-c1deaf7f8f23 req-27b96147-c6a5-4582-949b-d292633cae1a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071690 Oct 19 01:11:44.497135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2517/4914] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:44.613835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:44.614464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:44.625802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:44.632892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:44.633746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:44.635297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:44.635973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:44.636691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:44.766031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:44.776916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:44.787758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:44.789403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16784b4a-1dfc-4975-9fc0-076b013ad323 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.179769 Oct 19 01:11:44.790222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2398/4915] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:44 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:44.987623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:44.988435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:45.002717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.003382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.003944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:45.004843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.006124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.009826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:45.316576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:45.328558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ea8de4a4-4cc7-41da-89ea-30cd93a42514 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1687 microversion: 2.1 time: 0.346881 Oct 19 01:11:45.354899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2518/4916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:44 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1687 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:45.459475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:45.462906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:45.474283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.476139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.476769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:45.477763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.478310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.478824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:45.819794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:45.820815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:45.833822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.834577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.841886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:45.842944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:45.843613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:45.844358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:46.075852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:46.094532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:46.113830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:46.116478 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11a3ebf1-00c4-415d-97b1-e3d34227cf15 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.300993 Oct 19 01:11:46.122721 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2519/4917] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:45 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:46.188410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:46.209890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-27cd9dbd-3f77-4efc-a419-d5d8e7bb27e9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1694 microversion: 2.1 time: 0.756318 Oct 19 01:11:46.210501 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2399/4918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:45 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1694 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:46.363301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:46.364372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:46.380382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:46.387765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:46.390921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:46.393697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:46.401730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:46.402767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:46.965000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-plugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:47.011841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:47.012328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:47.028699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:47.044143 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:47.081966 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] Creating event network-vif-plugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:11:47.115820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a3008488-c2c6-4f28-a2f9-618edde0d899 req-83046ce3-9818-4932-85d6-defc92f3b3e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153790 Oct 19 01:11:47.118581 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2400/4919] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:47.154805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:47.155663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:47.189169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:47.190019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:47.193992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:47.194362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:47.200165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:47.200903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:47.202548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:47.223654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b74c67a-8084-43cf-afce-8477b1ffc361 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.865322 Oct 19 01:11:47.228645 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2520/4920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:46 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:47.256470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:47.265609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:47.281063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:47.295142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:47.302068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:47.302842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:47.303315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:47.303749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:47.625165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:47.640997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:47.642480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:47.643721 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-990c60ef-6dfd-4c74-bab5-449cc3709b08 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.494338 Oct 19 01:11:47.649142 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2401/4921] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:47 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:48.258921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:48.260908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:48.269157 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=52 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:48.286157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:48.298192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:48.300181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b68a3c9-d768-4e79-b16f-3932d00acc32 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1693 microversion: 2.1 time: 1.066665 Oct 19 01:11:48.301125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:48.301327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:48.303036 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2521/4922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:47 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1693 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:48.305642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:48.309159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:48.314231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:48.421834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-unplugged", "status": "completed", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:48.466904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:48.471547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:48.477310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:48.526655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Creating event network-vif-unplugged:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h2-master-1 Oct 19 01:11:48.535457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:11:48.574594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-df191486-0e50-4e92-8006-c82867722161 req-04cf49d1-07f4-4c2a-b98d-245cfc2bc14a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156652 Oct 19 01:11:48.579041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2522/4923] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:11:48.683617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:48.685027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:48.706136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:48.708459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:48.710903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:48.714044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:48.717092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:48.719051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:48.970331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:49.011965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:49.030464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:49.031931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb885c01-efc1-4305-9e89-ec04d529d205 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.357672 Oct 19 01:11:49.036088 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2523/4924] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:48 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:49.047080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:49.063887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a9cae38-b141-453a-81ee-41da28e4e67a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.812759 Oct 19 01:11:49.064326 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2402/4925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:48 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:49.330413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:49.331261 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:49.351563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:49.353609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:49.356862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:49.359992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:49.362237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:49.366316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:49.748377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:49.752351 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:49.771146 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-71edcdd4-e35a-4e96-812a-38d3348cc4af tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1693 microversion: 2.1 time: 0.445124 Oct 19 01:11:49.774330 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2524/4926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:49 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1693 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:50.065706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:50.068490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:50.089458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.090582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:50.091219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:50.093389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.098224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.102738 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=56 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:11:50.105023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.105754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.107734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.115226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.121814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.122418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.123215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.123697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.133759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.582281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:50.600725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:50.606850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:50.609443 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-252bd0ff-6834-4401-b71b-ac7ec4d96da5 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.553035 Oct 19 01:11:50.625153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2403/4927] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:50 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:50.636285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:50.686980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.687810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.688477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.701893 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Creating event network-changed:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h2-master-1 Oct 19 01:11:50.709501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:11:50.726722 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9eafd62c-206a-4194-b858-8ec9f098b9d0 req-60d6ef15-8969-47bf-9525-7ffd7be0d4ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093271 Oct 19 01:11:50.728398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2404/4928] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:11:50.803029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:50.803750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:50.817698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.821117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.823101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:50.824040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:50.825476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:50.830916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:51.813266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:51.829096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bda65d22-ec0e-4b2c-95ec-cc50e1197ba0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 1.740947 Oct 19 01:11:51.832409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2525/4929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:50 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:11:51.846084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:51.851462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:51.865811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:51.870083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:51.871519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:51.873196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:51.877037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:51.877796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:52.562359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:52.573403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:52.574867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:52.576107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc200c53-a2ea-4b90-b0c6-afbf6c601e52 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.742248 Oct 19 01:11:52.598508 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2526/4930] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:51 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:52.671275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:52.685933 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-940dcae4-5be1-4d40-9170-b623eea991fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1693 microversion: 2.1 time: 1.888430 Oct 19 01:11:52.690217 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2405/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:50 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1693 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:52.863240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:52.863240 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:52.871569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:52.872062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:52.872501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:52.886670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:52.889715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:52.890326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:53.582438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:53.601248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12943ed8-c6f2-4727-acfa-5a9800753073 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.744881 Oct 19 01:11:53.601248 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2527/4932] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:52 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:53.622487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:53.623563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:53.656366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:53.658899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:53.659587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:53.662955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:53.666118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:53.670972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:53.709379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:53.710297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:53.726638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:53.727421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:53.728197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:53.733386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:53.734129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:53.734905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:53.971067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:53.986299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:53.990602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:53.995556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46699625-342f-4e20-a114-2b5841e1d0d3 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.393048 Oct 19 01:11:53.997833 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2406/4933] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:53 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:54.402236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:54.412115 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9cbc6ff6-7819-4fe2-ab2b-fcc0662bb3fa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1691 microversion: 2.1 time: 0.706599 Oct 19 01:11:54.419258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2528/4934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:53 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1691 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:54.627190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:54.627864 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:54.646408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:54.650802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:54.654213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:54.658205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:54.665958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:54.667160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:55.027612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:55.028235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:55.048214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:55.048731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:55.049171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:55.049895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:55.050340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:55.050766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:55.772021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:55.787238 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:55.795302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:55.813154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1bf820d5-a0ca-44d9-b8ef-69aa42ba1b1c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.773910 Oct 19 01:11:55.813830 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2529/4935] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:55 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:55.828961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:55.832089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:55.864103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:55.868969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:55.875663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:55.878453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:55.889965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:55.891240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:55.908093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:55.922176 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4c9afdb-6b55-41d8-8773-79d9d63ac4f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 1.299797 Oct 19 01:11:55.924159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2407/4936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:54 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:56.488338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:56.504099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e17f520-0e41-4bb6-a0e2-344a96ee5a1f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1688 microversion: 2.1 time: 0.685592 Oct 19 01:11:56.505357 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2530/4937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:55 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1688 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:56.531861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:11:56.532517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:56.549105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:56.552721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:56.553664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:56.557469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:56.561065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:56.567817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:56.844462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:56.845118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:56.863500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:56.864246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:56.864584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:56.873831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:56.874328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:56.874775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:57.057961 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9111dfab-8994-4940-a346-be43444e526a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action" status: 202 len: 0 microversion: 2.1 time: 0.532060 Oct 19 01:11:57.066775 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2408/4938] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:11:56 2022] POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:11:57.066934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:57.095733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:57.098163 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:57.099435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:57.101514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:57.106056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85ef9395-bccd-44c5-88f3-67bc203895b6 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.263174 Oct 19 01:11:57.110563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2531/4939] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:56 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:11:57.117975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:57.120124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:57.161208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:57.163576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:57.164761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:57.167232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:57.167692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:57.167836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:57.168454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:57.168946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:57.169802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:57.170437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:57.172427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:57.176027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:57.756474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:57.771596 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd427dbb-a846-4a77-b394-2de9d043e792 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.658731 Oct 19 01:11:57.783799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2532/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:57 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:57.798751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:57.807472 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c39a795-8e4e-4d32-83af-deb8352d7840 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.739217 Oct 19 01:11:57.810120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2409/4941] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:57 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:58.141571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:58.142914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:58.154679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.156586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.157973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:58.159146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.162393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.163750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:58.403595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:58.431167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:58.432587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:58.433858 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de6ab97f-dc47-4841-9da3-59d89e0350bd tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.296554 Oct 19 01:11:58.434641 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2533/4942] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:58 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:11:58.799258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:58.799885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:58.813211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.816385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.817062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:58.818243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.820306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.822726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:58.838254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:58.839336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:58.873508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.873911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.874358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:58.875088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:58.875582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:58.876048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:59.634102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:59.647535 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-835c7185-6779-4403-bddb-c930396c8d19 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.814155 Oct 19 01:11:59.652486 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2534/4943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:58 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:59.673314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:11:59.678820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:11:59.706089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:59.720980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:59.721493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:59.721948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:59.722691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:11:59.725433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35ce1788-82d6-4c68-89c4-02cd537687a6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.920952 Oct 19 01:11:59.726094 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2410/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:11:58 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:11:59.732246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:11:59.735153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:11:59.922615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:59.970361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:59.975427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:11:59.985555 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9b95080-abea-4628-bb92-54108f5f177c tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.328199 Oct 19 01:11:59.987007 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2535/4945] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:11:59 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:12:00.675564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:00.676158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:00.690752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:00.691260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:00.692764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:00.696337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:00.711294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:00.723241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:00.754853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:00.756187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:00.780448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:00.785305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:00.786238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:00.793765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:00.797303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:00.798031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:01.575026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:01.584660 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dacc0331-9ca2-46a9-9e85-f82cb07f977d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.913184 Oct 19 01:12:01.587105 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2411/4946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:00 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:01.600219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-plugged", "status": "completed", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:01.627234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:01.630710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:01.631339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:01.668350 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:01.675468 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Creating event network-vif-plugged:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h2-master-1 Oct 19 01:12:01.679755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b6e8cf4-f4cd-4ab7-8eff-566498ba80d1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.930264 Oct 19 01:12:01.680422 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2536/4947] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:00 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:01.692154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:12:01.706861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:01.712377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:01.721139 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-bb026796-3e61-40ec-8ff5-ef2cd0eacdeb req-bab4886c-ab2e-4dfb-9f49-f67b2bdc9f06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130520 Oct 19 01:12:01.723962 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2412/4948] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:01.755756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:01.757994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:01.760093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:01.763176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:01.765034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:01.765688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:01.930892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:01.944756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:01.946613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:01.950735 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eda4c3da-eb8c-444e-be56-d1e1454be6ac tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1604 microversion: 2.32 time: 0.264873 Oct 19 01:12:01.951907 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2537/4949] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:12:01 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:12:02.627738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:02.629347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:02.647578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:02.648558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:02.650836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:02.651839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:02.654388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:02.656480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:02.709908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:02.710832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:02.732011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:02.737163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:02.737899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:02.738829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:02.744021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:02.744796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:03.727491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:03.739983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3f93270-d5a9-432b-af63-54acd9a0e4d2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 1.126180 Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2413/4950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:02 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:03.760437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:03.854435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:03.865917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34e0ec4a-1bef-4f59-82b4-1de5e8835fc4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 1.159831 Oct 19 01:12:03.881003 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2538/4951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:02 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:03.988163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:03.990820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:03.992267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:03.992831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lazy-loading 'fault' on Instance uuid e0b7a587-8537-4ae7-86bb-4170fc802c90 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:12:04.280327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:04.302353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:04.311349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ac399b59740442a93081bb1a78297b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39c10fa11e244a629264dd733478c21b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:04.313482 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-13e1c96d-858e-4cd2-9d2f-02b0ee367966 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 200 len: 1609 microversion: 2.32 time: 0.567411 Oct 19 01:12:04.315923 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2414/4952] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:12:03 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 1609 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:12:04.771840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:04.772893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:04.803125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:04.811637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:04.813695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:04.815836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:04.818786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:04.822141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:04.893129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:04.893762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:04.920561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:04.923298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:04.923771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:04.929121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:04.929643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:04.930103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:05.162229 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:12:05.162758 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:12:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e (ip 10.222.0.27) !!! Oct 19 01:12:05.403209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:05.411292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:05.416901 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:05.425401 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44ea92ec-8d37-4dbc-8bb7-58f482a7da87 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.535879 Oct 19 01:12:05.430591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2415/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:04 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:05.438335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:05.441929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:05.449495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:05.450181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:05.450909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:05.452119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:05.452817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:05.453657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:05.455594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31fcca16-ba86-48fb-9272-3fd5ab18db6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.664218 Oct 19 01:12:05.465846 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2539/4954] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:04 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:05.475801 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] HTTP exception thrown: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Request method failure captured: Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 HTTP/1.1 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT00TUSa4-Et8WNQihliTA8IOC7BjPXpju9V5FZrrabWp34wQ1dNuVQCgTv67alCrdcmEclI9dFZw7bwJvKbq1OHa1QJRMOzeM__CkuAFN_OsXiR_r2dVBQtZXSOwiXFKBRhvFdbsLxVvOeCKNdE6YSiWc2fcWf-qnZvhimXHPgQ7D54 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39c10fa11e244a629264dd733478c21b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}] Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5ac399b59740442a93081bb1a78297b4 Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e0b7a587-8537-4ae7-86bb-4170fc802c90'} Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:05.479792 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:05.485537 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:05.489140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Returning 404 to user: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:12:05.490435 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03e562eb-366f-49d3-bf5b-8af5a45ceedf tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 404 len: 111 microversion: 2.32 time: 0.062585 Oct 19 01:12:05.499202 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2416/4955] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:12:05 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:12:05.514052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73418790-bef0-4bf1-96fe-9abe362e362b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '.version_select at 0x7f2af4761820>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:05.578926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73418790-bef0-4bf1-96fe-9abe362e362b tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622542462" status: 204 len: 0 microversion: 2.32 time: 0.073707 Oct 19 01:12:05.581131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2540/4956] 10.222.0.27 () {60 vars in 1259 bytes} [Wed Oct 19 01:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622542462 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:12:06.456389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:06.456988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:06.468251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:06.469147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:06.470030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:06.471322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:06.472302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:06.472930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:06.495208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:06.495894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:06.518472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:06.521780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:06.522431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:06.541762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:06.547067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:06.547745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:08.451865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:08.470134 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58023f8e-47b4-4a98-84e4-8351e4468773 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 2.018035 Oct 19 01:12:08.479786 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2417/4957] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:06 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:08.510679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-unplugged", "status": "completed", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:08.582680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:08.585035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:08.586910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:08.618467 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Creating event network-vif-unplugged:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:12:08.637425 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:12:08.665848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-aa4e29a2-34f6-46dd-b4d6-b5a8488806ac req-e3cbc087-4d0f-4635-91ab-943ad82a1770 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.179076 Oct 19 01:12:08.669805 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2418/4958] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:08.688601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:08.730506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ace5eb21-de31-48ad-85dc-189886fb4f02 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 2.235986 Oct 19 01:12:08.731664 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2541/4959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:06 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:09.510964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:09.511713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:09.532436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:09.535148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:09.536688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:09.540113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:09.543935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:09.547213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:09.756132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:09.756961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:09.782300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:09.782873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:09.783476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:09.783999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:09.784472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:09.784940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:09.885216 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:10.192371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:10.202717 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5160aff2-920d-4fae-b586-c5079d558afc tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.698003 Oct 19 01:12:10.213783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2419/4960] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:09 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:11.050499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:11.059528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f848c1f-d44f-4545-a65c-787acdb623f7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 1.307207 Oct 19 01:12:11.071617 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2542/4961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:09 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:11.234881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:11.236230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:11.251905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:11.252710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:11.254489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:11.257372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:11.260258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:11.260903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:11.868279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:11.896958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:11.905311 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d97cb79-48e1-41ee-95d7-378563f0c2ea tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.664312 Oct 19 01:12:11.906004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2420/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:11 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:11.922422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:11.922924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:11.923633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:11.980337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Creating event network-changed:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:12:11.993847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:12:12.040605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c4259076-5bb8-4800-9e33-06e633a8b12b req-7ac1ab1b-ec0a-494c-9162-758d9cb0b3aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147800 Oct 19 01:12:12.042469 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2543/4963] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:12:12.096674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:12.097346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:12.114943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:12.116985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:12.118424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:12.132879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:12.134310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:12.135901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:12.898499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:12.919707 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbb6aee7-38d7-4c19-bc53-f4d21995bbe5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.829178 Oct 19 01:12:12.924818 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2421/4964] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:12 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:12.943156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:12.944671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:12.963556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:12.964527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:12.972408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:12.973981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:12.979802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:12.980683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:13.852983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:13.863133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83c2e659-3bfc-4eb3-828e-ccd78e3fc436 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.927248 Oct 19 01:12:13.868537 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2544/4965] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:12 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:13.957055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:13.957806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:13.976905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:13.977354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:13.982263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:13.983436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:13.984142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:13.985471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:14.754027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:14.793055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8b52182-2400-4150-be75-51c36dfd838f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.833487 Oct 19 01:12:14.801249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2422/4966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:13 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:14.893012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:14.893645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:14.928904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:14.929412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:14.938146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:14.939338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:14.951318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:14.957204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:15.583015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:15.592841 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21bd9cf2-8756-4897-a17b-5c0038ff86ac tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 0.704766 Oct 19 01:12:15.597089 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2545/4967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:14 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:15.829771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:15.830399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:15.859014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:15.864065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:15.864536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:15.865307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:15.877432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:15.882019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:16.543142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:16.554407 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-031c1582-e283-49a9-bb0e-a7d956447eae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.728502 Oct 19 01:12:16.561250 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2423/4968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:15 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:16.628521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:16.629243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:16.661252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:16.661773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:16.667347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:16.670738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:16.671238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:16.671684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:17.588287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:17.589298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:17.612289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:17.612825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:17.623670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:17.625617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:17.626127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:17.631306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:18.279561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:18.308430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8493253c-7de3-4ff7-a36f-56c7b5a2c173 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1687 microversion: 2.1 time: 1.687931 Oct 19 01:12:18.309125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2546/4969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:16 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1687 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:18.771788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:18.784348 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7834fe8d-83d3-414a-99bc-4e84b9dd556e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 1.202609 Oct 19 01:12:18.787785 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2424/4970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:17 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:19.348081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:19.349714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:19.369618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:19.371094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:19.371968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:19.378442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:19.379127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:19.380241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:19.811509 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:19.812139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:19.825140 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=52 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:19.837995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:19.844543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:19.846994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:19.848389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:19.852307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:19.856212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:19.859116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:19.909341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32bcd761-8273-4dea-9aad-5fe8116833ef tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1680 microversion: 2.1 time: 0.529390 Oct 19 01:12:19.914382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2547/4971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:19 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1680 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:20.561542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:20.582109 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e5aecb80-550f-41ab-90ca-7a531617fea7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1682 microversion: 2.1 time: 0.774648 Oct 19 01:12:20.605002 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2425/4972] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:19 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1682 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:12:21.608507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:21.609917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:21.618577 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:21.622334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:21.623016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:21.625904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:21.626839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:21.628943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:21.629858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:22.075701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:22.076265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:22.099783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:22.100317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:22.109666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:22.110570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:22.114800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:22.116021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:22.171540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] HTTP exception thrown: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Request method failure captured: Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 HTTP/1.1 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT00TUSa4-Et8WNQihliTA8IOC7BjPXpju9V5FZrrabWp34wQ1dNuVQCgTv67alCrdcmEclI9dFZw7bwJvKbq1OHa1QJRMOzeM__CkuAFN_OsXiR_r2dVBQtZXSOwiXFKBRhvFdbsLxVvOeCKNdE6YSiWc2fcWf-qnZvhimXHPgQ7D54 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39c10fa11e244a629264dd733478c21b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}] Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5ac399b59740442a93081bb1a78297b4 Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e0b7a587-8537-4ae7-86bb-4170fc802c90'} Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:12:22.175581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.180900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.184040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Returning 404 to user: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:12:22.184704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7041c842-8925-48b1-9d28-1763b24414db tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 404 len: 111 microversion: 2.32 time: 0.113066 Oct 19 01:12:22.195030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2426/4973] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:12:22 2022] DELETE /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:12:22.207922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:22.208551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] [instance: e0b7a587-8537-4ae7-86bb-4170fc802c90] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:22.230220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:22.232085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:22.232689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:22.235381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:22.235966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:22.241708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:22.275074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] HTTP exception thrown: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Request method failure captured: Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 HTTP/1.1 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT00TUSa4-Et8WNQihliTA8IOC7BjPXpju9V5FZrrabWp34wQ1dNuVQCgTv67alCrdcmEclI9dFZw7bwJvKbq1OHa1QJRMOzeM__CkuAFN_OsXiR_r2dVBQtZXSOwiXFKBRhvFdbsLxVvOeCKNdE6YSiWc2fcWf-qnZvhimXHPgQ7D54 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.32 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39c10fa11e244a629264dd733478c21b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39c10fa11e244a629264dd733478c21b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39c10fa11e244a629264dd733478c21b"}]}] Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 39c10fa11e244a629264dd733478c21b Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1005061752 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 5ac399b59740442a93081bb1a78297b4 Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TaggedBootDevicesTest-1005061752-project Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e0b7a587-8537-4ae7-86bb-4170fc802c90'} Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.280157 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:12:22.285496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] Returning 404 to user: Instance e0b7a587-8537-4ae7-86bb-4170fc802c90 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:12:22.288731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c912d7fc-51dc-4e39-81ea-98b72b6e0784 tempest-TaggedBootDevicesTest-1005061752 tempest-TaggedBootDevicesTest-1005061752-project] 10.222.0.27 "GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90" status: 404 len: 111 microversion: 2.32 time: 0.092280 Oct 19 01:12:22.289478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2427/4974] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:12:22 2022] GET /compute/v2.1/servers/e0b7a587-8537-4ae7-86bb-4170fc802c90 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:12:23.481974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:23.501968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd6d289d-4b4b-4e95-9fc4-6986d995f51d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.891076 Oct 19 01:12:23.503395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2548/4975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:23.760271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:23.760908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:23.768550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:23.769100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:23.769540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:23.770257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:23.770715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:23.771143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:23.834098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-plugged", "status": "completed", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:23.864324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:23.864831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:23.865260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:23.895314 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] Creating event network-vif-plugged:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:12:23.907493 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-134a4d4b-ecb7-4b3b-afba-f6c0acb31d15 req-75738f57-43b5-4352-883d-a6a11a7e90cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076233 Oct 19 01:12:23.909078 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2549/4976] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:12:24.069302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:24.081556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a1f7933-0681-4202-9310-193ea2aad79e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.325154 Oct 19 01:12:24.084372 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2428/4977] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:23 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:25.965481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-unplugged", "status": "completed", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:25.978887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:25.979580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:25.980442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:25.994605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] Creating event network-vif-unplugged:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:12:26.009100 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-26e0c32f-57c4-45a7-b3ec-f49f8b56d732 req-bf998e6b-be2d-473a-a00e-c218382821ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052895 Oct 19 01:12:26.010524 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2550/4978] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:27.105918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:27.106618 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:27.114276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.114797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.115419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:27.116554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.118124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.118622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:27.322697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:27.333269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0ddb3c7-d7c0-4adb-8f6d-0699a594e14a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.232872 Oct 19 01:12:27.334412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2429/4979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:27.362259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:27.363088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:27.372566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.376571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.377206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:27.378082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.379735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.389978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:27.661193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:27.673679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09262cdf-220c-4326-9760-c87899f51b6f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.316787 Oct 19 01:12:27.674272 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2551/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:27.735032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:27.735743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:27.755560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.755984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.756429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:27.764306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:27.765107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:27.767158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:28.031590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:28.042334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64d14df0-54e0-4a57-a0a3-cff90986d93b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.327708 Oct 19 01:12:28.054111 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2430/4981] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:28.070478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:28.074402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:28.099733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:28.103498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:28.105772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:28.106986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:28.110771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:28.111469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:28.337157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95a83416-8571-4790-9a2b-76062c1c1b6e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.249040 Oct 19 01:12:28.341250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2552/4982] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:12:28 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:12:28.354880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:28.355688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:28.372450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:28.383947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:28.388248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:28.390341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:28.396132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:28.397445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:29.011856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:29.028437 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b61cdbd-75fd-498a-922d-a2bb556c10c7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1671 microversion: 2.1 time: 0.680076 Oct 19 01:12:29.029393 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2431/4983] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:28 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1671 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:30.054845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:30.055769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:30.081856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:30.082471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:30.082926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:30.083672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:30.084131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:30.084563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:30.484222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:30.506428 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b30db9f-4920-47b2-91ad-0f2db2b6b25f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1676 microversion: 2.1 time: 0.452688 Oct 19 01:12:30.525040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2553/4984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:30 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1676 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:31.549828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:31.552192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:31.579777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:31.582563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:31.583100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:31.584108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:31.585955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:31.588278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:31.918289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:31.934504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0a2b565-6c17-46ab-a91c-75306ca763ef tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.386092 Oct 19 01:12:31.936786 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2432/4985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:31 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:31.965114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:31.967845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:31.985240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:31.986881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:31.988476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:31.989790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:31.993293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:31.993995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:32.106141 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc8e8708-10f9-4606-9f70-a53b59a9929a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 200 len: 322 microversion: 2.1 time: 0.146849 Oct 19 01:12:32.107105 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2554/4986] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:12:31 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:32.117767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:32.121822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:32.134473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:32.136837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:32.137611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:32.151011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:32.157124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:32.157693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:32.441094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:32.454785 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-908da8c1-742e-49fd-900c-2568decaab62 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.340400 Oct 19 01:12:32.457001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2433/4987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:32 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:32.505337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:32.506566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:32.543604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:32.548811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:32.549277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:32.550042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:32.550511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:32.550949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:33.220919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:33.234667 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bfb263b-482a-486e-98ae-ef0d19b57cd5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.744565 Oct 19 01:12:33.237152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2555/4988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:32 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:33.263980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:33.265335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:33.276657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:33.277449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:33.278118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:33.279067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:33.279693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:33.280601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:33.717097 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:33.724832 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:33.737943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1558bca3-07a3-4c42-b9ed-1c32f56efa5e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.477348 Oct 19 01:12:33.740396 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2434/4989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:33 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:33.765953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:33.766575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:33.779365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:33.779789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:33.780239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:33.783304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:33.783811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:33.784260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:34.191585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:34.201623 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4212f768-190b-4513-a4c4-075d94ee0775 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.439986 Oct 19 01:12:34.260696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2556/4990] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:33 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:34.546756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-501723551", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "69976232-9b57-4354-be5a-f2d785e4a03d"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:34.676392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] validate_networks() for [('69976232-9b57-4354-be5a-f2d785e4a03d', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:12:35.861268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:12:35.861854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:12:35.862184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:12:35.862593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:12:35.863194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:12:35.880972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:35.881719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:35.883790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:35.889335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:35.890104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:35.890827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:35.932803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:12:35.945381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:12:35.978531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:12:35.986334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:12:36.157990 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7ef677d2-0264-4317-984f-51d217a76992 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619109 Oct 19 01:12:36.160162 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2435/4991] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:12:36.172647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb91a2db-67bd-4f0c-a326-43075bc03bf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:36.174025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb91a2db-67bd-4f0c-a326-43075bc03bf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:36.463582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb91a2db-67bd-4f0c-a326-43075bc03bf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:36.481899 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb91a2db-67bd-4f0c-a326-43075bc03bf3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1214 microversion: 2.1 time: 0.311290 Oct 19 01:12:36.484652 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2557/4992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:36 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1214 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:37.512930 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:12:37.513487 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:12:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec (ip 10.222.0.27) !!! Oct 19 01:12:37.523950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:37.531935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:37.560725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:37.561719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:37.562340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:37.564188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:37.565881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:37.568307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:37.831446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:37.846129 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0c4fd52f-2b99-460c-a5e9-c87b42a16a27 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1266 microversion: 2.1 time: 0.336195 Oct 19 01:12:37.848283 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2436/4993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:37 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:38.873116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:38.873884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:38.900146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:38.900683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:38.901151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:38.901885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:38.902352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:38.902791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:39.480862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:39.499097 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f6b3684-5fde-4d38-a25f-adb85ca23a9e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1272 microversion: 2.1 time: 0.627103 Oct 19 01:12:39.506765 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2558/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:38 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1272 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:40.534928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:40.536228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:40.558490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:40.563208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:40.564370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:40.569025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:40.572424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:40.574568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:41.398557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:41.409045 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-517c837f-2caa-4b20-9b49-8fed22840206 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.879761 Oct 19 01:12:41.411546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2437/4995] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:40 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:42.437626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:42.439347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:42.484162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:42.486059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:42.486820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:42.494939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:42.498762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:42.499613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:42.550647 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:42.997136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0621388c-6cae-479f-baf4-ff0527d733ec", "tag": "7af61c54-4dc5-4c48-a17f-fcede1e5718f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:43.031369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:43.034845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:43.036318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:43.083122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] Creating event network-changed:7af61c54-4dc5-4c48-a17f-fcede1e5718f for instance 0621388c-6cae-479f-baf4-ff0527d733ec on n-h2-master-1 Oct 19 01:12:43.107209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2103ecce-c21e-415b-a440-e269cf2f5d99 req-3a3e9948-58df-4125-8cc6-4eec65a9f20c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114746 Oct 19 01:12:43.113933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2438/4996] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:43.621831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:43.634686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0abcfced-f944-4dad-bb22-e610cff281c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 1.202926 Oct 19 01:12:43.637944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2559/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:42 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:44.564165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:44.566949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:44.592327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:44.592874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:44.593324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:44.594046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:44.594511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:44.605457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:44.662540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:44.663757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:44.684754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:44.687243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:44.687873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:44.688802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:44.691646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:44.694091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:44.767083 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4a09f8cd-b00b-4480-9c6c-bbc2a90e1465 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action" status: 200 len: 63118 microversion: 2.1 time: 0.207035 Oct 19 01:12:44.775352 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2439/4998] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:12:44 2022] POST /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793/action => generated 63118 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:12:45.182942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:45.194587 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-028bb44a-6ec8-4799-a57b-fc4dbc52bb26 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.536372 Oct 19 01:12:45.197307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2560/4999] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:44 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:12:46.230201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:46.232079 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:46.236778 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:46.237986 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:46.258775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:46.261527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:46.263132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:46.265538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:46.266305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:46.266992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:46.774541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:46.783212 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7ebd5fbd-6d9f-4670-b2de-b7342c7d6c96 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.560132 Oct 19 01:12:46.810107 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2440/5000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:46 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:47.805581 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:47.809834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:47.810456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:47.833627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:47.834166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:47.835006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:47.835373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:47.835833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:47.836270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:48.622462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:48.636998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cfe34f0f-27be-4213-8173-60cf428c4a32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.833331 Oct 19 01:12:48.642449 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2561/5001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:47 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:49.670890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:49.671525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:49.689179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:49.695354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:49.697224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:49.704818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:49.710091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:49.710781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:50.136753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:50.148375 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12c264c8-c9e4-4243-b576-5d53f90acc12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.480196 Oct 19 01:12:50.150060 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2441/5002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:49 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:51.175924 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:51.177248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:51.180713 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:51.199313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:51.200115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:51.200808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:51.201707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:51.202796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:51.205109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:51.570046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:51.570945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:51.580326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:51.580854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:51.581288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:51.582181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:51.582721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:51.602553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:51.832531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:51.843454 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d4a900a-c9a8-43d0-a303-b1bee649e6f0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.671920 Oct 19 01:12:51.852568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2442/5003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:51 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:51.864740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621388c-6cae-479f-baf4-ff0527d733ec", "name": "network-vif-plugged", "status": "completed", "tag": "7af61c54-4dc5-4c48-a17f-fcede1e5718f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:51.899179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:51.900270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:51.906352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:51.944639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] Creating event network-vif-plugged:7af61c54-4dc5-4c48-a17f-fcede1e5718f for instance 0621388c-6cae-479f-baf4-ff0527d733ec on n-h2-master-1 Oct 19 01:12:51.963582 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-799b1a81-fe66-493f-9166-5d2d80c26ffa req-676aedd4-c319-4322-8406-ed495dfde9b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109241 Oct 19 01:12:51.965907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2443/5004] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:52.880239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:52.881016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:52.912522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:52.916213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:52.921709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:52.923054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:52.923143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:52.924577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:53.171268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a237fa4-c653-4bf3-9170-2544aeea3cfd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1831 microversion: 2.1 time: 2.190470 Oct 19 01:12:53.175806 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2562/5005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:50 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1831 bytes in 2196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:53.789903 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:53.805495 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b82356e4-29f9-4f9d-a6a2-9755229fc0a6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1314 microversion: 2.1 time: 0.932485 Oct 19 01:12:53.806491 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2444/5006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:52 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1314 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:12:54.836404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:54.837612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:54.867539 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=32 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:12:54.871067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:54.871928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:54.874061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:54.875260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:54.881285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:54.882556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:55.594964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:55.603412 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c51b275-e764-4cc6-b574-49d359deeab8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1501 microversion: 2.1 time: 0.773691 Oct 19 01:12:55.609734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2563/5007] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:54 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1501 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:55.636596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:55.661883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:55.665368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:55.667285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:55.748743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:12:55.848569 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-391a8718-a660-4fd4-a11e-f75a7439d1ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec/action" status: 202 len: 0 microversion: 2.1 time: 0.216593 Oct 19 01:12:55.849226 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2445/5008] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:12:55 2022] POST /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:12:55.858011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:55.858901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:55.873706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:55.874201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:55.874642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:55.875359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:55.875813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:55.876234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:56.340721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:56.341635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:56.353438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:56.353953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:56.354405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:56.355136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:56.355604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:56.356046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:56.417346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:12:56.423774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:56.435643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e465442f-8301-4e06-9764-7f5a8ecfcda3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.581301 Oct 19 01:12:56.441286 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2564/5009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:55 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:56.457160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:12:56.521677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:56.525134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:56.527490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:56.572996 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] Creating event network-changed:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:12:56.588108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-158d1802-08e4-4fd0-b3cf-354b8d666fa4 req-997fe5a3-3182-403b-8464-99692cb28322 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143230 Oct 19 01:12:56.591936 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2565/5010] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:12:56.602093 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28404e55-2fb3-4c19-8620-525381a63de7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 204 len: 0 microversion: 2.1 time: 0.265556 Oct 19 01:12:56.603202 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2446/5011] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:12:56 2022] DELETE /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:12:56.614115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:56.614955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:56.630138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:56.630754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:56.632808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:56.633731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:56.635032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:56.636212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:57.000720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:57.067912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a940e8c-e66b-44d0-9743-4f0acb2d95fb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1686 microversion: 2.1 time: 0.426517 Oct 19 01:12:57.102517 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2566/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:56 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1686 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:57.477301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:57.478196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:57.503712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:57.504197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:57.511770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:57.513020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:57.513699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:57.515252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:57.980981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:57.994533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-635d0a1e-bea8-48ec-8b1c-15371b75dc5d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.533925 Oct 19 01:12:57.995712 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2447/5013] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:57 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:58.108842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:58.112982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:58.130068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:58.130598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:58.131092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:58.131960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:58.136264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:58.138639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:58.894410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:58.915598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eac17c28-b602-456e-b8c3-eb6d6d1b89b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1686 microversion: 2.1 time: 0.814105 Oct 19 01:12:58.940169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2567/5014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:58 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1686 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:59.022764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:59.023320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:59.031697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:59.032203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:59.032679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:59.033415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:59.033883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:59.034319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:59.465946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:12:59.484474 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9347a863-eeb7-47e9-a204-92ed01ab9818 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.465806 Oct 19 01:12:59.495117 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2448/5015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:59 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:12:59.941001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:12:59.941634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:12:59.954175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:59.956062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:59.956712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:12:59.957625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:12:59.958986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:12:59.960530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:00.405812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:00.415633 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bef32d1-0b83-4874-9bb2-5bc61e5793eb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1567 microversion: 2.1 time: 0.479379 Oct 19 01:13:00.420353 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2568/5016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:12:59 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:00.520839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:00.521398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:00.543721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:00.546126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:00.550870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:00.553537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:00.556175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:00.556959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:00.645389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a6f63a-6a1e-418f-a6ef-a90affc49793", "name": "network-vif-deleted", "tag": "dae1dcad-2b6a-4603-9202-f96ea5ba47ff"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:00.675150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:00.676319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:00.677143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:00.725630 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] Creating event network-vif-deleted:dae1dcad-2b6a-4603-9202-f96ea5ba47ff for instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 on n-h1-master-1 Oct 19 01:13:00.739248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-aa45e3c6-015e-4a7e-b7c4-f27194438a9d req-9380904d-e034-48c7-b03a-8a154e9c7441 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095541 Oct 19 01:13:00.741740 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2569/5017] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:13:01.059714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:01.072776 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3798ff7a-40a8-4288-b906-89e8fd4c0a14 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.558594 Oct 19 01:13:01.074503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2449/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:00 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:01.447610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:01.449471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:01.467371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:01.468232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:01.468887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:01.469794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:01.472878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:01.473781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:01.556495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:01.558866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:01.560014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:01.566624 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lazy-loading 'fault' on Instance uuid 34a6f63a-6a1e-418f-a6ef-a90affc49793 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:13:01.648471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:01.675748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ce8a16f-d088-44bd-accc-85af7a1f88c2 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 200 len: 1355 microversion: 2.1 time: 0.234074 Oct 19 01:13:01.679051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2570/5019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:01 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 1355 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:02.101580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:02.102217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:02.125024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:02.125829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:02.126313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:02.127252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:02.127727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:02.128361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:02.291995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:02.303044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c0d73e9-f800-452a-9971-6f864b68c06c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.205516 Oct 19 01:13:02.321742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2450/5020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:02 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:02.757548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:02.764650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 34a6f63a-6a1e-418f-a6ef-a90affc49793] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:02.782470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:02.789241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:02.790933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:02.793796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:02.797303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:02.804805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:02.861698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] HTTP exception thrown: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Request method failure captured: Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 HTTP/1.1 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02PfvuF5FK-lBYAeCKONFvpt4ZHToQuDk2Ar_tRRoKUn6i4vEK-w4vv0Sk1lxhkD_gGcWdlOyz8JKtAAQyEGgNfJq1EbZcdieQDaH9mkE4sZDd0stSc0B369XZ8beaQ5Lc-s6ZeewsCa6jSUIHxJw6m_iVfHGPRK_ACVNpPPcRODpg Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44453298a7d04311bd64354938bf2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}] Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2052fd7bb1ee432cb3ca4ec07698292c Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '34a6f63a-6a1e-418f-a6ef-a90affc49793'} Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:13:02.866860 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. Oct 19 01:13:02.871286 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:13:02.875592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Returning 404 to user: Instance 34a6f63a-6a1e-418f-a6ef-a90affc49793 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:13:02.877585 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b1f82bf-2d73-4765-a3b8-483a810ec136 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793" status: 404 len: 111 microversion: 2.1 time: 0.174006 Oct 19 01:13:02.880016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2571/5021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:02 2022] GET /compute/v2.1/servers/34a6f63a-6a1e-418f-a6ef-a90affc49793 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:13:03.331040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:03.332607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:03.344526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:03.347255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:03.349850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:03.350887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:03.352852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:03.354585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:03.364995 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:04.828103 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:04.846088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-941b5572-e6a5-43af-b069-cb39598721bd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 1.521798 Oct 19 01:13:04.847251 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2451/5022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:03 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:05.875913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:05.876570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:05.891966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:05.893092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:05.893695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:05.895659 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:05.900138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:05.900994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:06.789654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:06.801751 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-19bb2a77-d38b-4f22-ad27-42027aa90341 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.931483 Oct 19 01:13:06.802354 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2572/5023] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:05 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:07.832317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:07.832960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:07.862653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:07.863162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:07.863608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:07.864331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:07.864834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:07.865537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:08.331847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:08.349183 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2987940e-556a-4aa3-9aec-6c0d46faf511 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.519841 Oct 19 01:13:08.352993 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2452/5024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:07 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:09.394721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:09.395416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:09.425520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:09.426038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:09.426627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:09.446882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:09.447589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:09.461500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:10.238470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:10.246893 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e42457ff-022a-4911-b0fa-2d1e8246c368 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.857386 Oct 19 01:13:10.267775 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2573/5025] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:09 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:11.277294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:11.279328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:11.292664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:11.294070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:11.294673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:11.302613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:11.303629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:11.303838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:11.778663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:11.795997 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51493840-d2d8-49ad-bb08-47748e38da5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.524494 Oct 19 01:13:11.802136 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2453/5026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:11 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:12.834760 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:12.835507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:12.869481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:12.870554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:12.874765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:12.875573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:12.876588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:12.877052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:12.956425 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=80 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:13.481611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:13.492496 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-693bd281-b92a-41b4-8302-f241e5c7eac4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.670530 Oct 19 01:13:13.494167 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2574/5027] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:12 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:14.418215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c1976c39-37e2-4ac6-8b0c-1cba4d82ed82 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '.version_select at 0x7f2af486af70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:14.496480 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c1976c39-37e2-4ac6-8b0c-1cba4d82ed82 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-559336120" status: 202 len: 0 microversion: 2.1 time: 0.081441 Oct 19 01:13:14.498065 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2454/5028] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 01:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-559336120 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:13:14.542947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:14.543584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:14.548790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55a10146-662c-48be-b095-96ee5e345a65 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: .version_select at 0x7f2aefe0bca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-966763161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmIORbg6Y8YgZATPTK1B6gWz6+RCr1u7/HbpLMHO2IkAj7TUKucsVWnmCudaQm3uJH3RnSAnznYIHKwsV1hoSCUOeBsDlFRRZjH1/GMmd7DdYRYLPbLcsXpJwACEH5gSQ=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:14.555131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:14.555906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:14.556499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:14.557395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:14.558039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:14.558650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:14.570685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-55a10146-662c-48be-b095-96ee5e345a65 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:13:14.577968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-55a10146-662c-48be-b095-96ee5e345a65 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:13:14.610671 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55a10146-662c-48be-b095-96ee5e345a65 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067225 Oct 19 01:13:14.612168 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2455/5029] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:13:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:13:14.899955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:14.908144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-977ab83d-c2ed-4211-91f8-a3e8fca86941 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 0.382448 Oct 19 01:13:14.911351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2575/5030] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:14 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:15.936379 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:15.937320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:15.956774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:15.957338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:15.957818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:15.961447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:15.962024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:15.965106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:17.274380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:17.292482 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a56cfa01-d7aa-4b9b-af6a-d654b4e6f2e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 1.361793 Oct 19 01:13:17.297935 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2456/5031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:15 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:18.334699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:18.335905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:18.360514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:18.361208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:18.361811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:18.362705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:18.363172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:18.363603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:19.448635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:19.476353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e929e23-b4ce-4d2d-a9b4-190300573dcf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 1.154838 Oct 19 01:13:19.477328 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2576/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:18 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:20.504389 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:20.506595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:20.521592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:20.534499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:20.538299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:20.541821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:20.546472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:20.555917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:21.830885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:21.854429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ebc255b2-fade-47fc-b2fe-c4ceae0a4cb7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1511 microversion: 2.1 time: 1.354745 Oct 19 01:13:21.863568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2457/5033] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:20 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1511 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:22.893991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:22.894866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:22.906443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:24.570837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:24.585430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-873d720c-ad01-4a25-bd88-a56dcba47da4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1488 microversion: 2.1 time: 1.695091 Oct 19 01:13:24.586247 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2577/5034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:22 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1488 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:24.615962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:24.626708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:24.636505 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:24.637247 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:24.672942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:24.676290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:24.679021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:24.682771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:24.683270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:24.684981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:24.830400 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93476741-2f12-47ac-9460-08d6df92f62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 200 len: 132 microversion: 2.1 time: 0.220625 Oct 19 01:13:24.831149 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2458/5035] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:13:24 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 132 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:13:24.843125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:24.843749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:24.855444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:24.855943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:24.856388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:24.869184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:24.871612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:24.875355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:25.757390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:25.772381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-24bb346b-fbae-4d29-a484-805d7c7aa0a2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.932659 Oct 19 01:13:25.773997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2578/5036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:24 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:25.811892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:25.812880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:25.843265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:25.846289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:25.846755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:25.850994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:25.855069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:25.857127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:27.223269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:27.256388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d4fc86b-a169-4d8e-86d6-f5cd27103e87 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.439581 Oct 19 01:13:27.257121 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2459/5037] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:25 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:27.281168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:27.282223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:27.287171 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=34 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:27.321034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:27.324082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:27.328029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:27.331195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:27.333450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:27.337352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:28.773443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:28.795761 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c4a74e24-5413-415d-bb97-1cf32e73decd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.520034 Oct 19 01:13:28.799275 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2579/5038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:28.827346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:28.828999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:28.870669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:28.880872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:28.882825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:28.883613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:28.884098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:28.884538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:29.555631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:29.580206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-727856e7-49c6-4ecc-a6a5-fff492a4606c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.745430 Oct 19 01:13:29.581697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2460/5039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:28 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:29.808064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1927916984", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "69976232-9b57-4354-be5a-f2d785e4a03d"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:29.898692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] validate_networks() for [('69976232-9b57-4354-be5a-f2d785e4a03d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:13:35.519492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:13:35.520912 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:13:35.522045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:13:35.522822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:13:35.524169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:13:35.554739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:35.560427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:35.575457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:35.576957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:35.579392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:35.583884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:35.649034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:13:35.669657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:13:35.717005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2022351565", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "795f960f-82a6-48da-aaa5-bcbf13796d27"}], "key_name": "tempest-TestNetworkAdvancedServerOps-966763161", "security_groups": [{"name": "tempest-secgroup-smoke-260744801"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:35.742533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:13:35.760250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:13:35.901679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-957fd85d-0c9d-48fc-94a8-c0d8a7abd2c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.097613 Oct 19 01:13:35.906598 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2580/5040] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 6103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:13:35.923183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a21f2b98-f953-4f92-96da-891c313452de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:35.925066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a21f2b98-f953-4f92-96da-891c313452de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:36.148180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a21f2b98-f953-4f92-96da-891c313452de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:36.158076 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a21f2b98-f953-4f92-96da-891c313452de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1215 microversion: 2.1 time: 0.244464 Oct 19 01:13:36.162260 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2581/5041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:35 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1215 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:36.757202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] validate_networks() for [('795f960f-82a6-48da-aaa5-bcbf13796d27', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:13:37.184646 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2fb5ae94-0010-4f08-afea-9a3540e2dd4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:37.185366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fb5ae94-0010-4f08-afea-9a3540e2dd4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:37.558950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2fb5ae94-0010-4f08-afea-9a3540e2dd4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:37.566362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2fb5ae94-0010-4f08-afea-9a3540e2dd4a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1215 microversion: 2.1 time: 0.385540 Oct 19 01:13:37.570916 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2582/5042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:37 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1215 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:38.605049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:38.606456 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:38.635794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:38.636550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:38.638047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:38.640409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:38.641121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:38.642243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:38.680905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:13:38.681348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:13:38.681807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:13:38.682218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:13:38.682635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:13:38.716227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:38.717134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:38.721377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:38.722301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:38.722807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:38.723893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:38.768797 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=45 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:38.827270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:13:38.854462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:13:38.885712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:38.910036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:13:38.925319 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b78b4242-f155-467b-83c2-36dad111394a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1267 microversion: 2.1 time: 0.329165 Oct 19 01:13:38.932045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:13:38.953865 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2583/5043] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:38 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:39.032959 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1dd157f-1144-456c-84ac-645cc8dd6dc7 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.321984 Oct 19 01:13:39.034218 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2461/5044] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:13:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 3324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:13:39.046668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-50d05117-f68c-4dd9-b1d1-d23563fa30f4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:39.047281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-50d05117-f68c-4dd9-b1d1-d23563fa30f4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:39.253536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-50d05117-f68c-4dd9-b1d1-d23563fa30f4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:39.264248 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-50d05117-f68c-4dd9-b1d1-d23563fa30f4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1266 microversion: 2.1 time: 0.221327 Oct 19 01:13:39.264876 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2584/5045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:39 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:39.973156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:39.974053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:39.998785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:39.999056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:40.005942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:40.010160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:40.011306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:40.011768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:40.290914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:40.291800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:40.313487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:40.314160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:40.318814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:40.323859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:40.324464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:40.330644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:40.337672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:40.353814 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7034c97-20d3-46d3-8624-15e0a92e4a31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1273 microversion: 2.1 time: 0.385995 Oct 19 01:13:40.368108 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2462/5046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:39 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1273 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:40.593313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:40.603442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff468ca8-6d66-4eaa-99ef-50fa57ebf021 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1270 microversion: 2.1 time: 0.318357 Oct 19 01:13:40.605409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2585/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:40 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:41.386441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:41.388655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:41.410071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:41.420357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:41.421126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:41.422048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:41.422674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:41.424824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:41.629981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:41.636282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:41.637276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:41.656419 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-69ba0a8e-3328-4cfd-8fea-a592b3a848fb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1273 microversion: 2.1 time: 0.276414 Oct 19 01:13:41.658232 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2463/5048] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:41 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:41.668543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:41.669101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:41.683488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:41.686715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:41.688800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:41.689485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:41.868952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:41.886786 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a11f6423-1da5-46bd-a9f0-3022e0c3565c tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1326 microversion: 2.1 time: 0.253233 Oct 19 01:13:41.892174 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2586/5049] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:41 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1326 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:42.684772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:42.685393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:42.724524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:42.738107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:42.739298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:42.742279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:42.758215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:42.758882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:42.920489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:42.922010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:42.946655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:42.948271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:42.949671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:42.954353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:42.955897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:42.961201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:42.983807 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=56 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:43.094570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:43.106100 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19e48821-11e1-4403-9749-cb81a8bd2c61 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1273 microversion: 2.1 time: 0.425138 Oct 19 01:13:43.115750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2464/5050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:42 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1273 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:43.285045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:43.296387 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9d2fdfd-ca2b-4d1e-a0f4-9afb10c06022 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1324 microversion: 2.1 time: 0.380635 Oct 19 01:13:43.297455 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2587/5051] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:42 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1324 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:44.141920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:44.143842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:44.160149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:44.162420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:44.164591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:44.167662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:44.170738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:44.171608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:44.323921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:44.324549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:44.338357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:44.339321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:44.341189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:44.342223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:44.343069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:44.343745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:44.344125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:44.358721 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de55dc84-d1fe-4596-9b94-f8b2f9e17e3e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1273 microversion: 2.1 time: 0.222415 Oct 19 01:13:44.361881 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2465/5052] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:44 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:44.508957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:44.545252 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2ff4973-19c0-4e2c-b30c-77c1e2ba4a8a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1324 microversion: 2.1 time: 0.221074 Oct 19 01:13:44.545997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2588/5053] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:44 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:45.384682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:45.385314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:45.421910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:45.422696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:45.423158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:45.423898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:45.424366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:45.424839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:45.570636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:45.571891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:45.598938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:45.602444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:45.602947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:45.603707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:45.604167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:45.611020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:45.612136 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:46.174750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:46.187218 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f946782-fc1e-4f6c-b3bc-772f0c2259ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1273 microversion: 2.1 time: 0.807695 Oct 19 01:13:46.187965 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2466/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:45 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1273 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:46.210651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:46.223149 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e06ed71f-9fcd-4a3b-8d82-e86e0c8d7894 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1324 microversion: 2.1 time: 0.655624 Oct 19 01:13:46.242211 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2589/5055] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:45 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:47.215235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:47.215812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:47.241853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:47.242683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:47.249859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:47.250953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:47.251635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:47.252241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:47.254377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:47.255674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:47.271327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:47.271832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:47.272274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:47.278312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:47.278843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:47.279370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:47.609617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:47.621971 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-72de230c-9fc0-4cb3-a876-2459ee61d3cb tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1324 microversion: 2.1 time: 0.373135 Oct 19 01:13:47.639064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2590/5056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:47 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1324 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:48.061036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:48.077596 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbf4c157-bf22-4500-a8d0-175e3cddee5a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.866181 Oct 19 01:13:48.087707 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2467/5057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:47 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:48.648206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:48.649270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:48.695160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:48.697141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:48.698721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:48.701267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:48.702622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:48.704971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:49.129779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:49.131206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:49.136487 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:49.139132 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:49.159276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:49.167993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:49.168830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:49.169777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:49.173352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:49.173991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:49.258423 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:50.233956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:50.259381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b14cb496-8765-4ad8-86f1-e145e5e82329 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.609890 Oct 19 01:13:50.263295 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2591/5058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:48 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:50.980290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a730f888-496d-407e-adcb-4c7397cb6d31", "tag": "0357b2eb-17c1-4d80-b28c-34a65815b19c"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:51.021090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:51.025992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:51.030262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:51.090891 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] Creating event network-changed:0357b2eb-17c1-4d80-b28c-34a65815b19c for instance a730f888-496d-407e-adcb-4c7397cb6d31 on n-h1-master-1 Oct 19 01:13:51.103885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-904412b8-8496-4db6-a5a8-af2c47aa4e35 req-263bb709-9f2a-4f49-810a-49c589c60bb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128575 Oct 19 01:13:51.108223 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2592/5059] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:13:51.292420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:51.293239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:51.302802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:51.307204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:51.308463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:51.311515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:51.312509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:51.313328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:51.314705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:51.338783 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de4a05c6-da89-4670-9f6b-77b76cc7e935 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 2.213875 Oct 19 01:13:51.361829 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2468/5060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:49 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 2237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:52.373197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:52.374504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:52.387197 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:52.389252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:52.389934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:52.390866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:52.393302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:52.393949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:52.804026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:52.824991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f385a6f-c12f-4a67-ae77-2ff9448c9f3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.540156 Oct 19 01:13:52.828813 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2593/5061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:51 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:52.980085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:53.014493 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d86496b-56ba-405f-a0ac-ec5aa3d9ba85 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.628497 Oct 19 01:13:53.016472 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2469/5062] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:52 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:53.306892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:13:53.341477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:53.345666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:53.346809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:53.372171 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] Creating event network-changed:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h2-master-1 Oct 19 01:13:53.380768 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ffbd3033-0a90-4979-b91e-1ce85fe68c58 req-9d1b236d-2067-4ae0-8927-655e7ee79e25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081906 Oct 19 01:13:53.382023 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2594/5063] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:13:53.855641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:53.856285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:53.868495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:53.869035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:53.869489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:53.870252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:53.870687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:53.871130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:54.051869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:54.053585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:54.069040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:54.072214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:54.072879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:54.073796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:54.075479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:54.079324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:55.146393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:55.169556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec0b0818-5492-456d-8678-25f7c350e17f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.317303 Oct 19 01:13:55.172693 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2470/5064] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:53 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:55.220553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:55.250926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39688822-021f-4c6c-8dae-9a6668d9fba4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 1.207780 Oct 19 01:13:55.251715 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2595/5065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:54 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:56.201003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:56.201635 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:56.205749 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:56.220375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:56.221216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:56.222508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:56.223901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:56.225161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:56.230209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:56.276331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:56.277155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:56.291489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:56.303634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:56.304186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:56.308035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:56.308925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:56.309548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:56.826796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:56.835645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91e79772-5afe-4f5a-958f-ccc0b5e370d9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 0.639644 Oct 19 01:13:56.839719 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2471/5066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:56 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:56.925327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:56.936974 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8aa18d4f-dcc7-4873-a368-ab5c79842379 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.663596 Oct 19 01:13:56.939974 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2596/5067] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:56 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:13:57.866084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:57.866891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:57.898369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:57.900326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:57.900973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:57.904864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:57.907092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:57.910636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:57.967052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:57.968564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:57.977840 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:13:58.009911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:58.013250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:58.016356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:58.024278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:58.034105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:58.036440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:58.909105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:58.919537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae0f644e-bf43-4caf-adba-10f73c6aa0a8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.956615 Oct 19 01:13:58.926160 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2597/5068] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:57 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:59.104964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:13:59.127541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ec8297d-ed08-46be-8c80-8008209110f1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.257179 Oct 19 01:13:59.130016 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2472/5069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:57 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:13:59.953685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:13:59.955770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:13:59.965882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:59.966385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:59.967160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:13:59.969863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:13:59.970630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:13:59.971414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:00.157585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:00.159289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:00.173804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:00.177086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:00.177883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:00.179541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:00.181016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:00.181753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:00.380446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:00.398559 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8092f9bc-3eb6-44f7-81c9-ca839d04956d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.447266 Oct 19 01:14:00.400901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2598/5070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:13:59 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:00.555455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:00.567875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f830d84-82cb-47de-a420-1886e05bcb13 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 0.414550 Oct 19 01:14:00.569821 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2473/5071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:00 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:01.594420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:01.595809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:01.613315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:01.614165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:01.615938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:01.617315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:01.620424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:01.622831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:02.138471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:02.140922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:02.151407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:02.152410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:02.153105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:02.154168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:02.155242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:02.155900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:03.516467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:03.538948 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9202572-09d8-40ad-a74e-515a58d4758d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.949501 Oct 19 01:14:03.540689 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2474/5072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:01 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:03.555330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "name": "network-vif-plugged", "status": "completed", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:03.561882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:03.582336 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18f1abee-dc17-4a18-b56f-ed4aa3caeabb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 2.152527 Oct 19 01:14:03.583897 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2599/5073] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:01 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:03.604280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:03.605205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:03.607265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:03.651049 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] Creating event network-vif-plugged:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h2-master-1 Oct 19 01:14:03.673327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-fbe5b982-520d-43fd-8abe-dd42ce2a08a2 req-e04999ee-638f-4991-85bf-91d08a459d1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130757 Oct 19 01:14:03.682024 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2475/5074] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:04.567629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:04.568520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:04.581692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:04.583019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:04.583481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:04.584260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:04.585330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:04.585894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:04.613897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:04.614636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:04.624705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:04.625202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:04.625645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:04.626353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:04.626810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:04.636582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:04.968890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:04.978395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-11a7509c-993d-43fd-bbaa-4af0276a5b72 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 0.371397 Oct 19 01:14:04.986632 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2476/5075] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:04 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:05.797178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a730f888-496d-407e-adcb-4c7397cb6d31", "name": "network-vif-plugged", "status": "completed", "tag": "0357b2eb-17c1-4d80-b28c-34a65815b19c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:05.821655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:05.822137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:05.822781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:05.858726 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] Creating event network-vif-plugged:0357b2eb-17c1-4d80-b28c-34a65815b19c for instance a730f888-496d-407e-adcb-4c7397cb6d31 on n-h1-master-1 Oct 19 01:14:05.868036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4197ab07-3490-4f37-8caf-de3d95bcb939 req-508eeeb8-bcda-4b4d-82f7-705c59eaef6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075078 Oct 19 01:14:05.871652 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2477/5076] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:14:05.936182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:05.962031 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd9ed336-90c1-4a73-9b62-a1532fccc38a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1391 microversion: 2.1 time: 1.399999 Oct 19 01:14:05.973839 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2600/5077] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:04 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1391 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:06.018253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:06.019543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:06.055648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:06.063428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:06.064265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:06.067861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:06.070799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:06.071454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:06.998744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:06.999387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:07.002127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:07.018911 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16530dc9-b0c4-428e-a062-94bb54b25cad tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1315 microversion: 2.1 time: 1.010984 Oct 19 01:14:07.021051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2478/5078] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:06 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:07.031272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:07.058705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:07.062788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:07.063591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:07.064073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:07.064511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:07.626094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:07.634639 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09f4acf8-3581-426d-a6af-b52b7a3f7f45 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1562 microversion: 2.1 time: 0.640208 Oct 19 01:14:07.673565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:07.674133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:07.692265 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2601/5079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:06 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1562 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:07.698794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:07.708247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:07.709228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:07.714614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:07.717429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:07.718122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:08.053563 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:08.054751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:08.072579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:08.073110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:08.074546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:08.076159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:08.078265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:08.080172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:08.186572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:08.188962 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:08.197368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66862da5-30ac-4fa9-9115-48f59bb834ff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1562 microversion: 2.1 time: 0.532842 Oct 19 01:14:08.197982 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2479/5080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:07 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1562 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:08.610050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:08.626579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7867b3ae-d53b-47fd-938a-bb1021b9e0be tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1502 microversion: 2.1 time: 0.578820 Oct 19 01:14:08.627460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2602/5081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:08 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1502 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:08.655576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:08.659846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:08.726091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:08.726091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:08.751107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:08.752080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:08.752589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:08.758022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:08.881903 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c88e2bb-3002-4f2f-9fbf-53d7fac062d0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.229934 Oct 19 01:14:08.886492 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2480/5082] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:08 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:09.895630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:09.899967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:09.922820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:09.923861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:09.927424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:09.944298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:09.946658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:09.949258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:10.109173 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5cd54a2b-22ab-4be9-b377-39c9ed7e35e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.219131 Oct 19 01:14:10.113308 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2603/5083] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:09 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:11.121786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:11.124874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:11.157386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:11.165171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:11.166369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:11.171361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:11.175549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:11.176272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:11.369799 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba7bed1b-c2dc-4e91-9388-286f12a0a8dc tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.252136 Oct 19 01:14:11.398074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2481/5084] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:11 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 01:14:12.413469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:12.416842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:12.446132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:12.448016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:12.451982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:12.457415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:12.464199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:12.468428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:12.635646 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb6e9cdc-ff5b-43b6-9f61-347ba786b9ed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.237346 Oct 19 01:14:12.636558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2604/5085] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:12 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:13.652738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:13.668252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:13.698785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:13.702790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:13.703265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:13.704028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:13.704500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:13.704972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:13.880925 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab4f5e82-09e3-4217-aa26-82bad2c0cf6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.234341 Oct 19 01:14:13.885870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2482/5086] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:13 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:14.664503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-382906248", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:14.791747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:14.793395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:14.822076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:14.822965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:14.823596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:14.836002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:14.836942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:14.837572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:14.991031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] validate_networks() for None {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:14:15.761947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:14:15.762685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:14:15.763196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:14:15.763609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:14:15.764022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:14:15.768118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:15.791325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:15.792371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fefec7a-8edf-4be2-bb2f-1f5f20b779e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1562 microversion: 2.1 time: 1.008234 Oct 19 01:14:15.794036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:15.794671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:15.795667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:15.796291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:15.801101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:15.828881 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:15.834448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2483/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:14 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1562 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:15.880481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:15.903133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Getting quotas for project be4dc61aad674342855e701484fc5de8. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:14:15.946736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:15.947225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:15.947670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:15.949298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Getting quotas for user 9dd04587dfb945c1816c657b89cbfb18 and project be4dc61aad674342855e701484fc5de8. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:14:15.988106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] Creating event network-changed:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h2-master-1 Oct 19 01:14:16.005876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:14:16.012315 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3616f702-61ad-4e26-8df0-461fef0e7578 req-dbf009a2-c171-407c-8f96-e178574db8fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164893 Oct 19 01:14:16.015076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2484/5088] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:16.017989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:14:16.033267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:16.040799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:16.062734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:16.063252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:16.063971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:16.064403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:16.075237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:16.075817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:16.209805 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-db50884c-91fe-4a64-baea-289f71301014 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.192690 Oct 19 01:14:16.210458 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2485/5089] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:16 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:16.245542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0de0597b-4b55-4db5-bf24-da1529a7d241 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590161 Oct 19 01:14:16.253946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2605/5090] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:14:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:14:16.259579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5885e87-f83d-4d02-a397-f3a6f7a30226 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:16.260496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5885e87-f83d-4d02-a397-f3a6f7a30226 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:16.455177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5885e87-f83d-4d02-a397-f3a6f7a30226 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:16.466479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5885e87-f83d-4d02-a397-f3a6f7a30226 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1214 microversion: 2.1 time: 0.211267 Oct 19 01:14:16.481198 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2486/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:16 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:17.225262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:17.246156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:17.286756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:17.287279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:17.287734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:17.293114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:17.293889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:17.297982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:17.472206 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7611b238-7be3-4b99-9b40-5cd9d3d82825 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.251960 Oct 19 01:14:17.479381 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2606/5092] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:17 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:17.495483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52f92d0a-8ca1-45bb-9b95-57465efa3ac0 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:17.496824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52f92d0a-8ca1-45bb-9b95-57465efa3ac0 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:17.783498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-52f92d0a-8ca1-45bb-9b95-57465efa3ac0 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:17.836408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52f92d0a-8ca1-45bb-9b95-57465efa3ac0 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1214 microversion: 2.1 time: 0.344913 Oct 19 01:14:17.837791 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2487/5093] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:17 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1214 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:18.485933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:18.489302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:18.512005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:18.514180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:18.519974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:18.523377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:18.526604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:18.528124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:18.684572 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8527c7f7-96cc-4f70-9108-b5ac699ac9d5 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.199940 Oct 19 01:14:18.696873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2607/5094] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:18 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:18.869332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:18.871269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:18.899583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:18.900265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:18.903398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:18.905380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:18.907174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:18.911413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:19.070595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:19.085992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8435f247-53d2-40c6-8551-253028c356c4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1266 microversion: 2.1 time: 0.221933 Oct 19 01:14:19.106303 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2488/5095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:18 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:19.704308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:19.707104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:19.722212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:19.728178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:19.730373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:19.731286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:19.731782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:19.732224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:19.834112 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1838972-6bbc-4b45-9cbe-f5d67ed39b3b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 14 microversion: 2.1 time: 0.133443 Oct 19 01:14:19.836087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2608/5096] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:19 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:14:20.118646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:20.120125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:20.131713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:20.132686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:20.134081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:20.135667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:20.139399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:20.139868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:20.296955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:20.308122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95fc0365-3e34-420f-bbbe-1109ae35047a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1272 microversion: 2.1 time: 0.193725 Oct 19 01:14:20.308735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2489/5097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:20 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1272 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:20.848592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:20.853016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:20.875932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:20.881240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:20.882603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:20.883574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:20.884980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:20.885629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.001709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3b01196e-4c2f-42a2-a976-548016cbb51c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action" status: 200 len: 8208 microversion: 2.1 time: 0.158641 Oct 19 01:14:21.003984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2609/5098] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:20 2022] POST /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31/action => generated 8208 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:21.015023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:21.015969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:21.024003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.025138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.025846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.026798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.027518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.028333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.340381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:21.342214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:21.368346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.368878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.369324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.370049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.370512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.370947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.606710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:21.619498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a432681b-88e2-4c9d-b547-3bb3df91df5d tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1272 microversion: 2.1 time: 0.288576 Oct 19 01:14:21.621769 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2610/5099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:21 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1272 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:21.800566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:21.816962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa52aa9d-85a7-4152-8c3a-be4e4a1fde4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.805809 Oct 19 01:14:21.855921 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2490/5100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:21.865172 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:21.868885 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:21.889235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.889740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.896927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:21.898820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:21.899321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:21.899768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.162790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:22.176742 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16ccaba1-1518-495c-872b-bb17bc4e4e7c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.321060 Oct 19 01:14:22.178178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2611/5101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:22.202703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:22.203645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:22.223970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.224889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.225603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.227280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.227945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.228592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.650979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:22.651877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:22.660473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.661684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.662322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.663385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.664304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.664959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.865482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:22.883965 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81778ed1-2c3b-4fdd-86c3-12d93e1453cb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.685957 Oct 19 01:14:22.893112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2491/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:22 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:22.926603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:22.928670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:22.946406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.949241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.949801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:22.954627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:22.956467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:22.957213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:23.468468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:23.479546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4968382e-381f-4249-a062-7c3dc39025be tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.832906 Oct 19 01:14:23.481188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:23.500393 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2612/5103] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:22 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:23.504808 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b2c97f0-2799-4b74-ba01-31202ea633b0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.596635 Oct 19 01:14:23.517692 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2492/5104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:22 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:23.536033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:23.537359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:23.543777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:23.544323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:23.544813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:23.545619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:23.546064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:23.546493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:23.629642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Locking {{(pid=131449) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 19 01:14:23.731286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd8c8474-c43d-4c16-bedb-796994335e30 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.200109 Oct 19 01:14:23.731979 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2613/5105] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:23 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:23.742270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:23.743955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:23.753870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:23.767807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:23.768407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:23.769213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:23.769702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:23.770141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.173698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:24.183656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-929cfe08-8455-4bd2-8c57-0a847b01aadb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.446937 Oct 19 01:14:24.188062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2493/5106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:23 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:24.212226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:24.221568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.222385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.222838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.263274 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action HTTP/1.1 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 15 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: {"os-stop": {}} Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8293bf46-db0a-4343-96e4-b0651449064e', 'body': {'os-stop': {}}} Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked Oct 19 01:14:24.270179 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:24.276152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 409 to user: Instance 8293bf46-db0a-4343-96e4-b0651449064e is locked {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:14:24.277234 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c4c1c994-f0ca-4060-9b84-3369980c484f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 409 len: 107 microversion: 2.1 time: 0.069009 Oct 19 01:14:24.281421 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2614/5107] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:24 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 107 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:14:24.292657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:24.294440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:24.313029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.313528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.313970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.314762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.315399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.315841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.470321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Unlocking {{(pid=131450) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 01:14:24.505621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:24.506482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:24.514436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.516581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.522421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.523469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.524146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.524819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.625025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08a733f6-4b69-46e9-a514-947bf0ac73b3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.337904 Oct 19 01:14:24.626823 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2494/5108] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:24 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:24.635492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:24.646486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.647936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.650288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.709970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:14:24.799942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-543b7696-3a1d-4e4d-9d0d-609fca156e1c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.167254 Oct 19 01:14:24.801176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2495/5109] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:24 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:14:24.809799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:24.820299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:24.829675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:24.839141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.840164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.842995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.843376 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf8498c7-e35e-46b7-9c5c-abc868c891d4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.341045 Oct 19 01:14:24.844681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:24.845430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:24.846759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:24.862558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2615/5110] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:24 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:25.066755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:25.078288 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:25.083409 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f25b965-212e-4c9d-832a-6530d9ecc354 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.277727 Oct 19 01:14:25.086921 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2496/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:24 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:25.133776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3a27aa-43aa-4cd6-92b5-6d19fcd38baf", "tag": "a6c43fc8-b717-40db-b51b-781915950c15"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:25.147029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:25.147763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:25.148722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:25.164160 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] Creating event network-changed:a6c43fc8-b717-40db-b51b-781915950c15 for instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf on n-h1-master-1 Oct 19 01:14:25.181769 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0fe4a315-5182-4f12-a246-e09f19ba535c req-4c3d040e-ab41-4bb6-9f60-92e5df88aaef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051698 Oct 19 01:14:25.183389 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2616/5112] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:25.867881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:25.882415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:25.897609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:25.906536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:25.911679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:25.912568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:25.913298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:25.913807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:26.110670 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:26.112497 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:26.117690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:26.120491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:26.140565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:26.150994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:26.153323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:26.154262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:26.156528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:26.160360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:26.221815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:26.245305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6319cc1c-022a-490c-9fbe-a9536e953549 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.381495 Oct 19 01:14:26.246336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2497/5113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:25 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:26.435767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:26.444468 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f0715006-cc29-4ccd-b08a-815a6a56cc91 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.335480 Oct 19 01:14:26.465266 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2617/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:26 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:27.274298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:27.276262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:27.283204 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=58 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:27.301167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:27.301956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:27.303149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:27.304054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:27.304702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:27.305858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:27.473671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:27.474220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:27.485467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:27.486008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:27.486451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:27.487194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:27.491426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:27.492136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:27.673502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:27.685936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c624e3b1-aab6-44e4-a96d-fe0146c50755 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.422080 Oct 19 01:14:27.688015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2498/5115] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:27 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:27.787437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:27.796200 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0c817a6-6fc9-4028-8433-32aed5d2f7e1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.327103 Oct 19 01:14:27.819470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2618/5116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:28.712685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:28.713968 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:28.716153 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:28.745867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:28.746461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:28.749319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:28.752175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:28.753488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:28.753939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:28.829833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:28.831109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:28.833911 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:28.849055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:28.865863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:28.866621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:28.867493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:28.867982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:28.868413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:29.430475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:29.453402 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f41dbbd-6eb0-4a72-b974-6d57fb09fbf2 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.744931 Oct 19 01:14:29.457189 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2499/5117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:28 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:29.481922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:29.490505 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0d98566-d024-4f31-85e3-b3db37884472 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.664391 Oct 19 01:14:29.505374 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2619/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:28 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:29.924046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:29.926591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:29.945605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:29.946975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:29.948767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:29.949715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:29.952848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:29.953559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:30.120345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b60798b6-0809-4aa0-b7ef-47dd879c7ba4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action" status: 200 len: 24569 microversion: 2.1 time: 0.201276 Oct 19 01:14:30.121659 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2500/5119] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:29 2022] POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action => generated 24569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:14:30.479497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:30.480128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:30.493768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:30.494258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:30.494699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:30.495411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:30.495864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:30.496297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:30.529813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:30.534885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:30.567238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:30.569879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:30.570620 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:30.575101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:30.575867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:30.577156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:31.264096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:31.275074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-807984e8-95c8-47b9-8610-34dbc21f3989 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.755836 Oct 19 01:14:31.290091 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2501/5120] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:30 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:31.312001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:31.322055 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-abd7e894-01e0-45c6-9811-da5d80f59da6 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.846565 Oct 19 01:14:31.329658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2620/5121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:30 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:32.305481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3a27aa-43aa-4cd6-92b5-6d19fcd38baf", "name": "network-vif-plugged", "status": "completed", "tag": "a6c43fc8-b717-40db-b51b-781915950c15"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:32.316987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:32.317626 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:32.326899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:32.329366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:32.332021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:32.334556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:32.335066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:32.336601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:32.337645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:32.338112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:32.338548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:32.367951 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] Creating event network-vif-plugged:a6c43fc8-b717-40db-b51b-781915950c15 for instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf on n-h1-master-1 Oct 19 01:14:32.381283 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-fcfdcdaa-795a-48ce-8870-6892236daf22 req-c103104b-96f6-4a61-8124-68fef8aca15b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079165 Oct 19 01:14:32.384078 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2502/5122] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:32.398885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:32.413228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:32.452959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:32.458244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:32.461077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:32.477724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:32.478975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:32.483490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:32.940566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:32.959287 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b85754e-cb60-4e32-b65c-d9b96f87770e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.647083 Oct 19 01:14:32.987579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2621/5123] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:32 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:33.119342 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:33.128429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cabc7685-17c2-44ec-971c-4eec19b8d99f tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 0.741450 Oct 19 01:14:33.131718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2503/5124] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:32 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:33.995155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:33.995788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:34.008865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:34.009347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:34.010512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:34.015316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:34.015787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:34.016240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:34.128799 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:34.165071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:34.165071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:34.185302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:34.185804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:34.193230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:34.194162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:34.196930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:34.197628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:35.405344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:35.414796 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33ecd7cd-d0b1-4ff1-ae17-5790ad4c6e19 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1314 microversion: 2.1 time: 1.260045 Oct 19 01:14:35.420933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2504/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:34 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1314 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:35.465830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:35.481379 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29e2d8e2-cf81-4462-b485-19a78fa2118f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 1.490573 Oct 19 01:14:35.481892 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2622/5126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:33 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:36.448174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:36.449495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:36.466310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:36.467061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:36.467708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:36.468636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:36.469275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:36.469910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:36.510073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:36.510845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:36.531090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:36.539403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:36.547355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:36.556935 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:36.557754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:36.561443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.093296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:37.116185 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b95ea57f-b70a-4d6c-8048-c076b4bf49f4 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1464 microversion: 2.1 time: 0.671799 Oct 19 01:14:37.117586 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2505/5127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:36 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1464 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:37.124668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:37.127936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:37.128937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:37.134194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f0639e1-b220-403c-840a-cb40d9983a50 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1656 microversion: 2.1 time: 0.629249 Oct 19 01:14:37.134793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2623/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:36 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1656 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:37.193696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:37.194777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:37.195568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.198090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:37.202284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:37.203010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.217995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:37.258288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:37.261115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:37.263142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.457411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Going to try to start instance {{(pid=131449) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:14:37.630691 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6bdd862c-152c-4c23-9343-c964fd62af12 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.448210 Oct 19 01:14:37.636445 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2624/5129] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:37 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:37.663909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:37.676515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:37.694484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:37.695425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:37.696728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.697730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:37.700248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:37.701393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:37.910982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:14:38.007981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:38.021839 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3595fa7-2116-4512-b139-cc0a25ec59fe tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1680 microversion: 2.1 time: 0.901026 Oct 19 01:14:38.027687 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2506/5130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:37 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1680 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:38.053367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:38.055858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:38.085520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.089194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.092008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.094883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.098210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.098681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.242551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa45bcbe-c0e3-41c6-883e-76716020582b tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "DELETE /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 204 len: 0 microversion: 2.1 time: 0.603665 Oct 19 01:14:38.248090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2625/5131] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:14:37 2022] DELETE /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:14:38.283510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:38.283510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:38.347509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.351342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.354216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.362202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.367920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.370857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.494993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:38.516387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af8a7ee5-a642-44ca-b47c-a5fc881aca0f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 0.486304 Oct 19 01:14:38.517920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2507/5132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:38 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:38.541546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:38.544291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:38.577058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.582053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.583009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.587396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.589721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.590441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.719820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd7a8daa-06ec-4dec-b1e8-ce679b9053a9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action" status: 200 len: 32640 microversion: 2.1 time: 0.188294 Oct 19 01:14:38.728468 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2508/5133] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:38 2022] POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action => generated 32640 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:14:38.917398 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:38.931292 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54e6a72b-829d-4ff8-b62e-c1827a04c786 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1470 microversion: 2.1 time: 0.672704 Oct 19 01:14:38.934356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2626/5134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:38 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1470 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:38.949234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:38.949946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:38.967480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.968340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.969067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:38.970028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:38.970865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:38.971526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:39.521866 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b05f5811-d886-4076-9fe2-133da40366dd tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1831 microversion: 2.1 time: 0.574133 Oct 19 01:14:39.548993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:39.549838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:39.564996 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2509/5135] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:38 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1831 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:39.576519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:39.577099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:39.577662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:39.585127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:39.586375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:39.586375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:39.587237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:39.596160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:39.628605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:39.634787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:39.634997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:39.640173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:39.641714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:39.644771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:39.750061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lazy-loading 'flavor' on Instance uuid cfc7a33c-4a67-49fc-b435-0f7dd373b788 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:14:39.790956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Going to try to live migrate instance to another host {{(pid=131450) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 19 01:14:39.969976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:39.979651 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a042a2a2-e17b-43e5-832b-c8d3fb7bb8a0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 0.435048 Oct 19 01:14:39.993022 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2627/5136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:39 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:40.004902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:40.005548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:40.025029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:40.029267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:40.029922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:40.031394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:40.032068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:40.032820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:40.609171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:40.618844 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3aac0993-e89a-4089-8424-2496849b555a tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1470 microversion: 2.1 time: 0.624615 Oct 19 01:14:40.636658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2628/5137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:39 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:40.796549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3a27aa-43aa-4cd6-92b5-6d19fcd38baf", "name": "network-vif-deleted", "tag": "a6c43fc8-b717-40db-b51b-781915950c15"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:40.824912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:40.825421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:40.826003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:40.883698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] Creating event network-vif-deleted:a6c43fc8-b717-40db-b51b-781915950c15 for instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf on n-h1-master-1 Oct 19 01:14:40.917740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4b2217b8-cee6-47f9-9b46-e866bc34186c req-22fa0d69-45b4-4a93-baf7-ad3dfa0ba207 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124923 Oct 19 01:14:40.924958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2629/5138] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:14:41.008305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:41.009909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:41.027842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:41.029030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:41.029649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:41.031814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:41.033755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:41.034311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:41.537280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:41.559243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-98fac745-9375-42bd-9e6f-2573d5fe9084 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 0.551541 Oct 19 01:14:41.572663 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2630/5139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:41 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:41.649914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:41.657664 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:41.684926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:41.821245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:41.821740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:41.822455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:41.823959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lazy-loading 'fault' on Instance uuid da3a27aa-43aa-4cd6-92b5-6d19fcd38baf {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:14:41.948222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dd04587dfb945c1816c657b89cbfb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be4dc61aad674342855e701484fc5de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:41.959508 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1952520d-f04f-45d7-894d-d46a1c58638e tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 200 len: 1304 microversion: 2.1 time: 0.313807 Oct 19 01:14:41.985037 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2631/5140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:41 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 1304 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:42.586297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:42.586919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:42.610856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:42.617553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:42.623522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:42.628295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:42.632479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:42.633080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:43.622418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:43.638239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b5dc2de4-562a-4c9b-a9b4-27d3f1ee1228 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 1.055718 Oct 19 01:14:43.644202 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2632/5141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:42 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:43.649702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:43.652550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] [instance: da3a27aa-43aa-4cd6-92b5-6d19fcd38baf] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:43.668004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:43.668864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:43.671598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:43.672604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:43.673806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:43.679039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:43.738653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] HTTP exception thrown: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Request method failure captured: Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf HTTP/1.1 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT09iM2z223fU6qTSR7ehIKPdC6imhAazhxMWfVCbF4xM_7Zcjq5ohSXa9wFOJx9NOI40b9v4mmAVtgRD0RzsQR8WnztYPqe_sV0-nHubyzMIOEQywDY0ukibBbf6U9niQcBL85GwuoxCwNwCymIjSI4G9DpLObko2_QmiMPBaoCGjoU Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: be4dc61aad674342855e701484fc5de8 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-VolumesNegativeTest-1269032798 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_be4dc61aad674342855e701484fc5de8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4dc61aad674342855e701484fc5de8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/be4dc61aad674342855e701484fc5de8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/be4dc61aad674342855e701484fc5de8"}]}] Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-VolumesNegativeTest-1269032798 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: be4dc61aad674342855e701484fc5de8 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-VolumesNegativeTest-1269032798 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-VolumesNegativeTest-1269032798-project Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9dd04587dfb945c1816c657b89cbfb18 Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-VolumesNegativeTest-1269032798-project Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: exception: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'da3a27aa-43aa-4cd6-92b5-6d19fcd38baf'} Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:14:43.741637 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. Oct 19 01:14:43.745887 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:14:43.759835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] Returning 404 to user: Instance da3a27aa-43aa-4cd6-92b5-6d19fcd38baf could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:14:43.760869 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-479704dc-1f8e-434c-a264-e2211601af16 tempest-VolumesNegativeTest-1269032798 tempest-VolumesNegativeTest-1269032798-project] 10.222.0.27 "GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf" status: 404 len: 111 microversion: 2.1 time: 0.115310 Oct 19 01:14:43.764260 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2633/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:43 2022] GET /compute/v2.1/servers/da3a27aa-43aa-4cd6-92b5-6d19fcd38baf => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:14:44.663523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:44.664929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:44.673975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:44.674465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:44.674894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:44.675684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:44.676146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:44.676579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.014801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:45.023757 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bea5fe95-ba68-43fc-8ead-e112ffd0715a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.365537 Oct 19 01:14:45.025025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2634/5143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:44 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:45.050481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:45.051488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:45.058774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.059580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.060231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.061235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.061915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.062551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.315315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:45.324779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92f6a18b-1a2f-4d47-9067-fe2b665e8e6b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.279382 Oct 19 01:14:45.348092 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2635/5144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:45 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:45.372347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:45.379306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:45.421845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.422424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.424064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.425389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.426268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.426898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.545996 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:45.550834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Unlocking {{(pid=131449) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 19 01:14:45.726277 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f45cce1-9b40-4d72-a824-86d6307de724 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.373096 Oct 19 01:14:45.734575 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2636/5145] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:45 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:45.774698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:45.775329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:45.801996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.802744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.803579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:45.805093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:45.805720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:45.806927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:46.338371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:46.362499 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-470d0916-ca87-4bb4-aa33-d7fb286f8e81 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.622517 Oct 19 01:14:46.363153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2637/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:45 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:46.403831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:46.406405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:46.427898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:46.428438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:46.428982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:46.429697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:46.430701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:46.431287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:47.074564 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd6f31d1-73cc-4d41-b690-de2ee46c6421 tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action" status: 202 len: 0 microversion: 2.1 time: 7.495495 Oct 19 01:14:47.075756 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2510/5147] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:39 2022] POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action => generated 0 bytes in 7501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:47.085889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:47.086523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:47.112764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:47.114276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:47.116598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:47.119572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:47.121760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:47.125147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:47.413343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:47.427925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-888b7896-3adf-45b3-bc24-b6456ce62d2a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.033879 Oct 19 01:14:47.441792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2638/5148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:46 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:47.454969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:47.456539 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:47.463417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:47.464360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:47.465080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:47.466040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:47.466988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:47.467637 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:47.764152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:47.788067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7eca610-3769-4c57-b775-36cbe750f87e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.707115 Oct 19 01:14:47.797020 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2511/5149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:47 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:14:48.159977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:48.199951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a589100-1535-4824-98e2-7695f0b6ac31 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.749727 Oct 19 01:14:48.204029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2639/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:47 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:48.228500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:48.229123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:48.254219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.255016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.258630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:48.260565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.263522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.265472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:48.355713 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:48.449174 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2da344d7-452b-4ec1-ad5c-003eacf8f87e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.224614 Oct 19 01:14:48.450647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2512/5151] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:48 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:14:48.468656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:48.470591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:48.478858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.481373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.489544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:48.491111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.491828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.492817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:48.834936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:48.844470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:48.870947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.871450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.871994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:48.872755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:48.873221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:48.873660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:49.575311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:49.622758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-471c699a-1ea3-43c9-b078-d81bffa3f0c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1674 microversion: 2.1 time: 1.161213 Oct 19 01:14:49.623446 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2640/5152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:48 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1674 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:50.247805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:50.261435 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c61fbc37-1d48-4417-a44f-919d15b1bb3a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 1.430657 Oct 19 01:14:50.264033 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2513/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:48 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:50.653047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:50.654123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:50.674745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:50.681155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:50.681704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:50.689218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:50.689708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:50.693044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:51.140400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "name": "network-vif-unplugged", "status": "completed", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:51.173164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:51.174267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:51.179959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:51.214969 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] Creating event network-vif-unplugged:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h2-master-1 Oct 19 01:14:51.225630 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-39533d00-52ad-4285-95b5-4cf93a59fc65 req-a88dcd14-c90c-44b3-b6f8-d8484c2baa89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.605536 Oct 19 01:14:51.227997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2641/5154] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:51.293634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:51.294358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:51.307107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:51.308763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:51.309597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:51.311345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:51.312347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:51.312844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:51.735913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:51.754699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12302164-1aff-485e-afb7-4343190625c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1654 microversion: 2.1 time: 1.107560 Oct 19 01:14:51.769503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2514/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:50 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1654 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:51.796224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:51.800519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:51.816547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:51.817325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:51.818749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:51.820346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:51.823434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:51.824568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:52.041415 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-873cb169-5cdf-4550-a918-242418c7ef67 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.250411 Oct 19 01:14:52.046525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2515/5156] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:14:51 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:14:52.064999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:52.066144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:52.080364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:52.081914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:52.083123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:52.104475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:52.105161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:52.105746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:52.214515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:52.229991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f323c79-197a-45af-8fff-32bd26787c3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.940967 Oct 19 01:14:52.231133 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2642/5157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:51 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:52.771671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:52.797677 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9dc2eb39-9ad9-4afc-a45b-0c303cfda09e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1661 microversion: 2.1 time: 0.739272 Oct 19 01:14:52.799477 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2516/5158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:52 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1661 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:53.263359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:53.263987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:53.273967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:14:53.302714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:53.303440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:53.308213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:53.312501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:53.313199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:53.314751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:53.316652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:53.318741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:53.320739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:53.375901 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] Creating event network-changed:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h2-master-1 Oct 19 01:14:53.390955 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ab9cb41e-3bc7-4baa-b5ad-bbb29c02f34f req-83bd0e6d-1745-43d9-9ca2-55d7cff654c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122628 Oct 19 01:14:53.398013 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2517/5159] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:14:53.699839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:53.724107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b7a8ea26-72e4-405d-941d-474be67cd049 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.465990 Oct 19 01:14:53.751810 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2643/5160] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:53 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:53.835241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:53.836125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:53.865349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:53.880519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:53.880519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:53.885024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:53.885667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:53.887166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:54.582743 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:54.625744 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d043cce5-4c6b-4cc1-8384-aef8ab832695 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.802305 Oct 19 01:14:54.649027 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2518/5161] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:53 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:54.664946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:54.666029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:54.686064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:54.689535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:54.691461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:54.693418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:54.697712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:54.698830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:54.764969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:54.765835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:54.790856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:54.795878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:54.797597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:54.802617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:54.805491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:54.816984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:56.456120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:56.467646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a243484-c767-405e-8d36-9767131cd5aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 1.711915 Oct 19 01:14:56.472790 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2519/5162] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:54 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:56.895540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:56.912577 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-872f403c-3739-46bd-a799-e18ec1760131 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 2.251825 Oct 19 01:14:56.920045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2644/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:54 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 2264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:56.957029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:56.958094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:56.975670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:56.982607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:56.983230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:56.984014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:56.990773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:56.991341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:57.494790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:57.495691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:57.515120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:57.515120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:57.515120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:57.515547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:57.517540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:57.518109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:58.361826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:58.372943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e872687-3b10-4c17-a358-82f230570b7a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.421248 Oct 19 01:14:58.377418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2520/5164] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:56 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:14:58.407344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:14:58.408214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:14:58.421131 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=48 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:14:58.424162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:58.426307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:58.426940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:58.427942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:14:58.428759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:14:58.429742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:14:59.908984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:14:59.927640 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-035747d4-c534-4cac-85eb-b812523cb2f9 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 2.436506 Oct 19 01:14:59.929488 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2645/5165] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:57 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:00.137553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:00.158527 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fee2a20c-fab4-4396-b27d-83b25089b7ac tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.756782 Oct 19 01:15:00.161110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2521/5166] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:14:58 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:00.187871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:00.189000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:00.191799 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:00.205618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:00.213473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:00.214092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:00.216101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:00.216590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:00.217057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:00.976432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:00.977114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:01.033147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:01.036325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:01.039242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:01.040516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:01.043414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:01.057057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:01.334405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:01.351711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-726c2eff-1872-447b-aaff-e5db38308f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.168633 Oct 19 01:15:01.355111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2646/5167] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:00 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:01.382244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:01.383117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:01.398040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:01.400666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:01.403173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:01.405600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:01.407614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:01.408310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:02.828434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:02.848274 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27f38677-cce8-4f78-a62b-81abaf049e92 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 1.472799 Oct 19 01:15:02.851902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:02.861428 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2647/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:01 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:02.872851 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fb87547-fc6e-4fe3-bd4a-6d97f2f5119e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 1.919122 Oct 19 01:15:02.879534 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2522/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:00 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:03.907620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:03.909143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:03.924988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:03.925892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:03.928293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:03.929573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:03.932222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:03.933130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:04.299541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:04.307654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18730ae8-3e18-4df2-a045-92bfd085a1f8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.405328 Oct 19 01:15:04.317309 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2648/5170] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:03 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:05.357715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:05.359121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:05.380558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:05.384965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:05.386983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:05.391858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:05.394994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:05.396558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:05.895481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:05.904232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d16b543-8c36-40e0-a2ab-05e14d5400e4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.562652 Oct 19 01:15:05.925076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2523/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:05 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:06.942816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:06.944867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:06.972512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:06.973552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:06.974484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:06.977777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:06.979846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:06.983465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:07.217640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6852e72-e0e7-404b-887a-b5f2eaee84ed tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Action: 'create', calling method: .version_select at 0x7f2aefe66550>, body: {"keypair": {"name": "tempest-keypair-1636104169", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVV2vp9yhAxdM5Mg8+MFiGNfbdxxwAVqppDD/obr2lOoZM+iv1Rg3/HPdxEXvEq25F1OEzjrhKFdD4QqVweooIyJbOuFjjzVkB2/VCKqnooN+T1hzgSIEapaSXZ0qzX9Q=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:07.280908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d6852e72-e0e7-404b-887a-b5f2eaee84ed tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Getting quotas for project 69300f41e0bb41c191a9576afafccd63. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:15:07.301181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d6852e72-e0e7-404b-887a-b5f2eaee84ed tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Getting quotas for user 4e394c9876db468caaf058abac55f3fc and project 69300f41e0bb41c191a9576afafccd63. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:15:07.397300 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6852e72-e0e7-404b-887a-b5f2eaee84ed tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.172390 Oct 19 01:15:07.408592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2524/5172] 10.222.0.27 () {62 vars in 1200 bytes} [Wed Oct 19 01:15:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 191 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 19 01:15:07.733322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:07.742251 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5eb1ec90-2207-4385-96df-a55acfba6a93 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1690 microversion: 2.1 time: 0.811454 Oct 19 01:15:07.747702 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2649/5173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:06 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1690 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:08.786940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:08.788490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:08.819057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:08.821090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:08.822512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:08.823378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:08.825706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:08.829771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:09.499884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:09.513633 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1190b54b-a0a8-496d-83be-3047d657b66d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1680 microversion: 2.1 time: 0.739406 Oct 19 01:15:09.530860 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2525/5174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:08 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1680 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:09.557231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:09.557882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:09.573511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:09.574013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:09.574453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:09.589379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:09.590509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:09.590974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:09.881351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-993238679", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "bb31c449-332a-439d-bdea-09ef764bb697"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:09.979495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] validate_networks() for [('bb31c449-332a-439d-bdea-09ef764bb697', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:15:10.163632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4519d91d-b90a-412e-b33f-e537b9e67b0e tempest-TestNetworkAdvancedServerOps-833667623 tempest-TestNetworkAdvancedServerOps-833667623-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1831 microversion: 2.1 time: 0.626179 Oct 19 01:15:10.191906 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2526/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:09 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1831 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:10.197144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:10.198176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:10.219540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:10.220155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:10.220672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:10.221443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:10.221949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:10.222393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:10.896679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:10.908323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-069b89e5-446e-49b9-bf65-c0f653be675e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1680 microversion: 2.1 time: 0.711688 Oct 19 01:15:10.926990 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2527/5176] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:10 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1680 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:11.074264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:15:11.074738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:15:11.075348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:15:11.075767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:15:11.076182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:15:11.102519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:11.104901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:11.105632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:11.106612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:11.109474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:11.109936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:11.175788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Getting quotas for project 0e5a9b3a2c314ad0b2b2f40dc8fe15b1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:15:11.189050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Getting quotas for user 677e2e6bd7ce41f682abcfd261b37d60 and project 0e5a9b3a2c314ad0b2b2f40dc8fe15b1. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:15:11.233014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:15:11.235515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:15:11.344732 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e45a90e-db99-4e57-830f-f77d8191ad0b tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.971049 Oct 19 01:15:11.346432 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2650/5177] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:15:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:15:11.366416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-560cd03a-4693-4d67-ba3d-c335c686f9cf tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:11.368000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-560cd03a-4693-4d67-ba3d-c335c686f9cf tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:11.389179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:11.395909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:11.453220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:11.455561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:11.460389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:11.461523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:11.465253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:11.465875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:11.602126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8cb6cdbe-733f-46d8-b34d-13deb16fd61b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action" status: 200 len: 38670 microversion: 2.1 time: 0.225349 Oct 19 01:15:11.603746 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2651/5178] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:11 2022] POST /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788/action => generated 38670 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:15:11.949616 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-560cd03a-4693-4d67-ba3d-c335c686f9cf tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:11.959775 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-560cd03a-4693-4d67-ba3d-c335c686f9cf tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1214 microversion: 2.1 time: 0.603448 Oct 19 01:15:11.980832 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2528/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:11 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1214 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:12.478719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-533343158", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "51c25432-7377-4ac5-addd-4f5c44029915"}, {"port": "7fdcdb21-d41a-4c53-87e1-df1d8c012260", "tag": "port-1"}, {"port": "1ec40a53-8843-457f-8b3f-012ebf6e2066", "tag": "port-2"}, {"uuid": "dab3f413-9eb7-41a1-b043-95d336d7d118", "tag": "net-1"}, {"uuid": "dab3f413-9eb7-41a1-b043-95d336d7d118"}, {"uuid": "2b49863b-4110-4270-bebc-258a629acdb2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2b49863b-4110-4270-bebc-258a629acdb2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "151f9fab-2295-41db-9e6a-d9c7fdea0588", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ac094c76-b6b3-4177-9983-64ceb7e0126e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "adee5717-a624-47da-8ec7-fade8006fc52", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1904323043"}], "key_name": "tempest-keypair-1636104169", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:12.699299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] validate_networks() for [('51c25432-7377-4ac5-addd-4f5c44029915', None, None, None, None, None), (None, None, '7fdcdb21-d41a-4c53-87e1-df1d8c012260', None, None, None), (None, None, '1ec40a53-8843-457f-8b3f-012ebf6e2066', None, None, None), ('dab3f413-9eb7-41a1-b043-95d336d7d118', None, None, None, None, None), ('dab3f413-9eb7-41a1-b043-95d336d7d118', None, None, None, None, None), ('2b49863b-4110-4270-bebc-258a629acdb2', '10.2.2.100', None, None, None, None), ('2b49863b-4110-4270-bebc-258a629acdb2', '10.2.2.200', None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:15:12.993242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:12.994033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:13.021144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:13.021657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:13.022111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:13.028681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:13.036342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:13.039179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:13.155199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:13.173352 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9673e76-f82f-42e3-ba09-90bc37f2682c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1266 microversion: 2.1 time: 0.179341 Oct 19 01:15:13.174417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2529/5180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:12 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:14.202590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:14.204904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:14.218553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:14.219431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:14.220304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:14.221796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:14.222448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:14.223100 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:14.267773 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:14.403581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:14.431452 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20db1220-351e-4022-8d74-548cbc86a10a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1272 microversion: 2.1 time: 0.235630 Oct 19 01:15:14.434493 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2530/5181] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:14 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:15.356269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:15.358020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:15.384770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:15.388614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:15.391707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:15.396554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:15.398757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:15.400572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:15.492312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:15:15.688244 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb64fa98-8fc1-4a8d-a580-e29ef5b8f14f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 204 len: 0 microversion: 2.1 time: 0.342230 Oct 19 01:15:15.692346 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2531/5182] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:15:15 2022] DELETE /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:15:15.700989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:15.730646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:15.731161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:15.731722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:15.791691 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] Creating event network-changed:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h1-master-1 Oct 19 01:15:15.796489 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f3b8d0b8-8803-4efa-98ec-69fb31191cc0 req-0eac7d3e-6915-4de6-b052-b0e1160ed8fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105715 Oct 19 01:15:15.801449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2532/5183] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:15.818600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:15.825126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:15.841837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:15.842350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:15.843217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:15.844816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:15.847265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:15.848725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:17.258396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:17.276361 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93a4f865-0bda-4fa0-b794-64dd21f92813 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 1.473509 Oct 19 01:15:17.277131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2533/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:15 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:17.321704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:17.325746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:17.341727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:17.342782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:17.343241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:17.346250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:17.346735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:17.347179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:18.320126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:18.339291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c62e3614-8834-4b94-872e-b50b5eb94aa1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1686 microversion: 2.1 time: 1.039645 Oct 19 01:15:18.344973 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2534/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:17 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1686 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:18.355438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:18.361266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:18.370054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:18.370506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:18.370961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:18.372183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:18.372678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:18.373144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:18.973533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:18.987867 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18c685db-1959-4654-9a94-bcfbf1227c50 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 0.638628 Oct 19 01:15:18.990930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2535/5186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:18 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:19.367985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:19.368943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:19.384997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:19.386215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:19.387800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:19.388653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:19.390720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:19.391921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:19.712401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:19.732171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d7c05a0-d939-4f27-ba4d-a771fa20cc14 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 200 len: 1501 microversion: 2.1 time: 0.369121 Oct 19 01:15:19.747010 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2536/5187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:19 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 1501 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:19.761044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfc7a33c-4a67-49fc-b435-0f7dd373b788", "name": "network-vif-deleted", "tag": "94f9ebcd-9745-4511-98cf-562b959b660f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:19.784215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:19.788289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:19.789185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:19.821635 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] Creating event network-vif-deleted:94f9ebcd-9745-4511-98cf-562b959b660f for instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 on n-h1-master-1 Oct 19 01:15:19.830660 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-157f777b-7a87-4272-a90c-c38ca910f718 req-6ceb405b-9ed9-4db9-93a9-4c07d949c8c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082277 Oct 19 01:15:19.834866 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2537/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:20.023597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:20.026123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:20.043875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:20.044882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:20.045458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:20.048000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:20.048388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:20.049036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:20.853720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:20.869128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f8bc5ea-1d32-44db-8447-6e2d1fa4a422 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 0.855050 Oct 19 01:15:20.873631 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2538/5189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:20 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:20.895005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:20.899281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: cfc7a33c-4a67-49fc-b435-0f7dd373b788] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:20.920468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:20.921104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:20.924275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:20.926730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:20.927338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:20.929421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:20.971060 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] HTTP exception thrown: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Request method failure captured: Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 HTTP/1.1 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT02PfvuF5FK-lBYAeCKONFvpt4ZHToQuDk2Ar_tRRoKUn6i4vEK-w4vv0Sk1lxhkD_gGcWdlOyz8JKtAAQyEGgNfJq1EbZcdieQDaH9mkE4sZDd0stSc0B369XZ8beaQ5Lc-s6ZeewsCa6jSUIHxJw6m_iVfHGPRK_ACVNpPPcRODpg Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44453298a7d04311bd64354938bf2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}] Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2052fd7bb1ee432cb3ca4ec07698292c Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: exception: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'cfc7a33c-4a67-49fc-b435-0f7dd373b788'} Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:15:20.972900 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:15:20.978926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Returning 404 to user: Instance cfc7a33c-4a67-49fc-b435-0f7dd373b788 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:15:20.980693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-073e8704-c684-4932-b6f9-fd48840528a4 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788" status: 404 len: 111 microversion: 2.1 time: 0.087924 Oct 19 01:15:20.985857 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2539/5190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:20 2022] GET /compute/v2.1/servers/cfc7a33c-4a67-49fc-b435-0f7dd373b788 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:15:21.133554 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:21.215192 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:21.527084 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=88 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:21.865950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a6bc55-8abe-4879-ae27-1afa1015737d", "tag": "09645820-f786-47e6-b89b-43f3dc66396a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:21.889411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:21.889819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:21.890839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:21.932904 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] Creating event network-changed:09645820-f786-47e6-b89b-43f3dc66396a for instance 58a6bc55-8abe-4879-ae27-1afa1015737d on n-h2-master-1 Oct 19 01:15:21.939122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-32c73525-37fb-49d6-8a09-d439709fe663 req-a234e23e-56eb-4ea1-997d-34a8af1166c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079882 Oct 19 01:15:21.940589 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2540/5191] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:21.946513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:21.947460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:21.959863 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:21.965965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:21.971595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:21.972382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:21.973336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:21.974128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:21.974767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:21.978287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:15:21.978719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:15:21.979199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:15:21.979616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:15:21.980430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:15:21.995251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:21.995750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:21.996224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:22.009115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:22.009765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:22.010234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:22.051044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Getting quotas for project 69300f41e0bb41c191a9576afafccd63. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:15:22.067588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Getting quotas for user 4e394c9876db468caaf058abac55f3fc and project 69300f41e0bb41c191a9576afafccd63. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:15:22.303282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:15:22.307181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='151f9fab-2295-41db-9e6a-d9c7fdea0588',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ac094c76-b6b3-4177-9983-64ceb7e0126e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adee5717-a624-47da-8ec7-fade8006fc52',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:15:22.437853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:22.454604 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8478f17c-a702-415c-abb3-b9ced6d0ff91 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 0.512320 Oct 19 01:15:22.460247 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2541/5192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:21 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:22.849759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6520c632-4485-492b-a5e8-40d0b459f37f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 10.391499 Oct 19 01:15:22.856711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2652/5193] 10.222.0.27 () {62 vars in 1189 bytes} [Wed Oct 19 01:15:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 10395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:15:22.863405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:22.864052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:23.072359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:23.085125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:23.104216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:23.106550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ca39fcc-f5d1-44ef-9d44-bdb4a2829051 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1285 microversion: 2.42 time: 0.248503 Oct 19 01:15:23.111508 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2542/5194] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:22 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:23.163395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:23.166680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:23.184396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.189915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.191662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:23.192657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.193228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.193797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:23.367142 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-942c094c-6cda-4766-8d84-7b4e749c3374 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.206807 Oct 19 01:15:23.369206 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2653/5195] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:23 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:23.377921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:23.378562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:23.392155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.392944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.395215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:23.396157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.398580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.399249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:23.504571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:23.505244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:23.513208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.514370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.514993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:23.516684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:23.518316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:23.519575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:24.241716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:24.252806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03dc02bf-2696-47f8-9d20-29b1aa1ee62b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1671 microversion: 2.1 time: 0.879487 Oct 19 01:15:24.255313 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2543/5196] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:23 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1671 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:24.274053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:24.274053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:24.294040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:24.296169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:24.314332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:24.317351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:24.321608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:24.324960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:24.602858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:24.614329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-936110fb-4bac-423f-a034-6a9831ed9d0f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 1.127985 Oct 19 01:15:24.614952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2654/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:23 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:24.652952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:24.694086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:24.695559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:24.710681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-002ba549-6a5b-48f0-b867-e1dd3856aca0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1519 microversion: 2.42 time: 0.440260 Oct 19 01:15:24.711600 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2544/5198] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:24 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:25.279116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:25.280104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:25.297716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:25.299628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:25.300386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:25.303238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:25.304744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:25.306467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:25.578274 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:15:25.578512 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:15:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e (ip 10.222.0.27) !!! Oct 19 01:15:25.647331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:25.648554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:25.664502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:25.665351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:25.665974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:25.666872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:25.667510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:25.668116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:26.023510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:26.031848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b77f242f-fb34-45d5-b7d0-7877b15f4b5e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 0.388137 Oct 19 01:15:26.032391 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2545/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:25 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:26.063823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:26.064465 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:26.080411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:26.109871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:26.110381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:26.110834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:26.111563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:26.112283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54ca7b2e-2843-4866-afff-ad7c5786f706 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1671 microversion: 2.1 time: 0.833328 Oct 19 01:15:26.113036 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2655/5200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:25 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1671 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:26.113325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:26.113870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:26.235664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:26.256740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:26.258224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:26.259442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f470001-9015-4e6a-94a5-15118566fa39 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1593 microversion: 2.42 time: 0.226071 Oct 19 01:15:26.260019 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2546/5201] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:26 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1593 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:27.058602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:27.060175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:27.077080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.083966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.112469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:27.116034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.118153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.121091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:27.140825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:27.143129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:27.172084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.176321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.177140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:27.185741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.191036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.194257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:27.883986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:27.894656 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6848e5cc-68ce-4d21-b238-f21f37a8a697 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1671 microversion: 2.1 time: 0.759132 Oct 19 01:15:27.896223 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2547/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:27 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1671 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:27.919581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:27.922835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:27.957583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.958251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.962922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:27.970383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:27.972349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:27.976042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:28.185611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:28.195844 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa11e3e5-2c37-48b8-a4ba-e241f3ab4b70 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 1.141038 Oct 19 01:15:28.197013 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2656/5203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:27 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:28.257430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:28.278822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:28.282557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:28.284185 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18874bd1-a1d8-432a-9997-b418fed38853 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1593 microversion: 2.42 time: 0.386658 Oct 19 01:15:28.289589 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2548/5204] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:27 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1593 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:28.548878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6bc55-8abe-4879-ae27-1afa1015737d", "name": "network-vif-plugged", "status": "completed", "tag": "09645820-f786-47e6-b89b-43f3dc66396a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:28.565648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:28.566487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:28.567202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:28.610546 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] Creating event network-vif-plugged:09645820-f786-47e6-b89b-43f3dc66396a for instance 58a6bc55-8abe-4879-ae27-1afa1015737d on n-h2-master-1 Oct 19 01:15:28.625513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1c602ac2-9d67-426b-bf45-6da4efb0478d req-5b404183-c3a8-43d3-84c9-3b8ab1c4c779 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426208 Oct 19 01:15:28.629430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2657/5205] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:28.924440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:28.926047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:28.931911 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:28.960441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:28.963875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:28.965760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:28.973463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:28.974427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:28.975441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:29.087145 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:29.221495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:29.223016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:29.243999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:29.245531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:29.252397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:29.253937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:29.269535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:29.271690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:29.321461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:29.333094 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68e99939-80bf-4904-b61c-2bcda67977d8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.415071 Oct 19 01:15:29.333754 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2549/5206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:28 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:29.359904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:29.360123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:29.366893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:29.367953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:29.368601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:29.369768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:29.370545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:29.371207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:29.483295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:29.496926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:29.500012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:29.503854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7dfe8354-c05c-4e9c-8872-588d0eeb4c67 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1593 microversion: 2.42 time: 0.154478 Oct 19 01:15:29.505086 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2550/5207] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:29 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:29.577989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:29.592337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8485e9a6-52df-4204-8a2e-807e3b415d2f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1314 microversion: 2.1 time: 0.375829 Oct 19 01:15:29.593417 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2658/5208] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:29 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:30.536488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:30.538286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:30.566877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:30.568212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:30.571615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:30.581376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:30.582217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:30.583004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:30.620260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:30.620948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:30.624426 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:30.647026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:30.657493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:30.661123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:30.670952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:30.675311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:30.676007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:31.200480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:31.216985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:31.223623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:31.225262 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e074fbf-806c-4354-a3c4-321ef01af073 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1661 microversion: 2.42 time: 0.695607 Oct 19 01:15:31.226398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2551/5209] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:30 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1661 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:31.278213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:31.290245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5457a07d-b027-463c-a420-996d9900dc00 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1499 microversion: 2.1 time: 0.675197 Oct 19 01:15:31.291278 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2659/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:30 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1499 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:31.316551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:31.317135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:31.325084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:31.325728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:31.326469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:31.327457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:31.328040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:31.328585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:31.870194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:31.899891 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-135db362-edbe-49bb-bf2a-6749cb855d0a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1499 microversion: 2.1 time: 0.588067 Oct 19 01:15:31.901358 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2552/5211] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:31 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1499 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:31.925237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:31.926401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:31.944320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:31.948351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:31.952461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:31.954101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:31.960862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:31.962784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:32.027712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lazy-loading 'flavor' on Instance uuid 58a6bc55-8abe-4879-ae27-1afa1015737d {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:15:32.053550 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:32.122075 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:32.158357 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a56af6f-4345-4ae1-8b6e-a6b43171c6d9 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action" status: 202 len: 0 microversion: 2.1 time: 0.236138 Oct 19 01:15:32.159048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2660/5212] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:31 2022] POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:32.176021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:32.176709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:32.198023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:32.198581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:32.199055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:32.207887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:32.208493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:32.208994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:32.253767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:32.255335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:32.286705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:32.288969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:32.289611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:32.290547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:32.293646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:32.294310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:32.834870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:32.849860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:32.851682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:32.853073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7bb92583-0810-4572-8247-92a3a37bb5c2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1708 microversion: 2.42 time: 0.605172 Oct 19 01:15:32.864899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2661/5213] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:32 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1708 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:32.875244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:32.898424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19e3ec4d-9924-48bf-a2b0-c6f00c6a403e tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1507 microversion: 2.1 time: 0.731557 Oct 19 01:15:32.901365 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2553/5214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:32 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1507 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:33.076390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-962f10f1-f7e8-46d0-9c3a-a6e21bc9f965 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '.version_select at 0x7f2aefbb0b80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:33.133212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-962f10f1-f7e8-46d0-9c3a-a6e21bc9f965 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-966763161" status: 202 len: 0 microversion: 2.1 time: 0.062663 Oct 19 01:15:33.151133 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2662/5215] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 01:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-966763161 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:33.178808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97e1c795-3107-4ac4-a0e4-5365d8c6e343 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: .version_select at 0x7f2af486a820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1389011479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXPUdwHoqTPreQFQ4CiN482buPAZJnbhjh0ppkSDKaQ+STFB4toiCqhCbCOLyGbjkeaX3HVkCRXdzPRxPm96MBTSto5kASOodmXwFHBLuq+GUs/J83fNS+7Cb83gIxxsg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:33.192216 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:33.214659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-97e1c795-3107-4ac4-a0e4-5365d8c6e343 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:15:33.225306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-97e1c795-3107-4ac4-a0e4-5365d8c6e343 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:15:33.278048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97e1c795-3107-4ac4-a0e4-5365d8c6e343 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.102797 Oct 19 01:15:33.279621 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2554/5216] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:15:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:15:33.892355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:33.893406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:33.915595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:33.916303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:33.916908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:33.918005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:33.918642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:33.919278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:33.926742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:33.927628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:33.940301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:33.940873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:33.941372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:33.942126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:33.945420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:33.945905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:34.313534 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:34.333995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:34.338583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:34.350527 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee8e3d7b-4842-4dfd-97ee-9117e5ea071f tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1490 microversion: 2.1 time: 0.430823 Oct 19 01:15:34.353921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:34.356785 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e198d1e4-a3bc-4d86-97b1-6af25a0843d5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1755 microversion: 2.42 time: 0.468755 Oct 19 01:15:34.357940 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2555/5217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:33 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1490 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:34.359242 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2663/5218] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:33 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1755 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:34.379298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:34.379885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:34.387053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:34.387568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:34.388347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:34.389385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:34.389950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:34.390490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:34.501693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c83a4a85-cae5-42ff-93f5-53afeca40c65 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action" status: 202 len: 0 microversion: 2.1 time: 0.126943 Oct 19 01:15:34.503738 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2556/5219] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:34 2022] POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:34.518592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:34.519649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:34.544281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:34.549105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:34.549623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:34.554968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:34.555518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:34.556050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:35.082366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:35.105041 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-081f4864-a6e9-43dd-bc23-a52ac2537470 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1496 microversion: 2.1 time: 0.597746 Oct 19 01:15:35.120757 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2664/5220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:34 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1496 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:35.385856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:35.386954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:35.397714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:35.398555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:35.399257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:35.400171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:35.400910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:35.401594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:35.926750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:35.955186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:35.956974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:35.958397 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b2d427d-d253-4e16-9a09-f4fc114bee58 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1802 microversion: 2.42 time: 0.577236 Oct 19 01:15:35.966787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2557/5221] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:35 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1802 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:36.129156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:36.130510 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:36.138785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:36.140235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:36.141118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:36.141546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:36.142338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:36.142882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:36.298061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:36.306146 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a35b132-4ee0-49ad-bceb-f01375c58ac3 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1496 microversion: 2.1 time: 0.181828 Oct 19 01:15:36.307136 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2665/5222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:36 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1496 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:36.999975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:37.001280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:37.019117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.020603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.023041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.024076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.027204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.028634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.330541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:37.331175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:37.345473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.345980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.346429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.347927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.348399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.348869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.412417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:37.425294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:37.426753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:37.427943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aca506d9-f16a-4163-84b3-e4f0cd449090 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1849 microversion: 2.42 time: 0.435224 Oct 19 01:15:37.428510 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2558/5223] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:36 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1849 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:37.712145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:37.728081 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1c492f2d-ba23-458f-914b-2ff71f6bfa23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1499 microversion: 2.1 time: 0.402127 Oct 19 01:15:37.730973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2666/5224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:37 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1499 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:37.754962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:37.755520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:37.771469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.775636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.776101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.776895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.781256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.781933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.822411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lazy-loading 'flavor' on Instance uuid 58a6bc55-8abe-4879-ae27-1afa1015737d {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:15:37.910328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3859733c-fd30-4296-b029-d101b6ddbc88 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action" status: 202 len: 0 microversion: 2.1 time: 0.160627 Oct 19 01:15:37.912106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2559/5225] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:37 2022] POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:37.928005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:37.929123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:37.943812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.944948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.945778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:37.947572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:37.948538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:37.950318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:38.215343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:38.229286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03a77797-272c-4d66-8dd2-a5350f58625c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1507 microversion: 2.1 time: 0.311355 Oct 19 01:15:38.230799 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2667/5226] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:37 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:38.467951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:38.471901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:38.525189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:38.526427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:38.527057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:38.529113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:38.529842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:38.537059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:38.806723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:38.824746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:38.829034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:38.832158 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0bb0671-0b6d-40e9-be89-b015c0f7bde5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1849 microversion: 2.42 time: 0.379099 Oct 19 01:15:38.852802 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2560/5227] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:38 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1849 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:39.253874 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:39.255552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:39.262717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.263464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.264092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.265571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.266203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.266805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.271491 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:39.544455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:39.568948 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ab5aff4e-e7e1-4853-9692-652f8ba6602a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1490 microversion: 2.1 time: 0.318660 Oct 19 01:15:39.570188 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2668/5228] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:39 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1490 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:39.601048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:39.603515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:39.617412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.618252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.619465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.621271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.622094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.623945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.652866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "be8d70e8-a6b0-4676-8c91-f9675b669fb9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:39.675867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.676273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.679015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.708114 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] Creating event network-changed:be8d70e8-a6b0-4676-8c91-f9675b669fb9 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:39.723341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a6e0a1a1-568a-4e3b-9ec6-5246ca62b710 req-eaf21f0e-8bb8-4ac6-aa2c-861200b23178 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071950 Oct 19 01:15:39.725399 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2669/5229] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:39.805716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd2ea6da-dacd-44ec-9b56-e02c301a800a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action" status: 202 len: 0 microversion: 2.1 time: 0.214289 Oct 19 01:15:39.809193 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2561/5230] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:15:39 2022] POST /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:15:39.819348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:39.821214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:39.832863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.833365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.833801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.834721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.835348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.835939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.871764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:39.872733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:39.890482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.892255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.893120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:39.894237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:39.895944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:39.896977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:40.931863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:40.947126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b5b0de0-3929-4c01-a8aa-65fbcecccf23 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1496 microversion: 2.1 time: 1.133209 Oct 19 01:15:40.960663 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2670/5231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:39 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1496 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:15:41.017251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:41.029670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:41.031695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:41.032913 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-13ef40d9-0e28-4d77-9d90-1c8df823705c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1849 microversion: 2.42 time: 1.172394 Oct 19 01:15:41.039692 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2562/5232] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:39 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1849 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:41.820502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "7fdcdb21-d41a-4c53-87e1-df1d8c012260"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:41.846832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:41.847348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:41.847795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:41.872028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] Creating event network-changed:7fdcdb21-d41a-4c53-87e1-df1d8c012260 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:41.884566 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-684c357a-cb1f-42ce-b827-6a52be1e779b req-3f01d30f-66c3-4dd1-b8ea-1b960887d371 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070761 Oct 19 01:15:41.885221 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2671/5233] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:41.980202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:41.980867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:41.992985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:41.993491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:41.993940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:41.994663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:41.995129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:41.995565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:42.021597 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:42.063193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:42.063906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:42.080485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:42.087625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:42.088033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:42.088843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:42.095081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:42.095635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:42.678009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:42.686711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-600e091f-2808-4319-877d-bda4c3fa2a8d tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1496 microversion: 2.1 time: 0.710461 Oct 19 01:15:42.687315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2563/5234] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:41 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1496 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:42.957957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:42.972441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:42.976864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:42.980504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-678e1dd0-7c81-484b-8158-eddebb49da7a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1870 microversion: 2.42 time: 0.919568 Oct 19 01:15:42.981352 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2672/5235] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:42 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1870 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:43.711540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:43.713016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:43.726619 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:15:43.728246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:43.735260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:43.736002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:43.736981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:43.737750 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:43.738388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.008830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:44.009933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:44.039039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.041864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.044106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.045212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.046761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.050728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.113421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:44.123329 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c404a78-706c-4a48-8bba-20eb607a979a tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1499 microversion: 2.1 time: 0.416267 Oct 19 01:15:44.133164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2564/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:43 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1499 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:44.152683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:44.153462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:44.172335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.173140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.174168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.175387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.177611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.178705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.236199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:15:44.401323 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-adad4509-8d37-4ad8-aedc-66facc966258 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "DELETE /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 204 len: 0 microversion: 2.1 time: 0.253040 Oct 19 01:15:44.406854 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2565/5237] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:15:44 2022] DELETE /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:15:44.417452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "1ec40a53-8843-457f-8b3f-012ebf6e2066"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:44.439469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.440312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.440888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.476934 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] Creating event network-changed:1ec40a53-8843-457f-8b3f-012ebf6e2066 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:44.484140 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e0180257-1e13-46f3-9852-3eccb00a09ea req-96aec6e2-bb07-4484-b4be-78ea6cfacc1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075210 Oct 19 01:15:44.485548 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2566/5238] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:44.494537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:44.495535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:44.503770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.504681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.505373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.506317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:44.506998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:44.507674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:44.595702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:44.607502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:44.610266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:44.611779 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-72493044-22fa-48cf-98c4-b4b6d9dc8a9c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1891 microversion: 2.42 time: 0.608357 Oct 19 01:15:44.613752 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2673/5239] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:44 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1891 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:45.400226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:45.423099 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b653de37-721e-4f3d-87a4-d4a29a237221 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1505 microversion: 2.1 time: 0.935996 Oct 19 01:15:45.423706 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2567/5240] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:44 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1505 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:45.649328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:45.649981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:45.659417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:45.659920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:45.660513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:45.661316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:45.661776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:45.662206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:46.066531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:46.089957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:46.091651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:46.100096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d5cd9d6-1970-469a-aa98-3024b1cc4ca6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1891 microversion: 2.42 time: 0.461540 Oct 19 01:15:46.114157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2674/5241] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:45 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1891 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:46.454778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:46.456025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:46.467987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:46.468509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:46.469278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:46.469716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:46.481296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:46.482124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:47.132337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:47.132977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:47.145373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:47.145861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:47.148512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:47.150036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:47.152595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:47.153292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:47.552854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:47.563276 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45ed6c71-d091-4672-bf5b-a7b88475be19 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1505 microversion: 2.1 time: 1.112989 Oct 19 01:15:47.569343 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2568/5242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:46 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1505 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:48.026972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "288f1f37-4462-495e-a087-09267a50a989"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:48.074925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:48.075443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:48.075901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:48.125392 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] Creating event network-changed:288f1f37-4462-495e-a087-09267a50a989 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:48.137741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-760fe4f4-1891-43c0-af92-1eea1db80572 req-d57128a0-ac25-4018-a4f1-b198c86def03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116955 Oct 19 01:15:48.142989 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2569/5243] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:15:48.601777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:48.603390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:48.640068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:48.640572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:48.641054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:48.641892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:48.642411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:48.643500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:48.980750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677e2e6bd7ce41f682abcfd261b37d60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e5a9b3a2c314ad0b2b2f40dc8fe15b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:48.989497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6618a98c-f70d-4511-92cf-62323e900d5c tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 200 len: 1463 microversion: 2.1 time: 0.393169 Oct 19 01:15:49.010011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2570/5244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:48 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 1463 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:49.423930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:49.455574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:49.459932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:49.463500 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-206f3e43-246b-48ed-b4eb-e3c02d67fcf9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1891 microversion: 2.42 time: 2.334265 Oct 19 01:15:49.464408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2675/5245] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:47 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1891 bytes in 2337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:49.653789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6bc55-8abe-4879-ae27-1afa1015737d", "name": "network-vif-deleted", "tag": "09645820-f786-47e6-b89b-43f3dc66396a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:49.673449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:49.673866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:49.674315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:49.717789 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] Creating event network-vif-deleted:09645820-f786-47e6-b89b-43f3dc66396a for instance 58a6bc55-8abe-4879-ae27-1afa1015737d on n-h2-master-1 Oct 19 01:15:49.723986 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2c9e2215-926d-422c-9bf1-ba2d06274abf req-af866871-bae2-4eec-b4a0-33129e0646a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421886 Oct 19 01:15:49.725658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2571/5246] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:50.018349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:50.018982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] [instance: 58a6bc55-8abe-4879-ae27-1afa1015737d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:50.028128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:50.028937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:50.029694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:50.030771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:50.031468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:50.032126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:50.055415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] HTTP exception thrown: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Request method failure captured: Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d HTTP/1.1 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0-Z57-ckwzdKxVyTgr3A3Owcclt1v5WoebBDpybJflYTaQE3GkFbEnZHIPzUkIwSToJg1j6uS9eTTER2x4m97pNegjcWsJzqBKhTZzzgOoX3E-tYDqp0XvpLIMJ-H90vW4CWCpQNidgRyYCPzfbqSPDPMvnxekYnTHv9_T7UMkvVzI Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 0e5a9b3a2c314ad0b2b2f40dc8fe15b1 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestServerAdvancedOps-1624472077 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0e5a9b3a2c314ad0b2b2f40dc8fe15b1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e5a9b3a2c314ad0b2b2f40dc8fe15b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0e5a9b3a2c314ad0b2b2f40dc8fe15b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0e5a9b3a2c314ad0b2b2f40dc8fe15b1"}]}] Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestServerAdvancedOps-1624472077 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 0e5a9b3a2c314ad0b2b2f40dc8fe15b1 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestServerAdvancedOps-1624472077 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestServerAdvancedOps-1624472077-project Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 677e2e6bd7ce41f682abcfd261b37d60 Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestServerAdvancedOps-1624472077-project Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '58a6bc55-8abe-4879-ae27-1afa1015737d'} Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:15:50.057465 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. Oct 19 01:15:50.063213 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:15:50.066051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] Returning 404 to user: Instance 58a6bc55-8abe-4879-ae27-1afa1015737d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:15:50.067199 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1530482-b4ed-4749-b689-7613c0f428c7 tempest-TestServerAdvancedOps-1624472077 tempest-TestServerAdvancedOps-1624472077-project] 10.222.0.27 "GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d" status: 404 len: 111 microversion: 2.1 time: 0.053712 Oct 19 01:15:50.068338 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2676/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:50 2022] GET /compute/v2.1/servers/58a6bc55-8abe-4879-ae27-1afa1015737d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:15:50.496503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:50.497990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:50.510069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:50.510894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:50.512110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:50.513491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:50.514850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:50.515461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:51.678234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "a1606c90-698d-4440-9cc4-179ab1a91d6a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:51.715674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:51.721736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:51.723101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:51.759622 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] Creating event network-changed:a1606c90-698d-4440-9cc4-179ab1a91d6a for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:51.790955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5287e02b-ca7c-4b87-b6bc-31b9f7c433aa req-b226e367-5028-4ad0-890e-83ef47473d63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105512 Oct 19 01:15:51.791962 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2677/5248] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:51.895938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1250445527", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "5723029a-a686-4dbb-8776-47380f6f2f25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1389011479", "security_groups": [{"name": "tempest-secgroup-smoke-694253479"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:52.293499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:52.320154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:52.322003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:52.325928 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e720651-4ad5-430c-80fb-05d5bdbe0795 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.837319 Oct 19 01:15:52.327985 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2572/5249] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:50 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:52.577045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] validate_networks() for [('5723029a-a686-4dbb-8776-47380f6f2f25', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:15:53.359131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:53.359748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:53.372320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:53.385464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:53.385935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:53.386700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:53.387169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:53.387610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:54.315567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:54.328506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:54.330784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:54.333072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cccc859d-0b20-4b4b-86ba-05580b86b6fd tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.978559 Oct 19 01:15:54.334228 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2573/5250] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:53 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:15:54.341168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "b05dfb85-2b5a-4266-a9b8-1d80808f0283"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:54.371199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:54.372513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:54.373944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:54.392480 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] Creating event network-changed:b05dfb85-2b5a-4266-a9b8-1d80808f0283 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:54.410515 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6b468dac-e806-4cb5-80d3-e0430f9c2b77 req-09996732-b366-4169-b31b-4703ba88eca9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074312 Oct 19 01:15:54.412297 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2574/5251] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:54.602755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:15:54.603318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:15:54.603980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:15:54.604714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:15:54.605341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:15:54.618620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:54.619398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:54.620048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:54.621013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:54.621522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:54.621899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:54.648406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:15:54.658808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Getting quotas for user 2052fd7bb1ee432cb3ca4ec07698292c and project 44453298a7d04311bd64354938bf2431. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:15:54.676863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:15:54.679348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:15:54.780401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e1e5215-04b8-43bc-b284-e67634392bc5 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.890820 Oct 19 01:15:54.788696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2678/5252] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:15:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:15:54.798291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d12c18f5-97e5-4f3f-aec5-0d6ea6ea8019 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:54.799000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d12c18f5-97e5-4f3f-aec5-0d6ea6ea8019 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:55.287561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d12c18f5-97e5-4f3f-aec5-0d6ea6ea8019 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:55.297807 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d12c18f5-97e5-4f3f-aec5-0d6ea6ea8019 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1267 microversion: 2.1 time: 0.504339 Oct 19 01:15:55.299265 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2575/5253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:54 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1267 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:55.363002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:55.363712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:55.385986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:55.386885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:55.387591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:55.388803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:55.389481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:55.390116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:55.969129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:56.000383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:56.002075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:56.003329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c90adce8-086d-46e8-86c3-67ad40bf0533 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.644409 Oct 19 01:15:56.020438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2679/5254] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:55 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:56.329166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:56.330068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:56.345346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:56.345858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:56.346302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:56.347021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:56.353457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:56.354079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:56.466061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:56.476906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f6ab11a-fed7-488e-9199-d5e4789d9309 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1319 microversion: 2.1 time: 0.153923 Oct 19 01:15:56.477900 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2576/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:56 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:56.532470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "c81f4fac-56a4-4297-9a43-94b12f2107a4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:15:56.555227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:56.555866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:56.556874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:56.589900 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] Creating event network-changed:c81f4fac-56a4-4297-9a43-94b12f2107a4 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:15:56.608216 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f5792521-a37c-42f5-aae2-f7d1e57faa12 req-469146c1-abe7-4bef-816c-c3789f3b7e4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081532 Oct 19 01:15:56.609214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2680/5256] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:15:57.036854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:57.039762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:57.059144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:57.059711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:57.062105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:57.064017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:57.064966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:57.066545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:57.493523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:57.507003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:57.516426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:57.516710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:57.517372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:57.518649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2563faa0-c1d0-459e-b2b5-7ef0c833d331 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.489493 Oct 19 01:15:57.519740 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2577/5257] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:57 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:57.555625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:57.556418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:57.558511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:57.559721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:57.561480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:57.562379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:57.726390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:57.738521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df1bf994-5177-47af-b4f4-45377c92a495 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1325 microversion: 2.1 time: 0.228462 Oct 19 01:15:57.754015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2681/5258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:57 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:15:58.552861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:58.553439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:58.566045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:58.566678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:58.567397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:58.568207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:58.569166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:58.569809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:58.769453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:15:58.770111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:15:58.778053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:58.778484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:58.779010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:58.780325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:15:58.780491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:15:58.786512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:15:59.249497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:59.267467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:59.270539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:59.271753 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4966547c-204f-47ec-9096-347e8b5b8f9a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.724688 Oct 19 01:15:59.284698 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2578/5259] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:15:58 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:15:59.392463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:15:59.407054 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3fa2c1a8-810c-4a20-8d4e-e63c31434cf1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.638675 Oct 19 01:15:59.407635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2682/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:15:58 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:00.311315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:00.311943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:00.328543 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:00.330010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:00.330862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:00.331710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:00.332784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:00.333429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:00.334032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:00.433184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:00.433821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:00.441536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:00.442372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:00.443413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:00.444651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:00.445482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:00.446196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:01.251606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:01.260152 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3321332-719b-46c0-a270-a183616c25aa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.830850 Oct 19 01:16:01.274454 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2683/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:00 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:01.298906 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:01.309014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:01.311141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:01.312209 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e0333da-efb9-4ddd-b6d9-9503963fe25f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.004906 Oct 19 01:16:01.313129 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2579/5262] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:00 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:01.935088 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:01.946803 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:01.949956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:01.951512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:01.952231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:01.968608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] Creating event network-changed:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:16:01.975233 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3c052287-e422-4af8-bb58-c7dcfa2a0c55 req-78465770-2fc2-4389-b563-d4dcd7ec3aee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045277 Oct 19 01:16:01.976675 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2684/5263] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:02.288655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:02.289453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:02.297863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:02.298507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:02.299206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:02.300113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:02.300584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:02.301048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:02.346729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:02.348182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:02.364629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:02.365141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:02.365580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:02.366572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:02.367151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:02.367575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:02.687235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:02.695524 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d76fb84f-cdf5-4c4e-8d2a-24f508f97fc8 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.411940 Oct 19 01:16:02.708642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2580/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:02 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:02.865321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:02.876067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:02.878048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:02.879543 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-66941056-3f44-48b7-869d-4049951260f4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.544580 Oct 19 01:16:02.893149 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2685/5265] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:02 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:03.723369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:03.723913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:03.732235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:03.733216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:03.733874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:03.734798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:03.735560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:03.736210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:03.929959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:03.932832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:03.947955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:03.949977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:03.950698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:03.952188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:03.953686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:03.954389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:04.345421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:04.350784 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:04.361509 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d03ae0a-6c78-414c-871d-45b4b13d640b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.643301 Oct 19 01:16:04.362715 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2581/5266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:03 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:04.544479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:04.546959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:04.558063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:04.558928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:04.560570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:04.561640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:04.562590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:04.563312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:04.637527 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:04.670723 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:04.947875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:04.959897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:04.961845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:04.963325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-acfac0d1-f6b3-496a-a114-0e5ee0361660 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.055244 Oct 19 01:16:04.964766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2686/5267] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:03 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:05.296968 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:05.335339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:05.347788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee2a2fd1-b595-435a-aab4-75a727f61d48 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.809004 Oct 19 01:16:05.361500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2582/5268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:04 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:05.375971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:05.376670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:05.385403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:05.385984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.386136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:05.386608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.387104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.387832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.388500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.389152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.394400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.394899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.395556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.396745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.397372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.397962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.855487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:05.861049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:05.878172 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8862f8dd-517c-44fa-a032-4e4ac9b2edfd tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.507089 Oct 19 01:16:05.882289 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2687/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:05 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:05.882878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cbcbdc55-7ed3-484c-8b02-93d16190da17 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.499965 Oct 19 01:16:05.899641 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2583/5270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:05 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:05.905603 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:05.906498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:05.914006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.914723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.915372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.916099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:05.916564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:05.917025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:05.991912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:05.993353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:06.002488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.003299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.004380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:06.005379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.006167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.006811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:06.097976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:06.106525 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b64b4717-7bfc-4dbc-8a5f-b21dd982e9e4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.205307 Oct 19 01:16:06.108325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2688/5271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:05 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:06.131320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:06.132183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:06.139281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.140032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.140879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:06.141853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.142513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.143283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:06.164423 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:06.341979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:06.363005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:06.368014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:06.369802 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66bea29f-c47b-440a-985c-2b4d1523dba6 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.383207 Oct 19 01:16:06.373745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:06.383712 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2584/5272] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:05 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:06.389371 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2306539a-1b69-4a1a-9cd2-f5aee3045079 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.262117 Oct 19 01:16:06.390161 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2689/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:06 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:06.513978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1348309069", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "69976232-9b57-4354-be5a-f2d785e4a03d"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:06.575144 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] validate_networks() for [('69976232-9b57-4354-be5a-f2d785e4a03d', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:16:06.907527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:06.908059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:06.914942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.915430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.916175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:06.917013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:06.917694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:06.918130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.034010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:16:07.034604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:16:07.035765 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:16:07.036221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:16:07.036799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:16:07.056954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:07.059047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:07.059561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.060406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:07.061334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:07.061835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.083846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:16:07.093190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:16:07.095333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:07.103704 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03ae1b68-b0a3-4fb8-8944-f89808fc8d04 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.201521 Oct 19 01:16:07.104395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2690/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:06 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:07.110240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:16:07.112853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:16:07.165546 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-74f195bf-420b-48c3-b542-3f40350b5da7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656785 Oct 19 01:16:07.166518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2585/5275] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:16:07.179932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c93857fa-2364-447b-b251-cc53ca127570 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:07.181343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c93857fa-2364-447b-b251-cc53ca127570 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:07.317066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c93857fa-2364-447b-b251-cc53ca127570 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:07.339383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c93857fa-2364-447b-b251-cc53ca127570 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1215 microversion: 2.1 time: 0.159685 Oct 19 01:16:07.340802 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2691/5276] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:07 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:07.397085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:07.397714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:07.409528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:07.410049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:07.410777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.411444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:07.411921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:07.412363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.797195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "name": "network-vif-plugged", "status": "completed", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:07.819336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:07.820041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:07.820694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:07.835353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] Creating event network-vif-plugged:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:16:07.854184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a38fb61a-a091-4660-a932-b369c96930b4 req-c3ba58ee-803e-4ede-ab89-2cbdcf8b5f26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061161 Oct 19 01:16:07.854803 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2692/5277] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:16:08.130814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:08.132248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:08.137697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:08.154044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:08.155242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:08.156054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:08.156715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:08.157631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:08.158415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:08.160747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:08.161896 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4a7d9aee-6338-466e-b570-7541cd0401a0 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.768918 Oct 19 01:16:08.162435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:08.165889 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2586/5278] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:07 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:08.366868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:08.367683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:08.383316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:08.385320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:08.386070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:08.391163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:08.392025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:08.394973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:08.620146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:08.634983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f942137-4458-4935-afb0-b6360cd4a596 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 0.508976 Oct 19 01:16:08.636423 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2693/5279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:08 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:08.674333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:08.687952 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63faea71-ceb9-498d-a471-e86f33bbe132 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1267 microversion: 2.1 time: 0.327524 Oct 19 01:16:08.702499 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2587/5280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:08 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1267 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:09.197531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:09.198168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:09.209064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:09.210141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:09.210824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:09.211836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:09.212523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:09.213850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:09.660190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:09.660856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:09.694916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:09.706480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:09.707036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:09.717240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:09.717867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:09.718323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:10.619322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:10.636879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:10.639540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:10.641685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5f822ca-2074-4a5d-93a7-8c63332f101f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.449974 Oct 19 01:16:10.644655 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2694/5281] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:09 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:10.653521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:10.654758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:10.660940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:10.661435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:10.661914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:10.662735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:10.664270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:10.664823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:10.808310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:10.819965 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c95db92f-8acf-4dc4-87c8-d5efefbcd4b6 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1392 microversion: 2.1 time: 1.164551 Oct 19 01:16:10.821120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2588/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:09 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1392 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:10.848303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:10.860253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8619cd6-842f-4199-b7a0-8a50bc7c4b82 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1273 microversion: 2.1 time: 0.213985 Oct 19 01:16:10.874230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2695/5283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:10 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:11.674066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:11.674689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:11.683237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:11.683754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:11.686583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:11.687313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:11.687692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:11.690334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:11.849830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:11.850464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:11.862810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:11.867497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:11.868153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:11.869304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:11.869952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:11.871855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:12.268501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:12.287916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:12.294959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:12.298262 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b64f4f24-addf-4fa5-951f-7af45f7ae038 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.628603 Oct 19 01:16:12.299427 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2589/5284] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:11 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:12.305569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:12.306882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:12.318778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:12.319705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:12.320475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:12.322300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:12.323050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:12.323657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:12.392907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:12.401983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0c9df06-37e4-4b39-977b-576d8bbb6efa tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1564 microversion: 2.1 time: 0.556477 Oct 19 01:16:12.402847 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2696/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:11 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1564 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:12.433124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:12.433853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:12.444750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:12.445462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:12.445970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:12.447126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:12.457036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:12.459975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:12.831945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:12.841716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9a98844-8f7b-4e88-8e6e-13ba68825207 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.539937 Oct 19 01:16:12.857846 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2590/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:12 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:13.331311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:13.331311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:13.340066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:13.340571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:13.341065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:13.341789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:13.342250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:13.342685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:13.419490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:13.438110 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f047f403-0447-42e5-a050-734510fb9217 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1564 microversion: 2.1 time: 1.008796 Oct 19 01:16:13.439430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2697/5287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:12 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1564 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:13.785905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:13.810634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:13.812114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:13.813370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5f24873f-9caf-4c36-9e2e-c467aa834559 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.486579 Oct 19 01:16:13.813943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2591/5288] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:13 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:13.866569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:13.867513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:13.876206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:13.877014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:13.877655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:13.878554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:13.879207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:13.879807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:14.304212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:14.345010 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85feff4f-80b1-49f5-a22b-eeddf4964716 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.482203 Oct 19 01:16:14.346214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2698/5289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:13 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:14.740922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0954f2-53c4-4efe-829c-648a2b7f9be9", "tag": "4728fb5b-cfaf-4c3a-b34f-105414666ba1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:14.761118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:14.762051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:14.763572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:14.818025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] Creating event network-changed:4728fb5b-cfaf-4c3a-b34f-105414666ba1 for instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 on n-h2-master-1 Oct 19 01:16:14.825173 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0e541e33-e11e-40fc-a00a-7a9d402e2cc5 req-124a48d9-7a44-44b0-963c-6186166e7782 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089422 Oct 19 01:16:14.827046 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2592/5290] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:14.839866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:14.840484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:14.865830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:14.866260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:14.866709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:14.867434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:14.867901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:14.868331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:15.372981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:15.373981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:15.388978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:15.389740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:15.390361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:15.391310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:15.391948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:15.393140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:15.463606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:15.477131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:15.479495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:15.481195 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a547f9f1-0c4b-431c-a3fb-930ecdd1ecee tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.645253 Oct 19 01:16:15.498175 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2699/5291] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:14 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:16.121522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:16.146061 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac536e16-a6d6-4a51-a77a-f95076eae69e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.776465 Oct 19 01:16:16.156655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2593/5292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:15 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:16.508527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:16.509178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:16.531144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:16.531660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:16.536593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:16.539455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:16.541075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:16.543246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:16.909060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:16.926478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:16.929594 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:16.932104 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ced999dc-6822-44c7-965d-1650c887910c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.428077 Oct 19 01:16:16.933944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2700/5293] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:16 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:17.178181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:17.179491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:17.187879 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:17.188901 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:17.191487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:17.192333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:17.193196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:17.196177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:17.197279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:17.198479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:17.966617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:17.968074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:17.974926 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:17.978306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:17.979097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:17.979883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:17.980822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:17.982013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:17.982825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:18.224324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:18.242728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6f5f4d85-6d19-490d-a5da-4cc906737433 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 1.070832 Oct 19 01:16:18.245081 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2594/5294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:17 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:18.555448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:18.567323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:18.569374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:18.571307 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0152f7f1-1670-4b65-9f44-8bd2ee9ea012 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.609599 Oct 19 01:16:18.572597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2701/5295] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:17 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:19.267682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:19.268179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:19.275887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:19.276528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:19.277173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:19.277679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:19.278059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:19.280314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:19.600613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:19.601179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:19.601806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:19.614397 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-848d3317-8a81-4d9e-b3ce-9566ef1856fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.351397 Oct 19 01:16:19.615063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:19.616853 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2595/5296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:19 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:19.619469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:19.620179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:19.621784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:19.622506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:19.623214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.005734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:20.026437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:20.030480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:20.032064 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f715e3f1-4521-4748-9254-a8a9c2a64ac1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.436392 Oct 19 01:16:20.034304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2702/5297] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:19 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:20.202568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:20.203875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:20.212464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:20.213394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:20.214113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:20.214926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.216215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:20.216948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:20.217696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.234203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:20.234694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:20.235125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.256776 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] Creating event network-changed:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:16:20.263528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e9b60e66-292c-4acd-996c-74a4dbc00f76 req-c07637d9-8368-40a4-8a67-64d8b389ab86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054744 Oct 19 01:16:20.265658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2703/5298] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:16:20.640635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:20.642230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:20.655687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:20.656513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:20.657185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.658953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:20.659585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:20.660182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:20.860947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:20.894500 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8786f57-ecf2-4384-b744-e41226e43291 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1564 microversion: 2.1 time: 0.699052 Oct 19 01:16:20.895635 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2596/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:20 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1564 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:21.068659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:21.069613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:21.113506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:21.115347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:21.115993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:21.117074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:21.117704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:21.118301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:21.164678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:21.173792 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29ca6e24-8866-43d7-80a7-136ed01ce23a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.537969 Oct 19 01:16:21.181912 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2704/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:20 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:22.148307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:22.164156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:22.167519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:22.170446 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc1a1318-4e00-4298-bc30-f19201f2ad78 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.110814 Oct 19 01:16:22.172307 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2597/5301] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:21 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:22.209035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:22.210262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:22.219779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:22.223615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:22.224312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:22.225258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:22.237646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:22.238322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:22.760651 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:22.806910 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7578241e-c9a9-4653-8d93-7148aae41b6a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.599614 Oct 19 01:16:22.814559 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2705/5302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:22 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:23.214594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:23.218033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:23.248322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:23.261096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:23.261920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:23.262939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:23.264245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:23.266325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:23.776019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:23.794629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:23.802183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:23.806201 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-937e3677-2cc1-47be-a5b2-e06ca6785f0c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.604508 Oct 19 01:16:23.807995 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2598/5303] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:23 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:23.842060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:23.843314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:23.860566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:23.861384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:23.862058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:23.862955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:23.867521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:23.868246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:24.338929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:24.351347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae189864-598c-44e1-9dd4-02851592480c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.514439 Oct 19 01:16:24.370259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2706/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:23 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:24.738638 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0954f2-53c4-4efe-829c-648a2b7f9be9", "name": "network-vif-plugged", "status": "completed", "tag": "4728fb5b-cfaf-4c3a-b34f-105414666ba1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:24.763126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:24.764755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:24.766922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:24.773637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:24.776476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:24.777365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:24.777949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:24.779988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:24.781954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:24.784046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:24.831703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] Creating event network-vif-plugged:4728fb5b-cfaf-4c3a-b34f-105414666ba1 for instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 on n-h2-master-1 Oct 19 01:16:24.851436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b5b541fa-b74a-48e4-9042-4ce166da6825 req-c612c753-3346-4704-b60e-d86633fee3a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117514 Oct 19 01:16:24.854687 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2707/5305] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:24.869300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:24.870016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:24.883824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ef3324f-9740-47dd-8334-0f482aa1d5d4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.297041 Oct 19 01:16:24.898738 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2599/5306] 10.222.0.27 () {58 vars in 1185 bytes} [Wed Oct 19 01:16:24 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:24.902469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:24.903025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:24.906850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:24.918148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:24.920109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:24.920828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:25.089259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-166629575", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "availability_zone": "nova:n-h2-master-1", "networks": [{"uuid": "2ea4bde0-31b7-4913-bf2f-3860699e04af"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:25.180816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] validate_networks() for [('2ea4bde0-31b7-4913-bf2f-3860699e04af', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:16:25.869093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:25.886402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:25.888809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:25.892744 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e072aaf-21e5-43c0-95d1-fa4a4fcc593b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 1.034287 Oct 19 01:16:25.895289 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2708/5307] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:24 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:25.905955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:25.910496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:25.920399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:25.921327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:25.921966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:25.922918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:25.923580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:25.924366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:25.957704 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:26.243279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:26.254446 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aef2764d-e421-4a20-b59c-99b2be53e725 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1315 microversion: 2.1 time: 0.357943 Oct 19 01:16:26.257314 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2709/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:25 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:26.435784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:16:26.436403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:16:26.437016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:16:26.437797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:16:26.438119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:16:26.449439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:26.450769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:26.451321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:26.452160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:26.452755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:26.453283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:26.473067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Getting quotas for project 9af39100791e4975a675cac0d34e6818. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:16:26.478824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Getting quotas for user 25f9802b02aa49e398943b2fdfa92fd4 and project 9af39100791e4975a675cac0d34e6818. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:16:26.492480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:16:26.495139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:16:26.548376 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-36473add-5d35-47e8-a406-c20939c1b689 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462941 Oct 19 01:16:26.549456 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2600/5309] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:16:26.560119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5d8822f-d5d3-4808-ac11-bc0b963a1a13 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:26.561013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5d8822f-d5d3-4808-ac11-bc0b963a1a13 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:26.641432 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5d8822f-d5d3-4808-ac11-bc0b963a1a13 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1328 microversion: 2.1 time: 0.084995 Oct 19 01:16:26.642604 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2710/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:26 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1328 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:26.948586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:26.949268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:26.973860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:26.974358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:26.974811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:26.978587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:26.979338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:26.979789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.001568 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:27.283950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:27.291815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:27.294533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:27.296799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:27.298554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:27.300050 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4740eef-8382-4332-bfde-3cbb0a36ba16 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.381655 Oct 19 01:16:27.301233 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2601/5311] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:26 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:27.307336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.308340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.309059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.310189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.310989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.312191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.492394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:27.502730 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8227ff72-53b4-4e5d-9b1b-bcd2ceeae1e7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1501 microversion: 2.1 time: 0.225296 Oct 19 01:16:27.503680 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2711/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:27 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1501 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:27.528600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:27.529478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:27.537667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.549603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.550604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.551744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.552686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.553460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.666471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:27.667916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:27.681429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.685050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.686457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.696570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:27.702562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:27.706274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:27.737310 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Removing security group a0e2c4de-3739-45b1-9b91-9e17324c87ce from port 4728fb5b-cfaf-4c3a-b34f-105414666ba1 Oct 19 01:16:27.885703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-90961665-9db0-426c-9fe2-bbc380306406 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1415 microversion: 2.1 time: 0.223913 Oct 19 01:16:27.889008 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2712/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:27 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1415 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:28.333607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:28.334396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:28.350209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:28.354101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:28.355058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:28.358108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:28.358629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:28.359079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:28.670752 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7b5aaa49-b9c9-4647-a547-59bc97d7cf76 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9/action" status: 202 len: 0 microversion: 2.1 time: 1.146791 Oct 19 01:16:28.678546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2602/5314] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:16:27 2022] POST /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9/action => generated 0 bytes in 1156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:16:28.707117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:28.708287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:28.718595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:28.719836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:28.721023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:28.722044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:28.722679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:28.723278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:28.985295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:28.998590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-40284a9b-e2ad-4814-b1b2-f0e9ca827863 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1459 microversion: 2.1 time: 0.314214 Oct 19 01:16:29.005571 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2603/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:28 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1459 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:29.023934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee0954f2-53c4-4efe-829c-648a2b7f9be9", "tag": "4728fb5b-cfaf-4c3a-b34f-105414666ba1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:29.043978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:29.056446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:29.065726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:29.067948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.068264 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f49bb784-6b7a-41d7-9a98-ee1d4c97f7e9 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.739587 Oct 19 01:16:29.068933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.069557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.073381 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2713/5316] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:28 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:29.093548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:29.098410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:29.108669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] Creating event network-changed:4728fb5b-cfaf-4c3a-b34f-105414666ba1 for instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 on n-h2-master-1 Oct 19 01:16:29.116050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.117017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.117798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.118702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.119370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.120047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.126165 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-40d3858d-a8ad-4d24-83bc-cb147396150e req-1fbb8b4c-382f-4a5f-9731-adf501a60e27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117064 Oct 19 01:16:29.127480 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2604/5317] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:29.133016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:29.135124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:29.166670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.170031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.173462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.174552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.175382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.176481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.306781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9de5ab56-da39-45d1-95a5-8bb906758bd7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1421 microversion: 2.1 time: 0.229051 Oct 19 01:16:29.317463 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2714/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:29 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1421 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:29.593239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:29.612613 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-623939d4-5bc3-4766-aa6f-e4fb96af7152 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.483281 Oct 19 01:16:29.615212 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2605/5319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:29 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:29.646366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:29.646906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:29.661328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.661888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.662600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:29.663491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:29.664349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:29.665058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.066253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:30.084694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-272fd259-b28c-45b7-8398-5a3163dc9dec tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.438139 Oct 19 01:16:30.094075 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2715/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:29 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:30.123510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:30.126915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:30.129606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:30.130671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:30.149813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.150034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.150462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.150905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.151353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.151634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.152101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.152563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.153962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.154770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.155437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.165030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.878362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:30.897741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:30.900159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:30.902271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0a2ee9b3-1e6f-4690-85cd-ad5a42bd4134 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.792052 Oct 19 01:16:30.903412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2606/5321] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:30 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:30.910620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:30.919875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:30.924589 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:30.932853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.933622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.935112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.936398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:30.937232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:30.939773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:30.950445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:30.966227 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ffaddcaa-10be-4b93-911c-6974c9ad9cf6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.850989 Oct 19 01:16:30.969179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2716/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:30 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:30.997824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:30.998988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:31.010261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:31.013516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:31.015412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:31.016244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:31.025189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:31.025799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:31.561906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95475d01-b28a-4dd5-bc08-ace2f761adec tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.656938 Oct 19 01:16:31.562996 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2607/5323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:30 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:31.598640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:31.607630 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8f82a5e4-bcfe-49a0-88d7-a5bd64d3c542 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.617295 Oct 19 01:16:31.608238 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2717/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:30 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:31.751895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1417126027", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "69976232-9b57-4354-be5a-f2d785e4a03d"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:31.814628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] validate_networks() for [('69976232-9b57-4354-be5a-f2d785e4a03d', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:16:31.931497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:31.932393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:31.941286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:31.942103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:31.942728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:31.943638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:31.944280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:31.944917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:32.804455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:32.814888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:32.817061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:32.818519 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e6cd2fc-4940-47ad-936d-a0881109f527 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.891207 Oct 19 01:16:32.819626 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2718/5325] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:31 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:32.824718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:32.825437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:32.830451 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=74 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:32.832506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:32.833205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:32.833668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:32.834352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:32.834970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:32.835400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:33.222419 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32a30ae0-946a-4f11-9407-da6762908b05 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.401389 Oct 19 01:16:33.223277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2719/5326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:32 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:33.228816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7adb7064-f419-4e4a-8091-558f0ff4992f", "tag": "61ddfa26-b385-4a6b-ab46-0aeff4d5cd67"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:33.239831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:33.240587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:33.241258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:33.253646 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] Creating event network-changed:61ddfa26-b385-4a6b-ab46-0aeff4d5cd67 for instance 7adb7064-f419-4e4a-8091-558f0ff4992f on n-h2-master-1 Oct 19 01:16:33.260686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-127d603b-4b31-47fb-8214-ba65fb8328f5 req-cbd372f3-f9ed-4fa9-ba80-842a02a556ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035780 Oct 19 01:16:33.261527 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2720/5327] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:33.304214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:16:33.304697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:16:33.304914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:16:33.305748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:16:33.306561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:16:33.321510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:33.322281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:33.322731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:33.324085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:33.326076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:33.326763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:33.353003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:16:33.359816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Getting quotas for user 2d97060e766f4e1f982d64b425ddd184 and project 235a5608bd9142dcbfb621873d3999a7. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:16:33.381985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:16:33.386053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:16:33.440172 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bc1ba27d-5855-4bb2-a3f4-9033dc77da8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692106 Oct 19 01:16:33.442943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2608/5328] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:16:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:16:33.460224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d01c82b0-407f-4a23-8829-f4ad42632ad6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:33.461565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d01c82b0-407f-4a23-8829-f4ad42632ad6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:33.580487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d01c82b0-407f-4a23-8829-f4ad42632ad6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:33.589814 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d01c82b0-407f-4a23-8829-f4ad42632ad6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1215 microversion: 2.1 time: 0.138442 Oct 19 01:16:33.618693 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2721/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:33 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:33.846142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:33.847029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:33.854700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:33.855434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:33.856886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:33.857795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:33.858441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:33.859052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.087172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:34.100117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:34.102114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:34.104133 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49bda801-ff68-486f-9a0b-0324bc878be2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.262777 Oct 19 01:16:34.112679 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2609/5330] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:33 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:34.124961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "a1606c90-698d-4440-9cc4-179ab1a91d6a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:34.141506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:34.142068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:34.142513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.158840 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] Creating event network-vif-plugged:a1606c90-698d-4440-9cc4-179ab1a91d6a for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:34.167305 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d2bae048-7f49-40cb-8be0-bb3589dc4c7c req-166e40ca-6ac7-4b92-949b-a2f955bd6447 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045580 Oct 19 01:16:34.168318 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2722/5331] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:16:34.250246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:34.252095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:34.264207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:34.265907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:34.266765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.268397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:34.268938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:34.269578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.545381 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d0859ad-ec9a-4a89-ab62-66dc0c898936 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.301053 Oct 19 01:16:34.548788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2610/5332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:34 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:34.622404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:34.623138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:34.629703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:34.630411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:34.631053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.631770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:34.632407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:34.633056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:34.708780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:34.717723 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d54931aa-eba8-4d71-a830-71ec559af99b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1267 microversion: 2.1 time: 0.099431 Oct 19 01:16:34.718625 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2723/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:34 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:35.133380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:35.134206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:35.145060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.145591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.147770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.148598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.149137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.149630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.478470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:35.481264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:35.494726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.495228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.495687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.497104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.497670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.497864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.631760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03d00d02-d378-4a89-96a9-070976fc4246 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action" status: 200 len: 24570 microversion: 2.1 time: 0.156092 Oct 19 01:16:35.634654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2724/5334] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:16:35 2022] POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action => generated 24570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 01:16:35.645472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:35.646581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:35.655072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.655926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.656914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.658222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.659088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.659749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.760975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:35.772214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:35.773741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:35.775321 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ee61482-171a-4f18-87ea-007cedbc970c tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.647056 Oct 19 01:16:35.776808 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2611/5335] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:35 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:35.784287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:35.785633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:35.795019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.795789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.796411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.797971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:35.798789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:35.799484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:35.957748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:35.974297 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ab39ee8-5534-4fd2-a468-b5e3d8da7ae8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1273 microversion: 2.1 time: 0.195296 Oct 19 01:16:35.975260 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2612/5336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:35 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:36.032846 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f9e61ca-d851-4616-8cc8-2e78e7de604d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.395675 Oct 19 01:16:36.037232 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2725/5337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:35 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:36.241472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "c81f4fac-56a4-4297-9a43-94b12f2107a4"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "7fdcdb21-d41a-4c53-87e1-df1d8c012260"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "b05dfb85-2b5a-4266-a9b8-1d80808f0283"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "288f1f37-4462-495e-a087-09267a50a989"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "1ec40a53-8843-457f-8b3f-012ebf6e2066"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-plugged", "status": "completed", "tag": "be8d70e8-a6b0-4676-8c91-f9675b669fb9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:36.257710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:36.258477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:36.259656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:36.292198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:c81f4fac-56a4-4297-9a43-94b12f2107a4 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.293612 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:7fdcdb21-d41a-4c53-87e1-df1d8c012260 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.294479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:b05dfb85-2b5a-4266-a9b8-1d80808f0283 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.294659 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:288f1f37-4462-495e-a087-09267a50a989 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.295499 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:1ec40a53-8843-457f-8b3f-012ebf6e2066 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.296671 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] Creating event network-vif-plugged:be8d70e8-a6b0-4676-8c91-f9675b669fb9 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:36.304315 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f22993cf-8344-4def-ac5f-23d3e53a5de6 req-33b83cdc-6b64-47c3-b01c-90c9e5cd619c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.076385 Oct 19 01:16:36.306869 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2613/5338] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:36.810234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:36.812420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:36.819974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:36.820978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:36.822676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:36.823806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:36.824844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:36.825468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.008392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:37.010650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:37.020237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:37.021224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:37.021842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.023062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:37.023832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:37.024389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.173727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:37.199818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:37.202380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:37.207885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3e51aae-76f7-41cd-a9a4-75f27c4cb45b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1879 microversion: 2.42 time: 0.397828 Oct 19 01:16:37.222960 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2726/5339] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:36 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1879 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:37.237290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:37.238160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:37.254358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:37.258406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:37.259119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.263448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:37.264294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:37.266649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.451125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:37.465683 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50d6f730-4504-47ab-bc27-a61991737673 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.460442 Oct 19 01:16:37.466976 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2614/5340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:36 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:37.627690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1cd82758-4617-4a22-9090-869c4e8d41e9 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.397583 Oct 19 01:16:37.629922 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2727/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:37 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:37.705985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88b3f7c4-be8b-4fdf-b3af-d2ac58406646", "tag": "6df888b4-a8ef-40fc-9137-e5a95899a62d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:37.717247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:37.717913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:37.718445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:37.734359 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] Creating event network-changed:6df888b4-a8ef-40fc-9137-e5a95899a62d for instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 on n-h1-master-1 Oct 19 01:16:37.740208 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b17595ce-0c84-485f-9cd4-3b4097c7fb9f req-9877cbdf-7aef-4346-a39c-8bce7f4c6aba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Oct 19 01:16:37.741444 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2615/5342] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:38.241741 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:38.242357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:38.251815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.253429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.254915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.256221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.259334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.260201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.492613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:38.493612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:38.505719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.506147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.506566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.507335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.507869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.511362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.768966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:38.780197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:38.788098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:38.793857 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c7d36f1-eae8-4fe8-ad1b-02bf7619c929 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2834 microversion: 2.42 time: 0.554842 Oct 19 01:16:38.795489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2728/5343] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:16:38 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2834 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:16:38.804364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:38.805700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:38.813094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.813805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.815278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.816210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.816875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.817476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.837740 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:38.926051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:38.942272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa394546-50a2-428e-970a-284c64cb5e0a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.454451 Oct 19 01:16:38.945693 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2616/5344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:38 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:38.952129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:38.952802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:38.959828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.960422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.960987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:38.962277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:38.962974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:38.964415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:39.038880 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2e34bf1-fc34-4e13-a5b9-b325917184cf tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.241526 Oct 19 01:16:39.053964 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2729/5345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:38 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:39.163794 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8bed062c-9e44-4b60-9fc1-038f45da56d4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.216197 Oct 19 01:16:39.165343 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2617/5346] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:16:38 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0/os-interface => generated 1829 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:16:39.968844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:39.973880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:39.988607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:39.989139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:39.989584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:39.990314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:39.990779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:39.991215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:40.046177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adb7064-f419-4e4a-8091-558f0ff4992f", "name": "network-vif-plugged", "status": "completed", "tag": "61ddfa26-b385-4a6b-ab46-0aeff4d5cd67"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:40.074057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:40.077811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:40.078617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:40.106850 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] Creating event network-vif-plugged:61ddfa26-b385-4a6b-ab46-0aeff4d5cd67 for instance 7adb7064-f419-4e4a-8091-558f0ff4992f on n-h2-master-1 Oct 19 01:16:40.120478 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4e2fc7c7-836a-401b-804f-adf0bf229ee2 req-e94db64b-b9cb-4fd2-8040-45ea1bcaf0d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078556 Oct 19 01:16:40.129029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2618/5347] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:40.137879 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:40.138705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:40.156058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:40.156704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:40.157058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:40.157827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:40.158299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:40.158740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:40.593406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:40.610785 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20d966df-d750-47d1-9754-f36f56717e95 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.646054 Oct 19 01:16:40.611407 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2730/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:39 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:40.648549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb28222a-299f-480b-bc8f-8d8d9ba9a27c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.517702 Oct 19 01:16:40.650797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2619/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:40 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:41.644248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:41.646794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:41.657281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:41.658466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:41.659926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:41.661988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:41.662847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:41.663440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:41.673717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:41.674348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:41.686677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:41.691678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:41.693657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:41.695009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:41.697059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:41.697787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:42.103909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:42.125155 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8969976-6e80-4944-9a76-c8e8a1f44a59 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1463 microversion: 2.1 time: 0.455717 Oct 19 01:16:42.128315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2620/5350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:41 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1463 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:42.134390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "tag": "be8d70e8-a6b0-4676-8c91-f9675b669fb9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:42.134756 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b2b3025-01e8-4fe6-823d-6f31790aec32 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.499115 Oct 19 01:16:42.135480 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2731/5351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:41 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:42.146775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:42.147670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:42.148379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:42.161318 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] Creating event network-changed:be8d70e8-a6b0-4676-8c91-f9675b669fb9 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:16:42.167152 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cd23480d-86e8-4ae4-b7ce-2af612bc7788 req-fa5bd4cf-0e26-4083-b3fa-3740e6e2e538 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036181 Oct 19 01:16:42.169576 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2621/5352] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:43.154804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:43.155606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:43.165892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:43.167884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:43.186968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.188213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.188997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.189892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.190313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.191606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.192523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.194295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.194993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.195623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.196666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.197447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.231973 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:43.338551 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:43.371952 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:43.449967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:43.463726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddfdb790-e0b5-4b07-9573-659475e7513d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1648 microversion: 2.1 time: 0.315830 Oct 19 01:16:43.464490 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ca10896-cebb-48f9-9b08-5ed889ba1f11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.301597 Oct 19 01:16:43.466703 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2622/5353] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:43 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:43.475267 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2732/5354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:43 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1648 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:43.489789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:43.490482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:43.501215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.501955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.502400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.503111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.503729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.504334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.695160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c32eecde-c5d0-47ba-9628-3f2ae7284283 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1648 microversion: 2.1 time: 0.209522 Oct 19 01:16:43.696513 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2623/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:43 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1648 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:43.719470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:43.720099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:43.727144 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:43.729143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.729640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.730083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.731657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:43.732126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:43.732562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:43.921061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03072c72-5144-4a12-be2e-bf25febc40b1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1648 microversion: 2.1 time: 0.206209 Oct 19 01:16:43.937293 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2733/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:43 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1648 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:44.178427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-635617453", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "availability_zone": "nova:n-h1-master-1", "networks": [{"uuid": "2ea4bde0-31b7-4913-bf2f-3860699e04af"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:44.254827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] validate_networks() for [('2ea4bde0-31b7-4913-bf2f-3860699e04af', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:16:44.490936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:44.491567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:44.500784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:44.501599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:44.502369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:44.503382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:44.504235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:44.504957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:44.843514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:44.870242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33082812-c85c-4418-8d22-7eb52589d55f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.383476 Oct 19 01:16:44.895099 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2734/5357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:44 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:44.904795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:16:44.907580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3f7c4-be8b-4fdf-b3af-d2ac58406646", "name": "network-vif-plugged", "status": "completed", "tag": "6df888b4-a8ef-40fc-9137-e5a95899a62d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:44.908380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:16:44.909761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:16:44.911072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:16:44.911849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:16:44.935118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:44.935654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:44.936125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:44.937406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:44.937914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:44.938287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:44.938437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:44.939569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:44.939717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:44.955512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] Creating event network-vif-plugged:6df888b4-a8ef-40fc-9137-e5a95899a62d for instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 on n-h1-master-1 Oct 19 01:16:44.962119 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-308ea795-c25f-4081-ba3d-2a87ab0824bc req-da034e27-ddc6-4cbe-b9ca-ee9ce79a1886 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060616 Oct 19 01:16:44.963678 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2735/5358] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:44.984307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Getting quotas for project 9af39100791e4975a675cac0d34e6818. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:16:44.995950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Getting quotas for user 25f9802b02aa49e398943b2fdfa92fd4 and project 9af39100791e4975a675cac0d34e6818. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:16:45.018514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:16:45.021349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:16:45.144504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cc6be014-d0b7-4cde-897d-f3b6978445a4 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970289 Oct 19 01:16:45.145369 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2624/5359] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:16:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:16:45.172986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-72935098-b9cb-4514-ac2f-f71e9560a8ac tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:45.175920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-72935098-b9cb-4514-ac2f-f71e9560a8ac tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:45.284135 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-72935098-b9cb-4514-ac2f-f71e9560a8ac tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1328 microversion: 2.1 time: 0.129704 Oct 19 01:16:45.300654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2736/5360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:45 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:45.909433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:45.910610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:45.930241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:45.930821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:45.931351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:45.932083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:45.932552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:45.933110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.314331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:46.315956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:46.323609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.325271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.325271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.325889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.326789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.327461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.530947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f23eae95-6340-44b4-8868-d8a476355c1b tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1415 microversion: 2.1 time: 0.220829 Oct 19 01:16:46.533053 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2737/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:46 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1415 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:46.556670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:46.559735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:46.570909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.571702 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.572335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.573287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.574334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.574958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.758409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:16:46.758765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:16:46.759259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:16:46.759663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:16:46.760086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:16:46.863999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:46.865599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:46.882983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb5b51d7-7fc3-4f20-b0b0-8eabab106c28 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1315 microversion: 2.1 time: 0.978779 Oct 19 01:16:46.889926 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2625/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:45 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:46.913040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.913507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.913977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:46.914700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:46.918929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:46.922615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.013462 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4c5f238e-4cea-4605-a9ba-b2c385087393 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action" status: 202 len: 1137 microversion: 2.1 time: 0.474557 Oct 19 01:16:47.014053 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2738/5363] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:16:46 2022] POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action => generated 1137 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 19 01:16:47.037880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:47.041208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:47.068931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.069658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.070282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.071341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.071969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.072566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.485637 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:47.496915 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2bc0421-3791-456a-adbe-8a79c6345b0e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.465154 Oct 19 01:16:47.501240 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2626/5364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:47 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:47.564852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:47.567046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:47.578789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.579643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.580338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.582465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.582956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.583396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.695513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43c01916-7d0b-4af1-8245-e6c687d67af7 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1421 microversion: 2.1 time: 0.135138 Oct 19 01:16:47.696956 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2739/5365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:47 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1421 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:47.915217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:47.917310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:47.937382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.943121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.945757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:47.946724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:47.950330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:47.951162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.526157 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:48.527838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:48.543498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.544875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.546903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.550496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.553160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.554919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.727588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:48.745239 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0a82787-2d60-43a9-ad15-c3c53d2fabfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1501 microversion: 2.1 time: 0.834392 Oct 19 01:16:48.747423 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2627/5366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:47 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1501 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:48.778533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:48.779172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:48.797334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.797837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.798290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.799021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.799487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.799926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.929519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:48.942536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-446568e7-4b82-4761-921c-0bfd4fe10c7a tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.422894 Oct 19 01:16:48.943158 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2740/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:48 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:48.974686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:48.975417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:48.986628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.986869 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d621793-529c-4839-961f-dd18da303bc6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1421 microversion: 2.1 time: 0.217477 Oct 19 01:16:48.987140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.987594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:48.988327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:48.990523 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2628/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:48 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1421 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:48.991694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:48.992201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:49.121391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e74fcbd9-3013-4d30-90cf-31b33e2ff65a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646/action" status: 202 len: 0 microversion: 2.1 time: 0.166856 Oct 19 01:16:49.127524 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2741/5369] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:16:48 2022] POST /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:16:49.130804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:49.131583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:49.147289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:49.148115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:49.148929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:49.160969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:49.162797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:49.163428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:49.615551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:49.628510 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc53c60f-0f13-4f7d-a6d1-b435b0cc6908 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1506 microversion: 2.1 time: 0.500586 Oct 19 01:16:49.630825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2629/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:49 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:49.973089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:49.973803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:49.988212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:49.988509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:49.989314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:49.990260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:49.991121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:49.991940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:50.022782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:50.026250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:50.048805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:50.050166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:50.051727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:50.056902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:50.059959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:50.061034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:50.461515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:50.476603 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d195a23b-b2ab-48ed-8f86-f60dbf3fdde1 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.507903 Oct 19 01:16:50.477871 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2742/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:49 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:50.486045 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e3b850fb-c5a8-44e4-82c9-03ca42199435 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.478727 Oct 19 01:16:50.497175 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2630/5372] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:50 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:50.654936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:50.655881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:50.662847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:50.663748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:50.664377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:50.665303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:50.666181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:50.666767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:50.970265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:50.979578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34dbfc6f-f5a2-44bb-bb92-5899a0e41262 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1486 microversion: 2.1 time: 0.328561 Oct 19 01:16:50.981427 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2743/5373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:50 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1486 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:51.004602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:51.005156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:51.012060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.012539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.013004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.014013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.014160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.014773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.040722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lazy-loading 'flavor' on Instance uuid 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:16:51.108344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8414c498-106a-4f95-bf32-f097be7f082e", "tag": "c99bd356-9c85-45a6-a671-3283b09849d7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:51.126635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.127400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.128076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.144547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] Creating event network-changed:c99bd356-9c85-45a6-a671-3283b09849d7 for instance 8414c498-106a-4f95-bf32-f097be7f082e on n-h1-master-1 Oct 19 01:16:51.152436 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5c9fe913-f585-4de7-b504-be838b634f52 req-680699bf-6a58-490a-b6da-0688f626d128 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074454 Oct 19 01:16:51.154369 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2744/5374] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:51.325813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1272807-7bd9-48ce-b6a6-1904506a8e7f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646/action" status: 202 len: 0 microversion: 2.1 time: 0.325120 Oct 19 01:16:51.326499 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2631/5375] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:16:50 2022] POST /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:16:51.345616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:51.350788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:51.374496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.374496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.374496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.374496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.377176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.377959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.421676 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:51.508932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:51.509949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:51.518648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.519546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.519998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:51.520747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:51.521218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:51.521654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:52.069549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:52.078154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38cbfbc9-5752-488a-8e60-b6ac7b52dcb6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1492 microversion: 2.1 time: 0.746636 Oct 19 01:16:52.079102 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2745/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:51 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1492 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:52.085062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:52.093169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:52.100732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:52.101476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:52.101963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:52.102670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:52.103290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:52.103714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:52.142123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:52.151867 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5d37a3d0-6644-46aa-976d-db536af6a858 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.649232 Oct 19 01:16:52.152611 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2632/5377] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:51 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:52.334755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3653ebfb-4352-460d-b749-11e60f8091ad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.254277 Oct 19 01:16:52.349250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2746/5378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:52 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:53.102382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:53.103021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:53.109954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.112045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.112758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.113700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.114536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.114967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.176986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:53.178291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:53.186489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.187316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.187958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.189148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.189805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.190430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.526011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:53.540600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f9bbba2-af9b-4b7f-ac99-9d55d5df8db1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1513 microversion: 2.1 time: 0.442231 Oct 19 01:16:53.545174 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2633/5379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:53 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:53.550462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:53.551380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:53.559851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.560301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.560844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.561578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:53.562192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:53.562637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:53.569814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:53.581945 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd4cc0c6-208a-4374-bca3-5ea8a792f0e3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.408960 Oct 19 01:16:53.584772 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2747/5380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:53 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:53.844673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-996813a2-ff72-4146-b92e-cc6f3aecfe71 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.298064 Oct 19 01:16:53.845740 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2634/5381] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:53 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:54.568536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:54.569474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:54.598514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:54.599407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:54.600111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:54.602044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:54.603174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:54.604157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:54.609650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:54.610429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:54.621967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:54.622475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:54.624998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:54.625772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:54.626242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:54.626683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:54.957937 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:54.962456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:54.979356 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f47fa84-beb9-46a6-950c-79b199743b6d tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.374483 Oct 19 01:16:55.007853 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2635/5382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:54 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:55.014145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:55.014776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:55.034217 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:55.035840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:55.036346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:55.041181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:55.042717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:55.043382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:55.043988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:55.189130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:55.208225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00201e89-2453-48d3-b4e8-0c7e8bd3ea39 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.642795 Oct 19 01:16:55.213203 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2748/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:54 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:55.491699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d54ba96-f9ba-4381-af34-dae38452191a tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.481745 Oct 19 01:16:55.492329 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2636/5384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:55 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:56.020047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:56.020722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:56.022654 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:56.039795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:56.041410 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:56.041863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:56.042649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:56.043121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:56.057304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:56.240169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:56.241373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:56.249535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:56.250032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:56.250477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:56.251183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:56.251843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:56.252271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:56.921647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:56.933398 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:16:56.939924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:56.962427 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b699c0e4-aac1-4db8-a0d3-c7b73e39490b tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.951481 Oct 19 01:16:56.962663 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-453595b8-725a-4977-b4a4-a62437ca76c3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.720669 Oct 19 01:16:56.963045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2749/5385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:56 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:56.966321 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2637/5386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:56 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:16:56.983724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:56.984358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:57.023500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:57.024292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:57.025055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:57.025873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:57.039743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:57.040243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:57.385977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07875365-67fa-4640-b1f8-8983e3b5d7e5 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.418413 Oct 19 01:16:57.390691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2638/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:56 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:57.837211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3f7c4-be8b-4fdf-b3af-d2ac58406646", "name": "network-vif-plugged", "status": "completed", "tag": "6df888b4-a8ef-40fc-9137-e5a95899a62d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:57.860446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:57.862341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:57.864768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:57.891465 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] Creating event network-vif-plugged:6df888b4-a8ef-40fc-9137-e5a95899a62d for instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 on n-h1-master-1 Oct 19 01:16:57.905539 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-78cb67c1-1d7b-4a94-a21f-58f6f9b4225a req-89fd677b-2bf4-45ba-aa26-e000efe73a53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072561 Oct 19 01:16:57.906348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2750/5388] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:16:57.990660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:57.991576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:57.998903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:57.999836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.000398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.001283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:58.001854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.002552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.003211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:58.004254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:58.034324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:58.036001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.037468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.040002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:58.040791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.042813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.381641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:58.390557 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5c0b87f5-4999-45c2-9251-febcc3e9a399 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.404422 Oct 19 01:16:58.408006 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2639/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:57 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:58.431415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:58.432193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:58.442481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:58.443107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.443831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.448928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:58.449669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:58.454610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:58.842685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:58.863329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7da7b47-a9be-4e1f-9b7f-c0b9ac3911d7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.867852 Oct 19 01:16:58.867714 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2751/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:57 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:59.116699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47c2c85d-c3dd-4666-bf2b-f78959e00e23 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.688946 Oct 19 01:16:59.134820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2640/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:58 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:59.438682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:59.439977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:59.452878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:59.454930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:59.455725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:59.457539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:59.460984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:59.461522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:59.696309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:16:59.707159 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62acce32-4f51-455a-a7d5-8a79849e9e3f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.273332 Oct 19 01:16:59.708974 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2752/5392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:59 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:16:59.900828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:16:59.902055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:16:59.913537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:59.915273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:59.930316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8414c498-106a-4f95-bf32-f097be7f082e", "name": "network-vif-plugged", "status": "completed", "tag": "c99bd356-9c85-45a6-a671-3283b09849d7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:16:59.937809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:59.939209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:59.946327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:59.947079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:59.957823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:16:59.958460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:16:59.959022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:16:59.982421 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] Creating event network-vif-plugged:c99bd356-9c85-45a6-a671-3283b09849d7 for instance 8414c498-106a-4f95-bf32-f097be7f082e on n-h1-master-1 Oct 19 01:16:59.996971 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3d034b47-fd7b-4cfa-9dda-74b262a00429 req-976f2cf1-bf83-490e-9483-de4d87233e7a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070253 Oct 19 01:16:59.998365 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2753/5393] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:17:00.151581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:00.152597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:00.172923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:00.173531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:00.177067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:00.178062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:00.179369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:00.181329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:00.393042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:00.412337 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54048936-7d28-4069-b903-2b74b7947a23 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.515799 Oct 19 01:17:00.449106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2641/5394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:16:59 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:00.535755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2d62ede0-ef9f-47b7-b36f-29de92735c0c tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.391059 Oct 19 01:17:00.536791 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2754/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:00 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:00.746476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:00.747778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:00.749931 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:00.777765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:00.781636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:00.782272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:00.785202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:00.792776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:00.793630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:01.128172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:01.166242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d0cba8d9-60a0-4cd1-8b23-b245523da129 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.426249 Oct 19 01:17:01.186311 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2642/5396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:00 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:01.441249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:01.442441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:01.456011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:01.456526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:01.457001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:01.457727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:01.458187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:01.458626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:01.572891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:01.575908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:01.586690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:01.595609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:01.596078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:01.596908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:01.597374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:01.598712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:01.756461 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:01.772326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b6265d1-aded-4457-9fa2-3f472231b474 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.335368 Oct 19 01:17:01.788669 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2755/5397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:01 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:02.003577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-505322b9-eb8d-4a2e-ae37-dd1fd2ddcaef tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1463 microversion: 2.1 time: 0.436584 Oct 19 01:17:02.005582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2643/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:01 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1463 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:02.197218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:02.198011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:02.211247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:02.212962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:02.216834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:02.217747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:02.218337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:02.218915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:02.571131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:02.581441 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-66e967ef-b024-4dbf-8749-d5e37211b453 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.389616 Oct 19 01:17:02.582597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2756/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:02 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:02.803875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:02.804658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:02.816236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:02.817743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:02.820264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:02.822984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:02.824570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:02.826613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.032120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:03.033161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:03.044829 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=84 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:03.051166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.053710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.054415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.058654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.061817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.063193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.094598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:03.113949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8b5b65a-64f2-45cf-b72d-76b936796504 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.313487 Oct 19 01:17:03.115189 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2644/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:02 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:03.335032 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f6944d1-6001-44ba-9dd6-ed0295bb090d tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1649 microversion: 2.1 time: 0.311505 Oct 19 01:17:03.338113 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2757/5401] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:03 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1649 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:03.365692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:03.366886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:03.380051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.382006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.386334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.387572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.388218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.389017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.608600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:03.610148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:03.623739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.624488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.625324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.627040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.629427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.629874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.708257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f140b2eb-3754-4b6c-a10d-0f209cd9daad tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1649 microversion: 2.1 time: 0.346769 Oct 19 01:17:03.709605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2645/5402] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:03 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1649 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:03.736320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:03.737311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:03.744660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.746280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.747079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.748033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:03.748741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:03.749360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:03.996115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:04.014462 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b41f41c1-11e7-4d20-8115-908922a85d1e tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1691 microversion: 2.1 time: 0.410485 Oct 19 01:17:04.019902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2758/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:03 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1691 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:04.131623 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4ed85f8-0c25-4075-91d3-2bbae581d0dd tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1649 microversion: 2.1 time: 0.401477 Oct 19 01:17:04.133225 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2646/5404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:03 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1649 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:04.152777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:04.153706 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:04.163461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:04.164145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:04.178747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.179679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.180186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.180600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.180794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.181551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.181908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.182344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.185980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.187466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.191478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.193343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.310265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:04.513903 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91e7978b-7fb2-42b1-bd56-419c0f5f76f6 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 204 len: 0 microversion: 2.1 time: 0.353696 Oct 19 01:17:04.514933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:04.518909 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2647/5405] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:04 2022] DELETE /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:04.531015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:04.532537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:04.547348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.548637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79e42ff0-dffb-41db-bc7e-e35b08982c2f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.400036 Oct 19 01:17:04.550124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.551083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.552852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:04.555299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:04.556825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:04.577131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2759/5406] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:04 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:04.911830 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b914d9a-e032-4ff4-875a-3a20c8f622bb tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1655 microversion: 2.1 time: 0.391239 Oct 19 01:17:04.923311 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2648/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:04 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1655 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:05.047466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:05.048203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:05.067086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.070824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.071689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:05.073273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.075585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.076378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:05.333677 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:05.350240 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40d8f0ea-f73b-436c-8f50-7ef7174cdae3 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1697 microversion: 2.1 time: 0.306719 Oct 19 01:17:05.351172 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2760/5408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:05 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1697 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:05.580417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:05.582057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:05.613361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.614463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.616304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:05.621964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.622714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.624215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:05.939926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:05.940583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:05.954337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.954876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.955331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:05.956069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:05.956539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:05.957020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:06.103317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:06.114287 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2328fdf-3fc1-4d14-91e0-25686e286ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.539296 Oct 19 01:17:06.131111 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2649/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:05 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:06.309613 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7214a18d-039f-482a-9962-632ba0880d55 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1655 microversion: 2.1 time: 0.371618 Oct 19 01:17:06.311298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2761/5410] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:05 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1655 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:06.382626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:06.383605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:06.391436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:06.392267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:06.393097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:06.394203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:06.394929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:06.395528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:06.687630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:06.710191 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d77dd3e9-a9b5-44a6-b00a-fd6c57bfcecf tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1697 microversion: 2.1 time: 0.332338 Oct 19 01:17:06.713304 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2650/5411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:06 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1697 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:07.146420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:07.147394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:07.158714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.159496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.160293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.161358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.162049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.162857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.334562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:07.335696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:07.346169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.347624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.348375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.361856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.363116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.368077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.438591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:07.458297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1d5c172-2172-46ef-a098-2e8b1626ac11 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.315382 Oct 19 01:17:07.460582 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2762/5412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:07 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:07.740427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26a3da06-3241-469f-9925-c484b0411725 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1655 microversion: 2.1 time: 0.409713 Oct 19 01:17:07.748332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:07.749281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:07.761447 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2651/5413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:07 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1655 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:07.763640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.770942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.771764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.775287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:07.777476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:07.780919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:07.841984 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:08.060834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8414c498-106a-4f95-bf32-f097be7f082e", "name": "network-vif-deleted", "tag": "c99bd356-9c85-45a6-a671-3283b09849d7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:08.111646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:08.112183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:08.116638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:08.151794 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] Creating event network-vif-deleted:c99bd356-9c85-45a6-a671-3283b09849d7 for instance 8414c498-106a-4f95-bf32-f097be7f082e on n-h1-master-1 Oct 19 01:17:08.174872 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-baac45f9-7b54-4539-8301-8316b184ba65 req-dcc638d9-ef17-4937-941d-04de25dd024e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136493 Oct 19 01:17:08.178412 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2652/5414] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:17:08.487756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:08.488679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:08.504139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:08.507713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:08.510213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:08.511909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:08.514095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:08.517609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:08.596371 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:08.964542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:08.986319 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbcce2ac-8d31-4856-a635-62d0dfb56b12 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1682 microversion: 2.1 time: 1.243688 Oct 19 01:17:08.992891 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2763/5415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:07 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1682 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:09.015313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:09.025644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:09.042115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:09.042662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:09.043178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:09.045509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:09.047989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:09.050278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:09.161425 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:09.165250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:09.168867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:09.170285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lazy-loading 'fault' on Instance uuid 8414c498-106a-4f95-bf32-f097be7f082e {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:17:09.311417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:09.334279 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12ec8a25-88cf-4512-beaa-996a51c44a46 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.848857 Oct 19 01:17:09.337447 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2653/5416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:08 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:09.571741 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bc200f3-4489-4a54-876a-0a403c64dc74 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 200 len: 1453 microversion: 2.1 time: 0.541344 Oct 19 01:17:09.580161 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2764/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:08 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 1453 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:10.372596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:10.374092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:10.397582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.398675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.400050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.404371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.407284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.408073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.611075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:10.612668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 8414c498-106a-4f95-bf32-f097be7f082e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:10.631326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.632293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.633497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.636559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.639616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.642934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.706668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] HTTP exception thrown: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Request method failure captured: Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e HTTP/1.1 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0_oT4G9ZNdpjnqllgi2u-D7XWMVW8GV7Ki3kjmTDRkItWaQOSebBnp6cjlVEzUZoeFHGnHPVg3zIxXKLJQdST-scneZMaavlOrRpJqaGXgmKbsdZ3ol_rkPL07Yp1Z3fAgIRZjj8iGG8xKjoydznPydPRVfBEpu6b5l9G-gtiESWq4 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9af39100791e4975a675cac0d34e6818 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestServerMultinode-774876026 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9af39100791e4975a675cac0d34e6818", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9af39100791e4975a675cac0d34e6818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9af39100791e4975a675cac0d34e6818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9af39100791e4975a675cac0d34e6818"}]}] Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestServerMultinode-774876026 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9af39100791e4975a675cac0d34e6818 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestServerMultinode-774876026 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestServerMultinode-774876026-project-admin Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 25f9802b02aa49e398943b2fdfa92fd4 Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestServerMultinode-774876026-project-admin Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8414c498-106a-4f95-bf32-f097be7f082e'} Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:10.710583 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. Oct 19 01:17:10.716424 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:10.717993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Returning 404 to user: Instance 8414c498-106a-4f95-bf32-f097be7f082e could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:10.721879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6fd6466e-a60e-453f-8967-695d5850a327 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e" status: 404 len: 111 microversion: 2.1 time: 0.118276 Oct 19 01:17:10.725704 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2765/5418] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:10 2022] GET /compute/v2.1/servers/8414c498-106a-4f95-bf32-f097be7f082e => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:10.734655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:10.736665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:10.752800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.753507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.760004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.761603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:10.762285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:10.762835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:10.816671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:10.996511 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cae9e529-58be-44ab-b2eb-7e20927936e1 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 204 len: 0 microversion: 2.1 time: 0.268410 Oct 19 01:17:10.997682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2766/5419] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:10 2022] DELETE /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:11.031608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:11.033103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:11.054873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:11.058859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:11.059654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:11.069370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:11.070133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:11.070861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:11.305225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:11.324423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a9d0b7c-27f8-4a1e-a11e-2e9ab9977ee8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.962985 Oct 19 01:17:11.330968 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2654/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:10 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:11.524579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4c34bbc6-7575-48cf-b840-15c5c89b5505 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1654 microversion: 2.1 time: 0.513170 Oct 19 01:17:11.532033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2767/5421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:11 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1654 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:12.347497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:12.348189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:12.362664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:12.363210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:12.363675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:12.364469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:12.364997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:12.369737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:12.556152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:12.558086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:12.571789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:12.575629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:12.576385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:12.577429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:12.580657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:12.582625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:13.377693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:13.390545 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80d3272b-31b3-4258-8f34-3108843b4536 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 1.047083 Oct 19 01:17:13.394568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2655/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:12 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:13.409116 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "name": "network-vif-plugged", "status": "completed", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:13.423077 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57e832df-0748-438b-af4f-c00c0a10cb95 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1654 microversion: 2.1 time: 0.871404 Oct 19 01:17:13.426216 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2768/5423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:12 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1654 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:13.449666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:13.450167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:13.450618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:13.482225 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] Creating event network-vif-plugged:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:17:13.509991 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f7807120-810d-4852-9ce6-47ae33b0a6bf req-3ad7f53b-aacc-4e58-837c-c80c41d22aa5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112761 Oct 19 01:17:13.521312 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2656/5424] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:14.083869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7adb7064-f419-4e4a-8091-558f0ff4992f", "name": "network-vif-deleted", "tag": "61ddfa26-b385-4a6b-ab46-0aeff4d5cd67"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:14.106480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.107340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.108183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.156686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] Creating event network-vif-deleted:61ddfa26-b385-4a6b-ab46-0aeff4d5cd67 for instance 7adb7064-f419-4e4a-8091-558f0ff4992f on n-h2-master-1 Oct 19 01:17:14.185576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3892ff0f-fd41-4fd9-af42-bdd9d9c16eb0 req-3640b5ec-79ed-437b-af1d-e4388d3981c6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106730 Oct 19 01:17:14.188087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2769/5425] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:14.424040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:14.424805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:14.444950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.445764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.446399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.447348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.448514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.449161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.454727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:14.456353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:14.487684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.497236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.497716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.508413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.508925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.513515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.636722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:14.637600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:14.638239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:14.638871 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lazy-loading 'fault' on Instance uuid 7adb7064-f419-4e4a-8091-558f0ff4992f {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:17:14.769835 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1aa08d6-79cb-4574-9edf-05a7f49fdd46 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 200 len: 1453 microversion: 2.1 time: 0.321727 Oct 19 01:17:14.797759 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2770/5426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:14 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 1453 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:14.883396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:14.893511 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad96a804-84b4-416c-a2f4-f3569c37f7a9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.473199 Oct 19 01:17:14.894668 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2657/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:14 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:15.800566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:15.802052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] [instance: 7adb7064-f419-4e4a-8091-558f0ff4992f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:15.819170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:15.820254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:15.821919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:15.822746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:15.827348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:15.829225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:15.862778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] HTTP exception thrown: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Request method failure captured: Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f HTTP/1.1 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT0_oT4G9ZNdpjnqllgi2u-D7XWMVW8GV7Ki3kjmTDRkItWaQOSebBnp6cjlVEzUZoeFHGnHPVg3zIxXKLJQdST-scneZMaavlOrRpJqaGXgmKbsdZ3ol_rkPL07Yp1Z3fAgIRZjj8iGG8xKjoydznPydPRVfBEpu6b5l9G-gtiESWq4 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9af39100791e4975a675cac0d34e6818 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestServerMultinode-774876026 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9af39100791e4975a675cac0d34e6818", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9af39100791e4975a675cac0d34e6818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9af39100791e4975a675cac0d34e6818"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9af39100791e4975a675cac0d34e6818"}]}] Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestServerMultinode-774876026 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9af39100791e4975a675cac0d34e6818 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestServerMultinode-774876026 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestServerMultinode-774876026-project-admin Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 25f9802b02aa49e398943b2fdfa92fd4 Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestServerMultinode-774876026-project-admin Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7adb7064-f419-4e4a-8091-558f0ff4992f'} Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:15.865639 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. Oct 19 01:17:15.871752 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:15.873367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] Returning 404 to user: Instance 7adb7064-f419-4e4a-8091-558f0ff4992f could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:15.874551 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0225da77-bf06-4f74-8125-9a38b599a481 tempest-TestServerMultinode-774876026 tempest-TestServerMultinode-774876026-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f" status: 404 len: 111 microversion: 2.1 time: 0.080464 Oct 19 01:17:15.876027 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2771/5428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:15 2022] GET /compute/v2.1/servers/7adb7064-f419-4e4a-8091-558f0ff4992f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:17:15.923081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:15.924230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:15.941849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:15.942595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:15.943274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:15.944352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:15.945259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:15.946065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:16.336402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:16.355405 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d936dc0-7651-4701-9ce6-98726c9a4b3a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.434534 Oct 19 01:17:16.356739 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2658/5429] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:15 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:17.384450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:17.387989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:17.421649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:17.422413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:17.423018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:17.423883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:17.424428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:17.424908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:17.737889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:17.750588 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-081b00db-936b-4c22-ab31-24d6171b8ba8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1505 microversion: 2.1 time: 0.371425 Oct 19 01:17:17.750588 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2772/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:17 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:18.778806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:18.779666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:18.789619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:18.790123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:18.790577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:18.791563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:18.792545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:18.793096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:19.308803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:19.334774 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7fe307e5-0d31-4663-8a57-25e8244d80b1 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1505 microversion: 2.1 time: 0.564634 Oct 19 01:17:19.335946 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2659/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:18 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:20.363024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:20.364769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:20.384325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:20.385901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:20.387672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:20.390035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:20.393792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:20.394790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:20.700969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:20.712707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5f944d1-c1c4-4726-82f2-99f49a62501c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 200 len: 1508 microversion: 2.1 time: 0.355937 Oct 19 01:17:20.713833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2773/5432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:20 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:20.745168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:20.748284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:20.783090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:20.783736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:20.784302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:20.786764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:20.787365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:20.788636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.146690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:21.157238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a02957d-2e42-4030-ab11-231b6bc7bd4c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.417700 Oct 19 01:17:21.169583 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2660/5433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:20 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:21.192580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:21.194076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:21.201363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.202104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.202561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.203833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.205079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.205696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.459912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3f7c4-be8b-4fdf-b3af-d2ac58406646", "name": "network-vif-unplugged", "status": "completed", "tag": "6df888b4-a8ef-40fc-9137-e5a95899a62d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:21.476449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.482126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.483035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.508372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_external_events [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] Unable to find a host for instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646. Dropping event network-vif-unplugged {{(pid=131450) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 01:17:21.509264 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-351836fb-ab75-458c-af97-8b4c00067c7f req-24b96c99-2e62-4f23-84e7-07c41b2151a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.056388 Oct 19 01:17:21.513091 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2661/5434] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 01:17:21.624044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:21.642054 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a5ccf71-7047-47fe-8c57-f0f01d640ddb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.453899 Oct 19 01:17:21.649134 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2774/5435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:21.671836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:21.672492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:21.683477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.683993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.687084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.687946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.688445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.689233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.952007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:21.960921 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0325862-7292-4483-ad06-85e3e90cd47a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.297109 Oct 19 01:17:21.962199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2662/5436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:21.984472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:21.985388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:21.991747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.992251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.992941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:21.993664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:21.994252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:21.995217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:22.251233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:22.271560 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a3bf2383-16f8-47b8-9170-0c18119d61fe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.290835 Oct 19 01:17:22.276280 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2775/5437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:21 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:22.305190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:22.315162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:22.316499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:22.317446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:22.346132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Going to try to stop instance {{(pid=131450) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:17:22.453424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9b1feed9-af96-43d2-ba97-ddf01a14b325 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.152547 Oct 19 01:17:22.454892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2663/5438] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:17:22 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:17:22.464150 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:22.465251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:22.485125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:22.486850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:22.489032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:22.489928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:22.491515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:22.495193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:22.808658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:22.825742 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe84e96c-ece2-4209-8e5b-5c2b44a66360 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.365594 Oct 19 01:17:22.827756 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2776/5439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:22 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:23.859431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:23.860139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:23.880514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:23.881373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:23.881982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:23.882885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:23.883505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:23.884106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:24.231779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:24.245619 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04cad781-45c7-4de2-aadb-bba1c2f7a8d9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.397782 Oct 19 01:17:24.252963 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2664/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:23 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:25.279548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:25.280257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:25.297964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:25.298820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:25.299491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:25.301114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:25.301860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:25.302533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:25.671252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:25.680181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e6c81c5-0469-4dd7-94e0-2fa4633b6b6c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.405802 Oct 19 01:17:25.682231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2777/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:25 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:26.708829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:26.709459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:26.718998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:26.719930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:26.721339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:26.722375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:26.723070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:26.723822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:27.037458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:27.038148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:27.053392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:27.054733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:27.055190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:27.058237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:27.061190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:27.062118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:27.156699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:27.168334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7a6198d1-3bc0-48ed-a959-6049a5689210 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.463287 Oct 19 01:17:27.170455 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2665/5442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:26 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:27.548821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:27.561243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:27.562889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:27.564540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9ddb2c75-52e2-47d0-b43e-999b960afb1b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2953 microversion: 2.42 time: 0.532264 Oct 19 01:17:27.565171 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2778/5443] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:17:27 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2953 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:17:27.592938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:27.594255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:27.600457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:27.600983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:27.601723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:27.602613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:27.603076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:27.603545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:27.763085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63f15a4b-c461-46a0-862b-391dcac8c648 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.173879 Oct 19 01:17:27.773082 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2666/5444] 10.222.0.27 () {60 vars in 1316 bytes} [Wed Oct 19 01:17:27 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0/os-interface => generated 1829 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:17:28.198436 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:28.199132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:28.210462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:28.211237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:28.211891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:28.213428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:28.214356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:28.214812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:28.455620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:28.461305 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:28.482367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-75bc3428-81a6-44a8-8820-9aec89bda90d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.289106 Oct 19 01:17:28.484261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2779/5445] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:28 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:29.508768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:29.510470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:29.516765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:29.517508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:29.517940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:29.518935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:29.519461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:29.519955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:29.749094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:29.770607 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2a2e79c-b33c-4874-9dac-37d558555f69 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.261144 Oct 19 01:17:29.772843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2667/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:29 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:17:30.800607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:30.803347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:30.818594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:30.820580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:30.821372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:30.823754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:30.824473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:30.825278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:31.036939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:31.046968 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff2bae36-e0a0-42ec-bf66-c83138ce71c2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.253127 Oct 19 01:17:31.047753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2780/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:30 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:32.073387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:32.074975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:32.091254 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:32.098007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:32.098517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:32.099010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:32.099726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:32.100200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:32.100651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:32.468716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:32.481095 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e7495a3-800b-4acc-a81e-dbd1a922171a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1679 microversion: 2.1 time: 0.411444 Oct 19 01:17:32.483783 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2668/5448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:32 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1679 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:33.513067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:33.513847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:33.522567 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:33.527383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:33.528174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:33.528925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:33.531366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:33.532907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:33.533598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:33.655797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:33.666039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:33.675791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:33.677109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:33.677910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:33.678832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:33.679307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:33.679748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:33.787705 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-956e19c3-1443-4fd0-bf74-a750cf1c1661 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action" status: 200 len: 24576 microversion: 2.1 time: 0.138631 Oct 19 01:17:33.789163 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2669/5449] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:17:33 2022] POST /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847/action => generated 24576 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:17:33.894568 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:33.904654 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b939be3a-84a5-4a20-bbf1-4859a1eb8385 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1656 microversion: 2.1 time: 0.396264 Oct 19 01:17:33.905239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2781/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:33 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1656 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:33.946129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:33.961105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:33.963515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:33.964979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:33.996318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Going to try to start instance {{(pid=131450) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:17:34.023187 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:34.061842 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7093a97d-979a-4f64-8c34-75ab4202190f tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.136410 Oct 19 01:17:34.064087 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2670/5451] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:17:33 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:17:34.073905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:34.074750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:34.085129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:34.085839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:34.086289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:34.087015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:34.088199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:34.088728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:34.324032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:34.332966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-542b3096-3b1a-4b91-b41c-3288e5a1b0e8 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 0.264081 Oct 19 01:17:34.333800 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2782/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:34 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:35.358963 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:35.360900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:35.369910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:35.370466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:35.370812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:35.371492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:35.372126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:35.372595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:35.619884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:35.631269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8dd733f-d243-499b-8efb-3f1119db5df7 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1665 microversion: 2.1 time: 0.277932 Oct 19 01:17:35.632084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2671/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:35 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1665 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:36.656490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:36.657146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:36.670970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:36.671802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:36.672427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:36.673365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:36.674012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:36.674608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:36.940921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:36.951209 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-149c5a6e-80b6-41f2-b618-2ab3a90b57a4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.298863 Oct 19 01:17:36.952986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2783/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:36 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:36.974936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:36.975772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:36.983823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:36.985383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:36.986024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:36.987136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:36.987606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:36.988562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:37.293783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:37.304895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a325cffd-d8f6-4aca-b345-210fde29f5ae tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.333896 Oct 19 01:17:37.305500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2672/5455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:36 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:37.334224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:37.335509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:37.342648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:37.343140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:37.343586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:37.344289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:37.345502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:37.346102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:37.694720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:37.704830 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e86c438b-cfed-4d64-a6e1-5f4d11ed3da2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.374433 Oct 19 01:17:37.705670 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2784/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:37 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:37.727642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:37.728298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:37.735120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:37.735613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:37.736053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:37.736979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:37.737619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:37.738070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:37.974063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:37.985694 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-56c39239-89dc-4910-945a-874ec698503e tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.261781 Oct 19 01:17:37.986344 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2673/5457] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:37 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:38.010782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:38.011766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:38.018118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.018612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.019053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.019758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.020231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.020756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.277665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:38.288902 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1bd1809c-fab2-48e7-bea6-94be609800e0 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.282610 Oct 19 01:17:38.290276 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2785/5458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:38 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:38.312649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:38.313196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:38.319372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.319873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.320314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.321048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.321556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.322189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.348257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lazy-loading 'flavor' on Instance uuid 8293bf46-db0a-4343-96e4-b0651449064e {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:17:38.422571 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d99feca7-4368-44b3-96d1-a636102e25c4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.113629 Oct 19 01:17:38.423591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2674/5459] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:17:38 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:17:38.432635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:38.433270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:38.439715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.440195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.440651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.441585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:38.442040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:38.442684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:38.717375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:38.726658 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e494ecf-824a-442b-b5b6-e175c01ec9de tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1677 microversion: 2.1 time: 0.298682 Oct 19 01:17:38.727479 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2786/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:38 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:39.753453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:39.755220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:39.757621 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:17:39.757774 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e (ip 10.222.0.27) !!! Oct 19 01:17:39.773920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:39.774601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:39.777860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:39.780841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:39.781573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:39.782110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:40.439293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:40.447818 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c49eaccd-114e-4957-89bd-f2e04dbf1500 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1660 microversion: 2.1 time: 0.698423 Oct 19 01:17:40.449380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2675/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:39 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1660 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:40.471128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:40.471724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:40.479334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:40.479818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:40.480286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:40.481009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:40.481466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:40.481890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:40.561474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-616d6294-76dd-4074-a6ff-199c502c2c6d tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action" status: 202 len: 0 microversion: 2.1 time: 0.094003 Oct 19 01:17:40.562650 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2787/5462] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:17:40 2022] POST /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:17:40.571216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:40.572106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:40.578974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:40.580951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:40.581577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:40.582642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:40.583277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:40.583900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:40.936818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:40.950023 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6a5858d-6497-474b-b97b-da06e7484f8a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1666 microversion: 2.1 time: 0.382896 Oct 19 01:17:40.964645 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2676/5463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:40 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:41.978522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:41.979316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:41.992838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:41.993448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:42.000440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.000977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.001421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.002136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.002586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.005372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.006050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.006673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.007651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.008336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.009353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.012760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.068291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:42.239540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ab598fb-2b36-43d2-a519-fa2c4eebf37f tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 204 len: 0 microversion: 2.1 time: 0.250225 Oct 19 01:17:42.240149 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2677/5464] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:41 2022] DELETE /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:42.245415 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:42.256087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.256521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.257083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.277033 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] Creating event network-changed:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:17:42.284540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b9eb140c-6ff2-4caa-894f-23959f35d59a req-6078de9d-adaa-4dc5-adac-b1d2700429c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042886 Oct 19 01:17:42.285534 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2678/5465] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:42.292118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:42.293422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:42.301044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.301603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.302052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.302857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:42.303358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:42.304306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:42.315880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:42.327922 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bc5f8d1-32ec-48f9-ab90-03eabb48c8e9 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1666 microversion: 2.1 time: 0.355018 Oct 19 01:17:42.329725 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2788/5466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:41 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1666 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:42.573397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:42.593598 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c425de5-5820-47ca-a958-001b3cc11229 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1688 microversion: 2.1 time: 0.306595 Oct 19 01:17:42.614491 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2679/5467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:42 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1688 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:43.355981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:43.358437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:43.370550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.373275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.374003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:43.375882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.376748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.377515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:43.621005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:43.621902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:43.640830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.641337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.641783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:43.642588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.643680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.644125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:43.694227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:43.704003 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9a9d4c4-acff-437f-9455-7166a66a4faf tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.354331 Oct 19 01:17:43.705325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2789/5468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:43 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:43.734745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:43.740905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:43.755468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.760023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.760485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:43.761273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:43.761753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:43.766064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:44.126139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:44.143185 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9962f4e2-5379-4be8-8eb9-8ba2ee2fdc81 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1688 microversion: 2.1 time: 0.526544 Oct 19 01:17:44.156656 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2680/5469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:43 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1688 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:44.158511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:44.167778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b8064241-7c1a-40fe-8e8d-da9e7396630a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1669 microversion: 2.1 time: 0.444688 Oct 19 01:17:44.182363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2790/5470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:43 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1669 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:44.196305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:44.197156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:44.215852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:44.216500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:44.216996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:44.217807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:44.218340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:44.218783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:44.250994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:44.257826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Working on deleting snapshot 5d011b39-e75d-40b3-aa16-c8c2b0d6e735 from shelved instance... Oct 19 01:17:45.169293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:45.170337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:45.188132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:45.189206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:45.202582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:45.203353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:45.203838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:45.204278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:45.228658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Doing local delete in cell 14b19ff0-767d-450c-8ab1-ff19c378cca7(cell1) {{(pid=131450) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 19 01:17:45.229405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:45.229900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:45.232068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:45.234630 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 19 01:17:45.244353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] deallocate_for_instance() {{(pid=131450) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 19 01:17:45.370335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2052fd7bb1ee432cb3ca4ec07698292c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44453298a7d04311bd64354938bf2431', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:45.385383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-310354a4-80cc-4c4d-9893-0e577b26a013 tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 200 len: 1352 microversion: 2.1 time: 0.220340 Oct 19 01:17:45.398608 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2791/5471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:45 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 1352 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:45.409246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dfb7e4-8cd2-4d89-b555-2932f9916847", "name": "network-vif-deleted", "tag": "4a86d524-667d-4f7a-b168-03db8b832ee1"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:45.420999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:45.421579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:45.422691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:45.442461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] Creating event network-vif-deleted:4a86d524-667d-4f7a-b168-03db8b832ee1 for instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 on n-h2-master-1 Oct 19 01:17:45.452093 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3e65df87-338a-4b09-bd21-d722ac1b3155 req-f47fc742-dc38-4dff-add9-4418735275b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050681 Oct 19 01:17:45.453528 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2792/5472] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:46.359985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88b3f7c4-be8b-4fdf-b3af-d2ac58406646", "name": "network-vif-deleted", "tag": "6df888b4-a8ef-40fc-9137-e5a95899a62d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:46.366575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Updating instance_info_cache with network_info: [] {{(pid=131450) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 19 01:17:46.375707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.376672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.377391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.393358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.compute.server_external_events [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] Unable to find a host for instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646. Dropping event network-vif-deleted {{(pid=131449) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 01:17:46.393878 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:46.395584 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-88d97c6e-5ee6-43b5-94d6-9a4b922cfa83 req-2ba56873-4ac9-4d3d-8877-39bedaf2bcec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.039876 Oct 19 01:17:46.397255 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2793/5473] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 19 01:17:46.414119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:46.415507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] [instance: 71dfb7e4-8cd2-4d89-b555-2932f9916847] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:46.426371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.427568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.428431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.429913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.431363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.432154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.455511 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] HTTP exception thrown: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Request method failure captured: Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 HTTP/1.1 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT02PfvuF5FK-lBYAeCKONFvpt4ZHToQuDk2Ar_tRRoKUn6i4vEK-w4vv0Sk1lxhkD_gGcWdlOyz8JKtAAQyEGgNfJq1EbZcdieQDaH9mkE4sZDd0stSc0B369XZ8beaQ5Lc-s6ZeewsCa6jSUIHxJw6m_iVfHGPRK_ACVNpPPcRODpg Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_44453298a7d04311bd64354938bf2431", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/44453298a7d04311bd64354938bf2431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/44453298a7d04311bd64354938bf2431"}]}] Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 44453298a7d04311bd64354938bf2431 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-7854411 Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2052fd7bb1ee432cb3ca4ec07698292c Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-7854411-project Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '71dfb7e4-8cd2-4d89-b555-2932f9916847'} Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:46.458527 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. Oct 19 01:17:46.465137 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.467390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Returning 404 to user: Instance 71dfb7e4-8cd2-4d89-b555-2932f9916847 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:46.468528 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e95c438c-f803-4f7c-8331-ef7a1d762aff tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847" status: 404 len: 111 microversion: 2.1 time: 0.060835 Oct 19 01:17:46.473657 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2794/5474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:46 2022] GET /compute/v2.1/servers/71dfb7e4-8cd2-4d89-b555-2932f9916847 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:46.776852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8226ee5-24b6-45b4-bf09-50a1ee480625 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 204 len: 0 microversion: 2.1 time: 2.585703 Oct 19 01:17:46.777806 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2681/5475] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:44 2022] DELETE /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 0 bytes in 2588 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:17:46.787075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:46.787810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 88b3f7c4-be8b-4fdf-b3af-d2ac58406646] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:46.803333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.803956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.804479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.805310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.805952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.806969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.835781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 HTTP/1.1 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '88b3f7c4-be8b-4fdf-b3af-d2ac58406646'} Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:46.838322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 404 to user: Instance 88b3f7c4-be8b-4fdf-b3af-d2ac58406646 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83c47e3e-ac64-409d-ac19-d01df350f517 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646" status: 404 len: 111 microversion: 2.1 time: 0.058039 Oct 19 01:17:46.847679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2795/5476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:46 2022] GET /compute/v2.1/servers/88b3f7c4-be8b-4fdf-b3af-d2ac58406646 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:46.850475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:46.851325 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:46.858958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.859653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.860715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.861591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:46.862059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:46.862499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:46.895908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:47.018238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47ed5ed7-37d1-47af-beac-6a46a331b632 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 204 len: 0 microversion: 2.1 time: 0.172641 Oct 19 01:17:47.029130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:47.029756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:47.034809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2682/5477] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:46 2022] DELETE /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:47.038598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:47.039297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:47.040003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:47.040947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:47.041584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:47.042243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:47.195323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:47.217392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-233660ce-1491-42ea-9f86-dacdcddb5ffb tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1465 microversion: 2.1 time: 0.193505 Oct 19 01:17:47.239244 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2796/5478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:47 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:48.253494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:48.258891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:48.278397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:48.281331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:48.282722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:48.286551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:48.287373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:48.288051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:48.498069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:48.509708 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c1805e0-904f-49b7-af9e-5cd16d4a4389 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1465 microversion: 2.1 time: 0.268236 Oct 19 01:17:48.511664 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2683/5479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:48 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:49.535421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:49.535986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:49.543155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:49.543648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:49.544087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:49.550202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:49.551543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:49.553451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:49.714410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:49.726248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee0954f2-53c4-4efe-829c-648a2b7f9be9", "name": "network-vif-deleted", "tag": "4728fb5b-cfaf-4c3a-b34f-105414666ba1"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:49.736242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0bdf6a0-1bd3-4bbe-944e-ef6bafd62e52 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 200 len: 1465 microversion: 2.1 time: 0.204743 Oct 19 01:17:49.737453 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2797/5480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:49 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 1465 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:49.758019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:49.759031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:49.759873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:49.779061 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] Creating event network-vif-deleted:4728fb5b-cfaf-4c3a-b34f-105414666ba1 for instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 on n-h2-master-1 Oct 19 01:17:49.786590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a36a6cd3-8814-4b40-adc2-9eddb4e2edc7 req-906df8c9-4085-4cac-aa64-ea7329c2e5db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063881 Oct 19 01:17:49.787889 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2684/5481] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:17:50.765639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:50.766870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: ee0954f2-53c4-4efe-829c-648a2b7f9be9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:50.778025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:50.778767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:50.779417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:50.780127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:50.780948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:50.781374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:50.786369 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:50.800297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 HTTP/1.1 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ee0954f2-53c4-4efe-829c-648a2b7f9be9'} Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:50.802344 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. Oct 19 01:17:50.807636 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:50.809617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 404 to user: Instance ee0954f2-53c4-4efe-829c-648a2b7f9be9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:50.810673 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e11d5958-d94f-4a63-8d67-d552ab19ca9a tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9" status: 404 len: 111 microversion: 2.1 time: 0.048890 Oct 19 01:17:50.811434 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2798/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:50 2022] GET /compute/v2.1/servers/ee0954f2-53c4-4efe-829c-648a2b7f9be9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:17:50.820569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:50.821462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:50.831089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:50.831993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:50.832711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:50.834668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:50.835334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:50.835954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:50.875891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:51.004123 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37243b73-f6f8-484c-b927-5cefbabbe194 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 204 len: 0 microversion: 2.1 time: 0.187156 Oct 19 01:17:51.005674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2685/5483] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:50 2022] DELETE /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:51.016280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:51.017590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:51.026531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:51.027424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:51.028419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:51.029604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:51.030383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:51.031298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:51.272280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:51.288567 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d38ce1c2-7a7e-4d20-8382-b8ef3e252749 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1508 microversion: 2.1 time: 0.278253 Oct 19 01:17:51.290453 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2799/5484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:51 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:52.315545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:52.316433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:52.326859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:52.327342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:52.327996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:52.329265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:52.329742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:52.331384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:52.736829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:52.746649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4585ee57-357b-44df-bdd2-2681a8017a84 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1508 microversion: 2.1 time: 0.437103 Oct 19 01:17:52.764813 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2686/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:52 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:53.176918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3a404bf-1b57-476c-9906-310aea3497cd tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] Calling method '.version_select at 0x7f2af42e5550>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:53.199324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3a404bf-1b57-476c-9906-310aea3497cd tempest-TestNetworkAdvancedServerOps-7854411 tempest-TestNetworkAdvancedServerOps-7854411-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389011479" status: 202 len: 0 microversion: 2.1 time: 0.026234 Oct 19 01:17:53.200209 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2800/5486] 10.222.0.27 () {58 vars in 1284 bytes} [Wed Oct 19 01:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1389011479 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:17:53.366756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a730f888-496d-407e-adcb-4c7397cb6d31", "name": "network-vif-deleted", "tag": "0357b2eb-17c1-4d80-b28c-34a65815b19c"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:53.410637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:53.411559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:53.425627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:53.453290 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] Creating event network-vif-deleted:0357b2eb-17c1-4d80-b28c-34a65815b19c for instance a730f888-496d-407e-adcb-4c7397cb6d31 on n-h1-master-1 Oct 19 01:17:53.470806 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0d1a2eea-c41e-413a-b6a7-460d69ca75d6 req-9bf8a2f5-d6f3-424b-b506-189e464fc919 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110790 Oct 19 01:17:53.471565 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2687/5487] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:53.771165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:53.772201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:53.789024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:53.791263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:53.792030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:53.793232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:53.795399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:53.797160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:53.873397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:53.873897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:53.875447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:53.876228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lazy-loading 'fault' on Instance uuid a730f888-496d-407e-adcb-4c7397cb6d31 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:17:53.944773 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:53.964164 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a6fc25a-ecb8-42fe-a0b0-3b8fda21de70 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 200 len: 1305 microversion: 2.1 time: 0.193177 Oct 19 01:17:53.964990 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2801/5488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:53 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 1305 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:54.994900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:54.997725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: a730f888-496d-407e-adcb-4c7397cb6d31] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:55.013707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.017078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.019714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.020740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.021689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.022313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.053312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 HTTP/1.1 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: exception: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'a730f888-496d-407e-adcb-4c7397cb6d31'} Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:55.056338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. Oct 19 01:17:55.062055 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:17:55.066365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 404 to user: Instance a730f888-496d-407e-adcb-4c7397cb6d31 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:55.067701 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1f4df85-81df-437c-b8bd-6223e393c031 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31" status: 404 len: 111 microversion: 2.1 time: 0.080282 Oct 19 01:17:55.068658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2688/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:54 2022] GET /compute/v2.1/servers/a730f888-496d-407e-adcb-4c7397cb6d31 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:55.077792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:55.078440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:55.101971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.103145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.103787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.114421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.115499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.116154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.170712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:55.354239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-823315e4-89cf-4f7d-85b6-32ed76eb4dc4 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 204 len: 0 microversion: 2.1 time: 0.280199 Oct 19 01:17:55.356489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2802/5490] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:55 2022] DELETE /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:55.365886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:55.366749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:55.375969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.376844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.377618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.378642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:55.380975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:55.381867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:55.612225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:55.620963 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6dc6257f-9417-4a2d-8f99-f4271e68b2e6 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1494 microversion: 2.1 time: 0.260431 Oct 19 01:17:55.621886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2689/5491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:55 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1494 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:56.584887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0621388c-6cae-479f-baf4-ff0527d733ec", "name": "network-vif-deleted", "tag": "7af61c54-4dc5-4c48-a17f-fcede1e5718f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:17:56.603394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:56.606406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:56.607351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:56.646159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:56.647125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:56.675851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] Creating event network-vif-deleted:7af61c54-4dc5-4c48-a17f-fcede1e5718f for instance 0621388c-6cae-479f-baf4-ff0527d733ec on n-h2-master-1 Oct 19 01:17:56.678046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:56.684789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:56.686981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:56.687960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:56.690345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b7c7ec59-a555-47b5-9932-ac04975db533 req-8752b7f4-69d8-486d-bc14-6364b8c3c8ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118217 Oct 19 01:17:56.692907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:56.694573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:56.695333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2803/5492] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:17:56.842528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:56.851589 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f36dd229-20fb-42ba-a20c-f09a29f07337 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 200 len: 1286 microversion: 2.1 time: 0.210424 Oct 19 01:17:56.855903 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2690/5493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:56 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 1286 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:57.878729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:57.879450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 0621388c-6cae-479f-baf4-ff0527d733ec] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:57.898758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:57.900282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:57.901297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:57.901509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:57.901981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:57.902414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:57.941861 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec HTTP/1.1 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0621388c-6cae-479f-baf4-ff0527d733ec'} Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:17:57.943791 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. Oct 19 01:17:57.950323 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:17:57.954527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 404 to user: Instance 0621388c-6cae-479f-baf4-ff0527d733ec could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:17:57.956063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13b9a5ad-6a60-41f8-b830-2e1a937d2cfe tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec" status: 404 len: 111 microversion: 2.1 time: 0.081842 Oct 19 01:17:57.957279 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2804/5494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:57 2022] GET /compute/v2.1/servers/0621388c-6cae-479f-baf4-ff0527d733ec => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:17:57.967060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:57.968459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:57.981624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:57.982381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:57.983051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:57.984422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:57.985168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:57.986593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:58.030266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:17:58.146051 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:UPDATE=16,nova_cell1:SELECT=80,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:17:58.259743 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6ae8056a-a865-425c-aaad-c6a59f6ae4e2 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 204 len: 0 microversion: 2.1 time: 0.297948 Oct 19 01:17:58.260746 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2691/5495] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:17:57 2022] DELETE /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:17:58.277140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:58.279737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:58.286729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:58.287527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:58.288530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:58.290323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:58.290969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:58.291596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:58.627670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:17:58.637512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e81e56a-4c44-4038-a401-3ee6b8467fd3 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1675 microversion: 2.1 time: 0.371878 Oct 19 01:17:58.643429 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2805/5496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:58 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1675 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:17:59.662990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:17:59.663704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:17:59.670992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:59.671555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:59.671997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:59.672718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:17:59.673175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:17:59.673603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:17:59.986574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:00.006692 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da8cb0dd-e8f9-4b3f-8dc9-f43b48fa2611 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1675 microversion: 2.1 time: 0.347109 Oct 19 01:18:00.009500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2692/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:17:59 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1675 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:01.036585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:01.038011 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:01.048683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:01.049584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:01.050912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:01.051918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:01.052675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:01.054052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:01.259316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:01.268670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e34cdb7-fea4-47a0-b42b-0feb1ce8ed9b tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1608 microversion: 2.1 time: 0.237410 Oct 19 01:18:01.272586 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2806/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:01 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1608 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:01.520695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8293bf46-db0a-4343-96e4-b0651449064e", "name": "network-vif-deleted", "tag": "60731a8b-c069-496a-bd4f-65a183a8807d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:01.553498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:01.554225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:01.556918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:01.598832 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] Creating event network-vif-deleted:60731a8b-c069-496a-bd4f-65a183a8807d for instance 8293bf46-db0a-4343-96e4-b0651449064e on n-h1-master-1 Oct 19 01:18:01.619709 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3a5be385-bcc3-42fe-9abe-fe8fa3a71747 req-4fb50e04-3b13-413e-a1f3-cbc407411801 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103177 Oct 19 01:18:01.624062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2693/5499] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:02.297121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:02.297935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:02.311629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:02.316206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:02.318491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:02.321827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:02.322386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:02.326455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:02.428329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:02.433426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:02.434094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:02.434763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lazy-loading 'fault' on Instance uuid 8293bf46-db0a-4343-96e4-b0651449064e {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:18:02.494363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d97060e766f4e1f982d64b425ddd184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235a5608bd9142dcbfb621873d3999a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:02.503297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9081a461-f5d8-4936-928a-6eabc9c87933 tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 200 len: 1328 microversion: 2.1 time: 0.211682 Oct 19 01:18:02.505535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2807/5500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:02 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 1328 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:03.533052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:03.534504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] [instance: 8293bf46-db0a-4343-96e4-b0651449064e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:03.536782 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:03.554085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:03.555513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:03.556172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:03.557541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:03.561253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:03.561921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:03.593154 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] HTTP exception thrown: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Request method failure captured: Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e HTTP/1.1 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT04syADqFkfSdmAQ0a6KXhOLgeDErWZfx2fOL9hHqESLdakroQXHEffPSSTCYhXynXIoGSNkGOO_H1zTQLk95BckdjhBXwJ9aiiON4_RgDx_Ph-ta2A3AODQ14wmGZOwXhU8TPBfmjT_udzZR6b-Hw4iA4HUiR6EfBvZU_37De2qNZE Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_235a5608bd9142dcbfb621873d3999a7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/235a5608bd9142dcbfb621873d3999a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/235a5608bd9142dcbfb621873d3999a7"}]}] Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-945752225 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 235a5608bd9142dcbfb621873d3999a7 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-945752225 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2d97060e766f4e1f982d64b425ddd184 Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-945752225-project Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '8293bf46-db0a-4343-96e4-b0651449064e'} Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:18:03.601786 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. Oct 19 01:18:03.607475 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:03.609402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Returning 404 to user: Instance 8293bf46-db0a-4343-96e4-b0651449064e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:18:03.610550 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8525c44f-4e14-4fb9-a22b-73bf7519dfed tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e" status: 404 len: 111 microversion: 2.1 time: 0.083178 Oct 19 01:18:03.614694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2694/5501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:03 2022] GET /compute/v2.1/servers/8293bf46-db0a-4343-96e4-b0651449064e => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:18:03.620405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8a1b762-f0f2-4221-9159-4b9d575e974c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] Calling method '.version_select at 0x7f2af50faca0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:03.639009 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:03.662882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8a1b762-f0f2-4221-9159-4b9d575e974c tempest-ServerActionsTestJSON-945752225 tempest-ServerActionsTestJSON-945752225-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259284986" status: 202 len: 0 microversion: 2.1 time: 0.046972 Oct 19 01:18:03.673625 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2808/5502] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:18:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259284986 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:18:10.146252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d9a549b-13e2-4c89-85e0-79e362b68858 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: .version_select at 0x7f2af45c3e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-766194722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb/B6rytnvj+6GPeN26dj9MQbygHdPvKnLZUPxmOFwBybqp4nz6N0h/0eF0Mn556H3ZILwSTLsLPopironaVlys3qWPEp8fAiWaGmPrx4LPZTtpxlXej67Rrfcm6wsqEg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:10.175706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9d9a549b-13e2-4c89-85e0-79e362b68858 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:18:10.183414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-9d9a549b-13e2-4c89-85e0-79e362b68858 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:18:10.221661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d9a549b-13e2-4c89-85e0-79e362b68858 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.079371 Oct 19 01:18:10.223406 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2695/5503] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:18:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:13.315408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2053015711", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "6a02bd48-beac-499e-ac13-226ea49f096f"}], "key_name": "tempest-TestNetworkBasicOps-766194722", "security_groups": [{"name": "tempest-secgroup-smoke-1518640408"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:13.349458 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:13.529653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] validate_networks() for [('6a02bd48-beac-499e-ac13-226ea49f096f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:18:14.742711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:18:14.743437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:18:14.743604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:18:14.744335 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:18:14.744972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:18:14.781612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:14.782105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:14.790944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:14.796972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:14.797568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:14.798259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:14.828713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:18:14.837024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:18:14.853092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:18:14.857293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:18:14.931942 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9cda1b2f-58e9-4faa-850e-116a90c83a6d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.620477 Oct 19 01:18:14.933479 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2809/5504] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:18:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:18:14.942485 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:14.948011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9b1cb42-72f2-4d8e-9b56-1fb8c829a971 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:14.948820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9b1cb42-72f2-4d8e-9b56-1fb8c829a971 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:15.142462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9b1cb42-72f2-4d8e-9b56-1fb8c829a971 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:15.154413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9b1cb42-72f2-4d8e-9b56-1fb8c829a971 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1248 microversion: 2.1 time: 0.213299 Oct 19 01:18:15.155146 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2696/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:14 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1248 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:16.185191 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:16.185992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:16.208587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:16.216480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:16.229716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:16.230776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:16.231838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:16.232382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:16.451988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:16.470032 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6fb7d3b8-9501-4e93-a4f9-cfc1e42a915e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1252 microversion: 2.1 time: 0.290337 Oct 19 01:18:16.471437 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2810/5506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:16 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1252 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:17.494877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:17.495507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:17.519548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:17.520378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:17.521168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:17.522107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:17.522814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:17.523437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:17.669462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:17.690568 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd4cbbcc-f7e4-427c-80ed-a5446987da72 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1306 microversion: 2.1 time: 0.200210 Oct 19 01:18:17.692285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2697/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:17 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1306 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:18.716788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:18.717512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:18.733725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:18.735925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:18.738460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:18.740762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:18.745079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:18.745993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:19.015986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:19.029039 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ed42954-a435-4753-bd4a-d20012b99ab8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1306 microversion: 2.1 time: 0.315231 Oct 19 01:18:19.031814 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2811/5508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:18 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1306 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:20.056194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:20.057448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:20.071505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:20.072008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:20.072451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:20.076017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:20.076736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:20.078339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:20.334966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:20.350160 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de7ada91-6486-47ef-aa66-3556f5476ede tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.298159 Oct 19 01:18:20.369401 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2698/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:20 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:21.377910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:21.378587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:21.387208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:21.391776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:21.392237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:21.393004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:21.393649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:21.394289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:21.673891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:21.689512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b32f1bd4-bb0e-4f87-9ac7-d1114e345f1d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.315668 Oct 19 01:18:21.690603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2812/5510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:21 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:22.718945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:22.719764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:22.733246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:22.734306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:22.735031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:22.736018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:22.736869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:22.737743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:23.354418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b560eb7b-83e3-4758-b7fb-33dea48ee37a", "tag": "5a11ae38-b70d-4135-8823-882eaaadac86"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:23.379287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:23.380032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:23.380698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:23.392567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:23.411206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-103797d6-aa7c-43ef-bd06-4f469b60948a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.696586 Oct 19 01:18:23.412096 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2699/5511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:22 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:23.430759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] Creating event network-changed:5a11ae38-b70d-4135-8823-882eaaadac86 for instance b560eb7b-83e3-4758-b7fb-33dea48ee37a on n-h2-master-1 Oct 19 01:18:23.442201 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1cb90c35-04fd-4ebf-a28a-6e9e65b577c2 req-20c51dbd-6da7-452a-91e4-e9a87468907f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093034 Oct 19 01:18:23.443010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2813/5512] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:24.444269 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:24.446733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:24.486138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:24.487484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:24.495647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:24.497205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:24.497982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:24.498676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:24.787249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:24.798917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-88693cf9-3c40-4268-9866-60cd537f33e8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.367291 Oct 19 01:18:24.804397 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2700/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:24 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:25.841050 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:25.843579 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:25.850695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:25.851678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:25.867660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:25.868979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:25.869620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:25.870925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:25.871603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:25.872356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:26.119732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:26.129306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-067e4c44-9ee4-4c59-8c1e-5a480a58e900 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.294588 Oct 19 01:18:26.129902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2814/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:25 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:27.156123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:27.157777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:27.161252 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:27.176192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:27.183646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:27.184456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:27.185528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:27.186209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:27.186856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:27.532672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:27.554883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17805551-f7ff-4b1a-85e1-c5a5520f5eb3 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.397451 Oct 19 01:18:27.555733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2701/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:27 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:18:28.579780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:28.580420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:28.591953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:28.600197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:28.601405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:28.602457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:28.603994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:28.604440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:28.933962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:28.943832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-664f508e-8106-48d6-9b16-a4214cb7c098 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.368196 Oct 19 01:18:28.966131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2815/5516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:28 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:29.052393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1101208925", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "c9482945-1a8f-4b20-8c74-21b6e7b4c270"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:29.117594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] validate_networks() for [('c9482945-1a8f-4b20-8c74-21b6e7b4c270', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:18:29.723770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:18:29.724199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:18:29.724705 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:18:29.725129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:18:29.725613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:18:29.737186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:29.738269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:29.738719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:29.739602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:29.740087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:29.740527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:29.763229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Getting quotas for project 5a867629c8954f369fe6a31d699131ae. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:18:29.770950 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Getting quotas for user f486ab1581c34819a271e7ec8d3886f1 and project 5a867629c8954f369fe6a31d699131ae. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:18:29.797368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:18:29.800939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:18:29.917975 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-453d9c5e-a2a4-495b-b3cd-fe0f7e181952 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025826 Oct 19 01:18:29.935934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2702/5517] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:18:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:18:29.942197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f762b9f-34a8-4493-ab06-95fdaaa4714a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:29.942939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f762b9f-34a8-4493-ab06-95fdaaa4714a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:29.974245 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:29.975310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:30.008014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:30.008539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:30.009015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:30.013030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:30.014483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:30.015085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:30.063215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f762b9f-34a8-4493-ab06-95fdaaa4714a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:30.077218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f762b9f-34a8-4493-ab06-95fdaaa4714a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1217 microversion: 2.1 time: 0.135822 Oct 19 01:18:30.077850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2816/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:29 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1217 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:30.392227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:30.407874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-794574ca-a24d-4901-8e26-d7fc956fcdf8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.440047 Oct 19 01:18:30.409134 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2703/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:29 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:30.933498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b560eb7b-83e3-4758-b7fb-33dea48ee37a", "name": "network-vif-plugged", "status": "completed", "tag": "5a11ae38-b70d-4135-8823-882eaaadac86"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:30.962563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:30.964203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:30.964677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:30.986369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] Creating event network-vif-plugged:5a11ae38-b70d-4135-8823-882eaaadac86 for instance b560eb7b-83e3-4758-b7fb-33dea48ee37a on n-h2-master-1 Oct 19 01:18:30.994228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a577c59f-f4c3-451f-9a75-afaccc1661b3 req-6850d53a-f3ae-42eb-b335-31b0bce9d84a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065168 Oct 19 01:18:30.995150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2817/5520] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:31.112248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:31.113474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:31.122845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:31.123610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:31.124237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:31.125275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:31.125887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:31.126610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:31.223691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:31.233233 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-465b71d4-2a89-4539-9dd0-9891cdcd426d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1221 microversion: 2.1 time: 0.131561 Oct 19 01:18:31.247828 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2704/5521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:31 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:31.439205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:31.440306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:31.450593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:31.451484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:31.452168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:31.454503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:31.456036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:31.457374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:31.778093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:31.787325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9117d9c-47d8-4682-bd5d-1dc7820c8bc0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1374 microversion: 2.1 time: 0.355085 Oct 19 01:18:31.788352 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2818/5522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:31 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1374 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:32.262993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:32.271399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:32.287611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:32.288573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:32.289290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:32.291604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:32.293981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:32.294822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:32.497887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:32.514359 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e435963-77fc-4edd-82cb-9e12c9feae6e tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1287 microversion: 2.1 time: 0.255143 Oct 19 01:18:32.531444 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2705/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:32 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1287 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:32.813380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:32.814572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:32.825306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:32.826460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:32.827029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:32.828151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:32.829225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:32.829931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:33.199030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:33.208122 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7cfe09d4-7524-4233-9bc8-96208ba07e54 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1547 microversion: 2.1 time: 0.400473 Oct 19 01:18:33.215327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2819/5524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:32 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1547 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:33.242045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:33.243057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:33.259206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:33.259717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:33.262630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:33.266628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:33.267153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:33.267857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:33.543440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:33.544075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:33.559859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:33.560369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:33.567642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:33.568779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:33.570162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:33.571055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:33.590688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:33.610696 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3b590f9-05e4-4fa0-b43e-3be6aab69187 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1547 microversion: 2.1 time: 0.371436 Oct 19 01:18:33.614964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2706/5525] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:33 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1547 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:33.693616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:33.705144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1b6630b-f919-437c-9053-29383715d7d7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1275 microversion: 2.1 time: 0.165569 Oct 19 01:18:33.706773 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2820/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:33 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:34.731125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:34.731746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:34.734927 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:34.741749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:34.742240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:34.742871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:34.743614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:34.744043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:34.744658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:35.532780 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:35.540747 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ed6b4063-0f0a-4e80-be8b-45794b1d4d72 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.813717 Oct 19 01:18:35.555996 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2707/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:34 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:35.876954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da525ce-bee5-4e10-a191-43231c26fd94", "tag": "dda093f2-13c7-44a2-8fbf-bdcad892248e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:35.901017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:35.904788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:35.905434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:35.940027 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] Creating event network-changed:dda093f2-13c7-44a2-8fbf-bdcad892248e for instance 1da525ce-bee5-4e10-a191-43231c26fd94 on n-h1-master-1 Oct 19 01:18:35.950815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dec4bbed-e5b2-4143-aaf5-1ec4ad2524d1 req-fcf0e13d-1c5a-4ef2-9bc5-5533137d1147 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078042 Oct 19 01:18:35.952968 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2821/5528] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:36.571464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:36.573161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:36.584165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:36.586260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:36.586736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:36.587643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:36.588676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:36.589395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:36.986894 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:37.007574 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a540339a-6ed2-4c66-a31b-4dd6feebdf39 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.445345 Oct 19 01:18:37.011498 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2708/5529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:36 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:37.130161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b560eb7b-83e3-4758-b7fb-33dea48ee37a", "tag": "5a11ae38-b70d-4135-8823-882eaaadac86"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:37.145812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:37.146300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:37.146733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:37.160704 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] Creating event network-changed:5a11ae38-b70d-4135-8823-882eaaadac86 for instance b560eb7b-83e3-4758-b7fb-33dea48ee37a on n-h2-master-1 Oct 19 01:18:37.167401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c08ebe03-d0bf-4d47-86a4-6b084ea0d70a req-db82a149-0e54-44b2-9fcf-a80d6dba579d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042504 Oct 19 01:18:37.168344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2822/5530] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:38.034956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:38.035707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:38.054246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:38.054762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:38.055225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:38.055956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:38.056428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:38.056906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:38.246874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:38.271189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d1875cb-82aa-4012-8f67-cb0625dc2649 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.240826 Oct 19 01:18:38.272295 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2709/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:38 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:39.295428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:39.296762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:39.307141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:39.308910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:39.310780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:39.313994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:39.314671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:39.315331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:39.589852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:39.598593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52d25877-afe6-4a74-97be-7fcd8ced8d3a tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.307542 Oct 19 01:18:39.599535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2823/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:39 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:40.622195 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:40.624075 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:40.630745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:40.632551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:40.642059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:40.643803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:40.644649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:40.645748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:40.646544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:40.647913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:41.174118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:41.187986 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-257361d0-dfb0-4db4-9400-6a12a29bceeb tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.567416 Oct 19 01:18:41.188525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2710/5533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:40 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:41.683903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da525ce-bee5-4e10-a191-43231c26fd94", "name": "network-vif-plugged", "status": "completed", "tag": "dda093f2-13c7-44a2-8fbf-bdcad892248e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:41.702007 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:41.704463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:41.705003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:41.705499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:41.722374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] Creating event network-vif-plugged:dda093f2-13c7-44a2-8fbf-bdcad892248e for instance 1da525ce-bee5-4e10-a191-43231c26fd94 on n-h1-master-1 Oct 19 01:18:41.727423 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c8b29667-698b-47b7-885e-0e704baddcda req-dbba30f7-1e68-49f2-9370-6f0c331b6bf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047492 Oct 19 01:18:41.728347 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2824/5534] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:42.212009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:42.213529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:42.223397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:42.224102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:42.224665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:42.225674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:42.226393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:42.227027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:42.476557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:42.485457 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-975e9950-89c9-4a50-a7d1-e3854507a59d tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1317 microversion: 2.1 time: 0.278223 Oct 19 01:18:42.486598 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2711/5535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:42 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:43.513381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:43.515271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:43.525789 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:43.528998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.529878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.530756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.531662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.532340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.533208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.565596 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=67 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:43.696053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:43.706648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6da234a6-c661-411b-aa2c-6442be825d14 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1506 microversion: 2.1 time: 0.200249 Oct 19 01:18:43.707238 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2825/5536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:43 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:43.737884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:43.738313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.760789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.786532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78ba91b5-7815-459a-b65b-1c98ffdc42cd tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips" status: 200 len: 109 microversion: 2.1 time: 0.059129 Oct 19 01:18:43.787794 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2712/5537] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:18:43 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips => generated 109 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:43.799727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:43.800237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:43.807128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.807623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.808067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.808820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.809289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.809926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.835350 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f66ff324-4b2a-4129-b482-271d1ade460b tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips" status: 200 len: 109 microversion: 2.1 time: 0.039358 Oct 19 01:18:43.836172 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2826/5538] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:18:43 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:43.847442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:43.847947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:43.854584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.855081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.855521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.856221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.856701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.857133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.884650 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c36ef16a-3e1b-4110-9ee8-9a1b123a1e74 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips/tempest-ServerAddressesTestJSON-2126402696-network" status: 200 len: 94 microversion: 2.1 time: 0.039915 Oct 19 01:18:43.885691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2713/5539] 10.222.0.27 () {58 vars in 1401 bytes} [Wed Oct 19 01:18:43 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94/ips/tempest-ServerAddressesTestJSON-2126402696-network => generated 94 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:18:43.899655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:43.901708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:43.908206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.909004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.909551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.910378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:43.910950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:43.911485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:43.943410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:18:44.032063 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6d9df6a-46dc-4a1b-ab67-a4ccd990e7f2 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 204 len: 0 microversion: 2.1 time: 0.136672 Oct 19 01:18:44.033288 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2827/5540] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:18:43 2022] DELETE /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:18:44.050806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:44.051910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:44.072538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:44.073119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:44.073562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:44.074382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:44.074968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:44.075572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:44.291309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:44.296365 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:44.306666 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-876f6181-42ad-48b0-8acd-e704a23001c7 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1512 microversion: 2.1 time: 0.267840 Oct 19 01:18:44.307573 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2714/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:44 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:45.332080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:45.332834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:45.340867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:45.341580 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:45.342213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:45.343157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:45.343827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:45.344475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:45.512661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:45.522028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44725330-87dd-4f1b-b1d1-3a9e45025466 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1512 microversion: 2.1 time: 0.194197 Oct 19 01:18:45.522901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2828/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:45 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:46.394626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da525ce-bee5-4e10-a191-43231c26fd94", "name": "network-vif-deleted", "tag": "dda093f2-13c7-44a2-8fbf-bdcad892248e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:46.415786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:46.416399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:46.418748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:46.437194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] Creating event network-vif-deleted:dda093f2-13c7-44a2-8fbf-bdcad892248e for instance 1da525ce-bee5-4e10-a191-43231c26fd94 on n-h1-master-1 Oct 19 01:18:46.447448 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-22cb84c3-77c3-4b2d-9fe4-a565ed2cc1c4 req-589a14ac-46ee-45b1-9aca-62324becb284 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054950 Oct 19 01:18:46.448394 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2715/5543] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:18:46.549718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:46.551040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:46.566979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:46.567612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:46.568103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:46.569058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:46.569610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:46.570309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:46.639265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:46.639652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:46.640188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:46.640873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lazy-loading 'fault' on Instance uuid 1da525ce-bee5-4e10-a191-43231c26fd94 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:18:46.687632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f486ab1581c34819a271e7ec8d3886f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a867629c8954f369fe6a31d699131ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:18:46.697243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0cc89409-66ac-4d52-bef4-53422783d472 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 200 len: 1307 microversion: 2.1 time: 0.155326 Oct 19 01:18:46.698418 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2829/5544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:46 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 1307 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:18:47.722367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:18:47.723222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] [instance: 1da525ce-bee5-4e10-a191-43231c26fd94] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:47.739151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:47.739869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:47.742241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:47.743154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:47.743789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:47.744379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:47.762304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] HTTP exception thrown: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Request method failure captured: Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 HTTP/1.1 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1BkBV0TtrGt8y66RHxajbWnR0jH2-eZDj96Ge5Hud-gWoKqPq4Zevk1ZCp1SD7vBKHMtn36R2ZgrDwUNUQOmaQ6kjGn6ja3qMqsHPx88YKzJKgW5BJSGQaG2kOPK2dc05DhKEDo4pytmYD43LRv3HVZUaMJZlmye1wNDa6EYAtiS84 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5a867629c8954f369fe6a31d699131ae Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerAddressesTestJSON-443467396 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a867629c8954f369fe6a31d699131ae", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a867629c8954f369fe6a31d699131ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a867629c8954f369fe6a31d699131ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a867629c8954f369fe6a31d699131ae"}]}] Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerAddressesTestJSON-443467396 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5a867629c8954f369fe6a31d699131ae Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerAddressesTestJSON-443467396 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerAddressesTestJSON-443467396-project Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: f486ab1581c34819a271e7ec8d3886f1 Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerAddressesTestJSON-443467396-project Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1da525ce-bee5-4e10-a191-43231c26fd94'} Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:18:47.764321 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. Oct 19 01:18:47.768553 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:18:47.770381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] Returning 404 to user: Instance 1da525ce-bee5-4e10-a191-43231c26fd94 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:18:47.771476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f1f8cec2-64f9-4595-8632-69d9e0e5c5e4 tempest-ServerAddressesTestJSON-443467396 tempest-ServerAddressesTestJSON-443467396-project] 10.222.0.27 "GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94" status: 404 len: 111 microversion: 2.1 time: 0.054092 Oct 19 01:18:47.772911 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2716/5545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:18:47 2022] GET /compute/v2.1/servers/1da525ce-bee5-4e10-a191-43231c26fd94 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:18:57.492178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:18:57.495397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:18:57.502225 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:57.502918 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:18:57.506428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:57.513368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:57.517302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:57.518224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:18:57.518843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:18:57.519427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:18:57.638243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0db1b087-a125-43ee-bb0d-0c8f44521e7b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a/action" status: 200 len: 24572 microversion: 2.1 time: 0.151417 Oct 19 01:18:57.639792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2830/5546] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:18:57 2022] POST /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a/action => generated 24572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:19:01.558250 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=19 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:01.560569 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:01.722346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1764333595", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:01.938930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] validate_networks() for [('45bea8c8-9e8b-42d9-b73f-5c3be6d2167f', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:19:02.555530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:19:02.556001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:19:02.556572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:19:02.557043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:19:02.558344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:19:02.574716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:02.575325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:02.575929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:02.576724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:02.577195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:02.577622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:02.601328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Getting quotas for project ee9420b773e6484188aa45a2aed1bc0e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:19:02.607396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Getting quotas for user 48518217acf44665a9ce74d4a30391bf and project ee9420b773e6484188aa45a2aed1bc0e. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:19:02.622288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:19:02.625956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:19:02.680308 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-551aa148-48df-4061-a04f-cf3b440dcd5d tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.128934 Oct 19 01:19:02.682254 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2717/5547] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:19:02.694838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-675e9a12-c00a-4f25-aa92-f3a0439da3ae tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:02.695609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-675e9a12-c00a-4f25-aa92-f3a0439da3ae tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:02.793397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-675e9a12-c00a-4f25-aa92-f3a0439da3ae tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:02.806354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-675e9a12-c00a-4f25-aa92-f3a0439da3ae tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1224 microversion: 2.1 time: 0.116489 Oct 19 01:19:02.821110 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2831/5548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:02 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:03.845251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:03.846294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:03.860425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:03.861659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:03.862659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:03.863600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:03.864777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:03.865480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:03.973446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:03.983412 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-174239db-c8b6-49b8-9d7e-b3d6fea75521 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1276 microversion: 2.1 time: 0.143247 Oct 19 01:19:03.985119 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2718/5549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:03 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:05.008945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:05.010405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:05.022428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:05.025687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:05.026407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:05.028964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:05.030309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:05.030995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:05.169219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:05.184296 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-644116ad-8e7d-461d-bfb8-188b2e9a48e1 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1282 microversion: 2.1 time: 0.180793 Oct 19 01:19:05.185386 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2832/5550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:05 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1282 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:06.209610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:06.210249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:06.227515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:06.230119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:06.233037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:06.234065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:06.237962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:06.239326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:06.527031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:06.539955 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9153973-5097-492f-83e5-58a01044ae33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1324 microversion: 2.1 time: 0.334448 Oct 19 01:19:06.541321 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2719/5551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:06 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:06.624507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f26be91-47c8-40a9-bfb7-bfbfa8518e80", "tag": "48eefe3c-5a0d-4453-b61e-b86832ece831"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:06.642706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:06.645024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:06.646251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:06.678007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] Creating event network-changed:48eefe3c-5a0d-4453-b61e-b86832ece831 for instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 on n-h1-master-1 Oct 19 01:19:06.694795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-70d86823-d416-49f1-9e12-f72f040079be req-24f56bd8-7d5c-4f02-814a-6ea874202150 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075587 Oct 19 01:19:06.700258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2833/5552] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:07.565822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:07.566994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:07.574612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:07.575397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:07.575991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:07.576849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:07.577581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:07.579222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:07.797448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:07.805674 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac815a77-d2ca-4d91-b499-bc87dbb4f308 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1324 microversion: 2.1 time: 0.244202 Oct 19 01:19:07.806409 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2720/5553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:07 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1324 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:08.898543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:08.901009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:08.923636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:08.924596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:08.925792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:08.927176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:08.928182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:08.928837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:09.374531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:09.383361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5cae5b82-e3fa-45af-95d2-5e011f483bcc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1324 microversion: 2.1 time: 0.556414 Oct 19 01:19:09.384217 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2834/5554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:08 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1324 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:10.417503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:10.418809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:10.433328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:10.439084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:10.440252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:10.441228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:10.442420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:10.443741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:10.668994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:10.679229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31fa026a-36db-41a8-a638-67381a826d4b tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1324 microversion: 2.1 time: 0.275682 Oct 19 01:19:10.680339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2721/5555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:10 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:11.706459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:11.707823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:11.721723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:11.722469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:11.723136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:11.725594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:11.726526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:11.727214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:12.029360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f26be91-47c8-40a9-bfb7-bfbfa8518e80", "name": "network-vif-plugged", "status": "completed", "tag": "48eefe3c-5a0d-4453-b61e-b86832ece831"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:12.061201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:12.061201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:12.061201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:12.081240 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] Creating event network-vif-plugged:48eefe3c-5a0d-4453-b61e-b86832ece831 for instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 on n-h1-master-1 Oct 19 01:19:12.095546 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d32bb949-9e54-4cdf-8191-18567bdaa776 req-121b5b6c-0f62-4cae-bdc6-bd3b3140ad17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070891 Oct 19 01:19:12.096526 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2722/5556] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:19:12.782518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:12.796363 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-290540f5-9493-4457-85b0-9f2823ce0291 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1324 microversion: 2.1 time: 1.093535 Oct 19 01:19:12.797323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2835/5557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:11 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1324 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:12.986407 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:12.987204 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:12.992202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba072e78-cc36-4c82-bff6-d47e0a3e11cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: .version_select at 0x7f2af4b9f160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-397242104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5/SKq43ooQyY4sLs7zViGxLZ9mQnEnmpj5DArmmt92Ed5nxDxxFM+u2bqPVSaFsg4qCp/podNwi/r5XscCJsg4bXCbXHVlG/wamPeeT1ngTn5xM0mbVqUyZ0OKV2pmLA=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:13.011851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ba072e78-cc36-4c82-bff6-d47e0a3e11cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:19:13.017632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ba072e78-cc36-4c82-bff6-d47e0a3e11cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:19:13.058355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba072e78-cc36-4c82-bff6-d47e0a3e11cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.072757 Oct 19 01:19:13.059543 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2723/5558] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:19:12 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:13.822201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:13.823410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:13.833865 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:13.838545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:13.842796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:13.843253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:13.843999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:13.844464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:13.844922 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:14.267194 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:14.280569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10ee299b-66b5-4de5-ab8e-98587cee6379 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1520 microversion: 2.1 time: 0.463858 Oct 19 01:19:14.283837 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2836/5559] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:13 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1520 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:14.376999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5d85c13-f4b8-47a3-b399-3f6e406769dc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1543164515", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5d85c13-f4b8-47a3-b399-3f6e406769dc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 243 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1543164515", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1543164515', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '45bea8c8-9e8b-42d9-b73f-5c3be6d2167f'}]}}} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.382598 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.386205 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.394527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5d85c13-f4b8-47a3-b399-3f6e406769dc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.401657 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e5d85c13-f4b8-47a3-b399-3f6e406769dc tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025703 Oct 19 01:19:14.405769 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2724/5560] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:14 2022] POST /compute/v2.1/servers => generated 175 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:19:14.417289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:14.418127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: fd9852f1-3178-42bc-9fbe-195f3fee43e6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:14.424864 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] HTTP exception thrown: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/fd9852f1-3178-42bc-9fbe-195f3fee43e6/metadata HTTP/1.1 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: exception: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': 'fd9852f1-3178-42bc-9fbe-195f3fee43e6'} Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.430627 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.433946 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:19:14.433946 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:19:14.433946 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. Oct 19 01:19:14.433946 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.436050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 404 to user: Instance fd9852f1-3178-42bc-9fbe-195f3fee43e6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.437527 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7243eb7-a039-4578-ad88-f219b09d6b77 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/fd9852f1-3178-42bc-9fbe-195f3fee43e6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024793 Oct 19 01:19:14.438667 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2837/5561] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:19:14 2022] GET /compute/v2.1/servers/fd9852f1-3178-42bc-9fbe-195f3fee43e6/metadata => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:19:14.492491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf91c9d7-2395-4ac3-915c-3f53f0073dc9 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-518167633", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf91c9d7-2395-4ac3-915c-3f53f0073dc9 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 498 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-518167633", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-518167633', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '45bea8c8-9e8b-42d9-b73f-5c3be6d2167f'}]}}} Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 01:19:14.500772 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.503333 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.507993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf91c9d7-2395-4ac3-915c-3f53f0073dc9 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.509272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf91c9d7-2395-4ac3-915c-3f53f0073dc9 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020983 Oct 19 01:19:14.510461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2725/5562] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:14 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:19:14.621919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37c66e85-d27c-4a83-846b-91dce794876c tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-387805774", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37c66e85-d27c-4a83-846b-91dce794876c tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 499 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-387805774", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-387805774', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '45bea8c8-9e8b-42d9-b73f-5c3be6d2167f'}]}}} Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 01:19:14.628225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.631369 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.634118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37c66e85-d27c-4a83-846b-91dce794876c tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.634294 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37c66e85-d27c-4a83-846b-91dce794876c tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.017206 Oct 19 01:19:14.636825 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2838/5563] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:14 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:19:14.719548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a98d4091-3ec6-4244-8958-dca7843d7c80 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-238987499", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a98d4091-3ec6-4244-8958-dca7843d7c80 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 753 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-238987499", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-238987499', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '45bea8c8-9e8b-42d9-b73f-5c3be6d2167f'}]}}} Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:19:14.729529 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:19:14.731796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:19:14.735104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.735104 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.735104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a98d4091-3ec6-4244-8958-dca7843d7c80 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.735104 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a98d4091-3ec6-4244-8958-dca7843d7c80 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016849 Oct 19 01:19:14.735104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2726/5564] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:14 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 19 01:19:14.819360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b9fd751-730c-40c5-bef2-6dba164fcccd tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-781561984", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b9fd751-730c-40c5-bef2-6dba164fcccd tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 1265 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-781561984", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "45bea8c8-9e8b-42d9-b73f-5c3be6d2167f"}]}} Oct 19 01:19:14.834395 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-781561984', 'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '45bea8c8-9e8b-42d9-b73f-5c3be6d2167f'}]}}} Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.837174 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:19:14.838480 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:19:14.840557 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 19 01:19:14.840557 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.840557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b9fd751-730c-40c5-bef2-6dba164fcccd tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.840557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b9fd751-730c-40c5-bef2-6dba164fcccd tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.023046 Oct 19 01:19:14.853873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:14.854647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:14.858815 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2839/5565] 10.222.0.27 () {60 vars in 1148 bytes} [Wed Oct 19 01:19:14 2022] POST /compute/v2.1/servers => generated 2221 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 19 01:19:14.861659 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] HTTP exception thrown: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c/metadata/test2 HTTP/1.1 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: exception: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': 'aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c', 'id': 'test2'} Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:14.863530 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 404 to user: Instance aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77102dc3-b8e3-4dd4-95ad-b33baedb8649 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016576 Oct 19 01:19:14.868577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2727/5566] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 01:19:14 2022] GET /compute/v2.1/servers/aac441cd-72aa-4aa6-bda5-1fb3a59c3c0c/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:19:14.891951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:14.892477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:14.900731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:14.901533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:14.901995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:14.902722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:14.903191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:14.903624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:14.934035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:19:15.078753 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1675308f-0c61-488d-aa0b-8bb6471708b5 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 204 len: 0 microversion: 2.1 time: 0.190602 Oct 19 01:19:15.079729 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2840/5567] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:19:14 2022] DELETE /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:19:15.087747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:15.089988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:15.103869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:15.104374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:15.104853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:15.105576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:15.106042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:15.106479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:15.279174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1837130559", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "5ab5f6ff-53c7-4a02-a66f-174366c646b3"}], "key_name": "tempest-TestNetworkBasicOps-397242104", "security_groups": [{"name": "tempest-secgroup-smoke-799192295"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:15.363556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:15.384095 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe130dd8-5b06-4dc2-87a6-fcd79f324e10 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1526 microversion: 2.1 time: 0.296025 Oct 19 01:19:15.390943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2728/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:15 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:15.470523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] validate_networks() for [('5ab5f6ff-53c7-4a02-a66f-174366c646b3', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:19:16.037867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:19:16.038970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:19:16.039469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:19:16.039893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:19:16.040316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:19:16.059004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:16.059499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:16.060116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:16.061639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:16.062516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:16.063128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:16.094206 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:19:16.101413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:19:16.122188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:19:16.125058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:19:16.250443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f85783c0-28ed-45f2-9077-15c2328a0a0f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.976633 Oct 19 01:19:16.251679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2841/5569] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:19:16.265042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-354659b8-60f0-49ab-9105-226c1f7e9576 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:16.266356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-354659b8-60f0-49ab-9105-226c1f7e9576 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:16.411988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-354659b8-60f0-49ab-9105-226c1f7e9576 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:16.415152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:16.415905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:16.427464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-354659b8-60f0-49ab-9105-226c1f7e9576 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1248 microversion: 2.1 time: 0.167286 Oct 19 01:19:16.428022 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2729/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:16 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1248 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:16.446000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:16.446608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:16.447242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:16.448045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:16.448577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:16.449100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:16.669470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:16.680844 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9adf09f-289b-42a6-956a-ff721e5e7387 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1526 microversion: 2.1 time: 0.270909 Oct 19 01:19:16.684461 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2842/5571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:16 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1526 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:17.453282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:17.455051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:17.474261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:17.475059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:17.475748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:17.477264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:17.477920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:17.479152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:17.630180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f26be91-47c8-40a9-bfb7-bfbfa8518e80", "name": "network-vif-deleted", "tag": "48eefe3c-5a0d-4453-b61e-b86832ece831"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:17.646263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:17.647966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:17.649174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:17.664600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] Creating event network-vif-deleted:48eefe3c-5a0d-4453-b61e-b86832ece831 for instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 on n-h1-master-1 Oct 19 01:19:17.675753 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5f8de10c-1356-441c-a917-9626d99e3e8e req-c5bef6b1-4d63-413e-bdf8-a0ac5f0bd3e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049132 Oct 19 01:19:17.677566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2843/5572] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:19:17.683168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:17.691553 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41e799c2-d277-4827-a311-dd88c6518f27 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1300 microversion: 2.1 time: 0.243380 Oct 19 01:19:17.693673 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2730/5573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:17 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:17.713850 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:17.714494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:17.725907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:17.729233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:17.729855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:17.730809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:17.733563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:17.734101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:17.986604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48518217acf44665a9ce74d4a30391bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee9420b773e6484188aa45a2aed1bc0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:18.005813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4abeacab-921f-4f81-b3a5-dc1d8e690142 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 200 len: 1309 microversion: 2.1 time: 0.298513 Oct 19 01:19:18.006415 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2844/5574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:17 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 1309 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:18.722494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:18.723974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:18.742736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:18.747453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:18.748412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:18.749359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:18.749975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:18.750557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:19.028657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:19.031050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:19.032812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] [instance: 5f26be91-47c8-40a9-bfb7-bfbfa8518e80] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:19.042611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24af1fe4-565c-478d-b432-16d84608263a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1306 microversion: 2.1 time: 0.325222 Oct 19 01:19:19.043529 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2731/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:18 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:19.068044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:19.068758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:19.069334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:19.070906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:19.071498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:19.072649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:19.128820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] HTTP exception thrown: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Request method failure captured: Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 HTTP/1.1 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1CF_uRWUldslv0y4HlWqn79vgPbfc4eDRAkxkwKzbM-65BmYasWWSDczoTy0MC5FE4YGJMMY3dykZFMfRvttECafjU0qZfLz_icWFMNi0b0ATQ0vNK0pDv3m3vZay7US1xTn10BvWMZhrPig4GU-1QnPBxBX1HNx7NYGbs2yjvJslE Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ee9420b773e6484188aa45a2aed1bc0e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ee9420b773e6484188aa45a2aed1bc0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ee9420b773e6484188aa45a2aed1bc0e"}]}] Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: ee9420b773e6484188aa45a2aed1bc0e Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1774528966 Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 48518217acf44665a9ce74d4a30391bf Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1774528966-project Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5f26be91-47c8-40a9-bfb7-bfbfa8518e80'} Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:19.135225 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:19.139256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] Returning 404 to user: Instance 5f26be91-47c8-40a9-bfb7-bfbfa8518e80 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:19.140949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc385f14-3980-474e-9648-bf537aeeba33 tempest-ServerMetadataNegativeTestJSON-1774528966 tempest-ServerMetadataNegativeTestJSON-1774528966-project] 10.222.0.27 "GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80" status: 404 len: 111 microversion: 2.1 time: 0.113419 Oct 19 01:19:19.141734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2845/5576] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:19 2022] GET /compute/v2.1/servers/5f26be91-47c8-40a9-bfb7-bfbfa8518e80 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:19:20.072793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:20.074484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:20.100496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:20.101267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:20.102055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:20.102949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:20.103604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:20.104210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:20.608130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:20.617962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5f079e3-cc26-47a3-8af8-d7c25f958c7f tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.554225 Oct 19 01:19:20.619508 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2732/5577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:20 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:21.644189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:21.645986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:21.652210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:21.652727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:21.653325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:21.654041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:21.654621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:21.655051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:21.867629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7668892f-1a6e-4ab5-bf17-7e8e311dd0f7", "tag": "4097b171-3e9e-42f3-a526-4df748f89408"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:21.893048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:21.893825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:21.895966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:21.912182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] Creating event network-changed:4097b171-3e9e-42f3-a526-4df748f89408 for instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 on n-h2-master-1 Oct 19 01:19:21.919179 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8be848e7-b416-448e-ac9f-97ca9b531c51 req-8b7bec79-bbf9-46ec-805e-e94797f5e474 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058290 Oct 19 01:19:21.920446 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2733/5578] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:19:22.053987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:22.065475 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3398c02e-6b98-4d62-a3c8-5f4cd0449a2e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.426267 Oct 19 01:19:22.081591 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2846/5579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:21 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:23.102645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:23.104585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:23.129057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:23.130343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:23.130799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:23.131558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:23.137655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:23.137996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:24.044722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:24.064167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77633ec8-eaf3-4b5a-a319-ee6fb4d0c5a5 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.968973 Oct 19 01:19:24.070839 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2734/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:23 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:25.096815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:25.100697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:25.110585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:25.111404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:25.112153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:25.113098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:25.114413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:25.115208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:25.414209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:25.433715 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bcb3efd-884a-4317-8aff-77efad12a136 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.341313 Oct 19 01:19:25.444649 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2847/5581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:25 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:26.461449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:26.462382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:26.471120 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:26.477078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:26.477582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:26.478022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:26.478727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:26.479182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:26.479610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:26.683538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:26.697610 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3c43fe3a-e094-4368-ac0c-7ad5eee92551 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.240838 Oct 19 01:19:26.707164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2735/5582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:26 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:26.942512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7668892f-1a6e-4ab5-bf17-7e8e311dd0f7", "name": "network-vif-plugged", "status": "completed", "tag": "4097b171-3e9e-42f3-a526-4df748f89408"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:26.953662 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:26.956135 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:26.960523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:26.961259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:26.961974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:26.978864 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] Creating event network-vif-plugged:4097b171-3e9e-42f3-a526-4df748f89408 for instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 on n-h2-master-1 Oct 19 01:19:26.984036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9ec56291-990b-4283-ab4a-4c9d461e21f1 req-aa7fb82e-8478-4beb-96a6-7199f2a86876 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045922 Oct 19 01:19:26.984686 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2848/5583] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:27.721829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:27.723098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:27.731533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:27.732455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:27.733055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:27.733811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:27.734357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:27.734793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:27.951786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:27.963262 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19946e14-9260-46d5-aefe-a39140ebc2cf tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1373 microversion: 2.1 time: 0.244376 Oct 19 01:19:27.963262 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2736/5584] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:27 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1373 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:28.991094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:28.992550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:28.998199 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:29.001109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:29.002403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:29.002843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:29.003784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:29.004642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:29.005075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:29.010836 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:29.180221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:29.188889 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e66735b6-dabb-4730-aa8f-8aa467f1dcff tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1546 microversion: 2.1 time: 0.204888 Oct 19 01:19:29.189613 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2849/5585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:28 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1546 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:29.219645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:29.221014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:29.231131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:29.231906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:29.232592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:29.234657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:29.235642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:29.236153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:29.448453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:29.466881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-255ec451-096d-4997-a686-c264e37ed3c0 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1546 microversion: 2.1 time: 0.253892 Oct 19 01:19:29.481105 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2737/5586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:29 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1546 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:35.183476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:35.184607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:35.194195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:35.194973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:35.195576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:35.196595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:35.197650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:35.198230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:35.242094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:19:35.295899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2022592560", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "a418b2b8-3e69-4e21-9ce8-8d0862b77837"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:35.322292 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:35.406555 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b59554d2-d6fa-4631-89c5-c71e08c71b2b tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 204 len: 0 microversion: 2.42 time: 0.622828 Oct 19 01:19:35.407370 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2850/5587] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:19:34 2022] DELETE /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:19:35.416376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] validate_networks() for [('a418b2b8-3e69-4e21-9ce8-8d0862b77837', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:19:35.421033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:35.427749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:35.443400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:35.444041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:35.444549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:35.445422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:35.445957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:35.447643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:35.911805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:35.926816 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:35.928906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:35.932516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-486addfa-ee25-41bb-b76e-ef6a4f117f03 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2959 microversion: 2.42 time: 0.519224 Oct 19 01:19:35.933751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2851/5588] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:35 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2959 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:36.166688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:19:36.167690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:19:36.168191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:19:36.171220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:19:36.172607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:19:36.195660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:36.196155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:36.196596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:36.197354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:36.197812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:36.198241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:36.228976 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=79 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:36.255024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Getting quotas for project 24871a8048b7422e8e4576360b3e81f5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:19:36.261293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Getting quotas for user a29461d7e91a431d9aa1bb77bcae9040 and project 24871a8048b7422e8e4576360b3e81f5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:19:36.275082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:19:36.277609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:19:36.337184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2f11b46-84c9-4aa4-8357-256adad50028 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150045 Oct 19 01:19:36.338496 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2738/5589] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:19:36.350488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a440e4e-42c1-42d0-8de2-f0038f274ebe tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:36.351857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a440e4e-42c1-42d0-8de2-f0038f274ebe tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:36.419036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9a440e4e-42c1-42d0-8de2-f0038f274ebe tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:36.431211 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a440e4e-42c1-42d0-8de2-f0038f274ebe tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1216 microversion: 2.1 time: 0.085351 Oct 19 01:19:36.431946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2852/5590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:36 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:36.964443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:36.964984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:36.984365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:36.985211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:36.986210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:36.987038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:36.987605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:36.991376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:37.440383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:37.450430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:37.452668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:37.454291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b562b415-efc8-4af5-8e6b-53353865334f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2959 microversion: 2.42 time: 0.495993 Oct 19 01:19:37.472878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:37.472878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:37.476258 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2739/5591] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:36 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2959 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:37.479852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:37.480452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:37.480946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:37.481682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:37.482149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:37.482750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:37.589504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:37.603410 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f288ef0-dc92-4eb4-ade3-47b5786bb1e2 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1220 microversion: 2.1 time: 0.150205 Oct 19 01:19:37.609566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2853/5592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:37 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:38.485418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:38.486098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:38.499563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:38.502211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:38.502671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:38.503394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:38.535264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:38.535868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:38.629127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:38.629856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:38.643075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:38.644765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:38.645321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:38.655649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:38.656156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:38.656607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:38.791024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:38.803358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0564a10a-a49b-4d6e-b951-d4ca72adee43 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1268 microversion: 2.1 time: 0.179043 Oct 19 01:19:38.804250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2854/5593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:38 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:38.969625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:38.982360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:38.985410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:38.987078 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-44312fee-27e0-4595-af12-05a88bd91b5a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2959 microversion: 2.42 time: 0.507200 Oct 19 01:19:39.009411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2740/5594] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:38 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2959 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:39.844748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:39.845943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:39.858529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:39.859267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:39.859891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:39.861644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:39.862270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:39.864373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:40.020614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:40.021485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:40.033726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:40.034341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:40.041331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:40.042238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:40.042722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:40.043942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:40.137293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:40.153793 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-78092ad2-859c-41ea-af56-bcc719316686 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1274 microversion: 2.1 time: 0.327079 Oct 19 01:19:40.154408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2855/5595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:39 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1274 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:41.182115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:41.182750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:41.197880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:41.198767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:41.199412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:41.200143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:41.200599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:41.201211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:41.589719 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:41.607040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:41.610872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:41.617000 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32452865-edbc-4a57-b294-1a7e05db3cf5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2959 microversion: 2.42 time: 1.601739 Oct 19 01:19:41.621457 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2741/5596] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:40 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2959 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:19:41.670660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:41.680289 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a281e53-20f4-4e3e-aa00-ef930753cdca tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 0.502150 Oct 19 01:19:41.681791 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2856/5597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:41 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:42.162838 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-unplugged", "status": "completed", "tag": "a1606c90-698d-4440-9cc4-179ab1a91d6a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:42.178033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.181278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.181960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:42.219236 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] Creating event network-vif-unplugged:a1606c90-698d-4440-9cc4-179ab1a91d6a for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:42.227080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5f1f1e6b-7ecd-4ecf-9a61-7fc7eb53a7d4 req-afa48609-e1c2-4fd3-96f1-f196bfa19a83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069939 Oct 19 01:19:42.228800 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2742/5598] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:42.419696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0a30480-4a91-4754-afd7-606a149cabe5", "tag": "0b652d2c-978d-482a-9efd-787ef052bde8"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:42.460779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.461191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.461628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:42.511685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] Creating event network-changed:0b652d2c-978d-482a-9efd-787ef052bde8 for instance d0a30480-4a91-4754-afd7-606a149cabe5 on n-h1-master-1 Oct 19 01:19:42.530482 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8579c4e5-be51-486a-8c91-22e1ed8e8bb5 req-3213f2ad-38f0-40db-9bc3-636754aeac2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114695 Oct 19 01:19:42.531114 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2857/5599] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:42.655397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:42.656404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:42.677889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.678883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.680774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:42.683384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.685437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.686063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:42.714583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:42.716389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:42.740066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.741986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.743477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:42.744576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:42.745285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:42.745932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:43.452036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:43.477824 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a35af692-691b-4d7e-8e4d-9500082fac6c tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 0.772340 Oct 19 01:19:43.482638 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2858/5600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:42 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:43.643429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:43.668740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:43.670215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:43.673170 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e1ed26b-c30c-42c5-ba83-779e1688d4fe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2938 microversion: 2.42 time: 1.021909 Oct 19 01:19:43.674626 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2743/5601] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:42 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2938 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:44.279477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-unplugged", "status": "completed", "tag": "c81f4fac-56a4-4297-9a43-94b12f2107a4"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-unplugged", "status": "completed", "tag": "b05dfb85-2b5a-4266-a9b8-1d80808f0283"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-unplugged", "status": "completed", "tag": "288f1f37-4462-495e-a087-09267a50a989"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:44.291888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:44.292929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:44.293638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:44.325220 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Creating event network-vif-unplugged:c81f4fac-56a4-4297-9a43-94b12f2107a4 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:44.326059 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Creating event network-vif-unplugged:b05dfb85-2b5a-4266-a9b8-1d80808f0283 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:44.326811 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] Creating event network-vif-unplugged:288f1f37-4462-495e-a087-09267a50a989 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:44.335634 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-91cda5b2-5839-459c-9736-4016235fbfa4 req-86524bbe-686c-4595-8299-49d13049d2ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.069723 Oct 19 01:19:44.336761 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2859/5602] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:44.507546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:44.508479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:44.543422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:44.544063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:44.545144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:44.564368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:44.565194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:44.565607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:44.707705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:44.709101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:44.717391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:44.717877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:44.719513 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:44.720826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:44.722561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:44.723728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:45.713654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:45.716880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:45.725936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-309e4998-1f0f-4aa6-ace1-a9ec23cbf4b3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 1.222639 Oct 19 01:19:45.729781 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2744/5603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:44 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:45.733648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:45.738504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:45.744469 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1034310-777e-4719-9788-5ac5824e7cbe tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2917 microversion: 2.42 time: 1.042114 Oct 19 01:19:45.745330 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2860/5604] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:44 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2917 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:45.991285 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-deleted", "tag": "c81f4fac-56a4-4297-9a43-94b12f2107a4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:46.018508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.020677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.021865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:46.056786 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] Creating event network-vif-deleted:c81f4fac-56a4-4297-9a43-94b12f2107a4 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:46.064398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-74298fb4-aad1-4265-a051-31a19a9d9c8d req-66651e37-3c8c-42e8-80f8-1bfef0db3aef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078126 Oct 19 01:19:46.066791 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2745/5605] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:46.389063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-unplugged", "status": "completed", "tag": "be8d70e8-a6b0-4676-8c91-f9675b669fb9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:46.417945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.418448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.418952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:46.447012 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:46.451023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] Creating event network-vif-unplugged:be8d70e8-a6b0-4676-8c91-f9675b669fb9 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:46.467389 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-95df2368-9a8f-4ac6-a7f5-9e1ecfd76fd4 req-7a20bf1f-4ca4-4f9d-8b02-a61bc2c8f52b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083322 Oct 19 01:19:46.469105 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2861/5606] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:19:46.751194 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:46.751996 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:46.791171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:46.793431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:46.796831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:46.802444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:46.829435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.831937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.832519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.832991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:46.833785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.834258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.834695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:46.836985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.837700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:46.840088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:46.840974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:46.841823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:47.366185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:47.381188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:47.384579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:47.386860 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8431d14-c7d2-4fbd-a882-e1ce79633729 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2709 microversion: 2.42 time: 0.614773 Oct 19 01:19:47.387650 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2862/5607] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:46 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2709 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:19:47.427606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:47.441077 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dad68525-4d7f-4280-af51-f94ba16ec3a1 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 0.690629 Oct 19 01:19:47.442315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2746/5608] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:46 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:48.105106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-deleted", "tag": "288f1f37-4462-495e-a087-09267a50a989"}, {"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-deleted", "tag": "b05dfb85-2b5a-4266-a9b8-1d80808f0283"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:48.141339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:48.142346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:48.144120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:48.173253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Creating event network-vif-deleted:288f1f37-4462-495e-a087-09267a50a989 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:48.178023 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] Creating event network-vif-deleted:b05dfb85-2b5a-4266-a9b8-1d80808f0283 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:48.196402 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-053cbcbf-4f6f-4ab2-ae76-89089360dcbe req-5bd0d7e5-235e-4731-b35f-fb65e06e7a07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095974 Oct 19 01:19:48.198009 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2863/5609] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:48.417260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:48.418419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:48.436282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:48.437138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:48.437595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:48.441744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:48.442426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:48.444654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:48.464233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:48.465280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:48.486500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:48.487008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:48.488005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:48.494034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:48.494570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:48.495022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:49.080748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:49.093357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:49.105396 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff05e822-4bff-4010-9445-f36a55e4c471 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 0.645614 Oct 19 01:19:49.110371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:49.110681 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2864/5610] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:48 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:49.114812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:49.116121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17398bfc-98d1-4337-b2d9-a9c3a0ceca47 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2392 microversion: 2.42 time: 0.704356 Oct 19 01:19:49.116739 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2747/5611] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:48 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2392 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:49.119508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a30480-4a91-4754-afd7-606a149cabe5", "name": "network-vif-plugged", "status": "completed", "tag": "0b652d2c-978d-482a-9efd-787ef052bde8"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:49.150296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:49.150961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:49.153162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:49.166884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] Creating event network-vif-plugged:0b652d2c-978d-482a-9efd-787ef052bde8 for instance d0a30480-4a91-4754-afd7-606a149cabe5 on n-h1-master-1 Oct 19 01:19:49.172579 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0e5ed621-f641-4070-9fa3-640496901296 req-1c5522d1-9c28-4dca-b819-87de76a82cf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060335 Oct 19 01:19:49.173719 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2865/5612] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:50.138783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:50.140000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:50.149231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:50.150852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:50.191450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:50.194677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:50.195522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:50.200602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:50.201522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:50.203805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:50.219670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:50.220187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:50.220659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:50.221404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:50.223253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:50.223871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:50.635931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:50.647168 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9d0762fd-d6da-4c27-ba44-9a50447127ef tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1316 microversion: 2.1 time: 0.512426 Oct 19 01:19:50.648716 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2748/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:50 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:50.654026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-deleted", "tag": "be8d70e8-a6b0-4676-8c91-f9675b669fb9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:50.664538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:50.665283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:50.665976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:50.684472 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] Creating event network-vif-deleted:be8d70e8-a6b0-4676-8c91-f9675b669fb9 for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:50.692490 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6616b4e9-871c-4679-9bdf-148e4f1126d8 req-c3f4cbd3-38ec-4f09-9a6b-390317b2770f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042315 Oct 19 01:19:50.693727 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2749/5614] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:50.708861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:50.720809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:50.722953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:50.724710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7787dcd-21a5-48fc-b65f-35068828a158 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 2345 microversion: 2.42 time: 0.580941 Oct 19 01:19:50.726230 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2866/5615] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:50 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 2345 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:19:51.677629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:51.678345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:51.704152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:51.704679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:51.717131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:51.717924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:51.718413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:51.718859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:51.758233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:51.758876 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:51.771404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:51.777423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:51.777890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:51.789290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:51.789793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:51.790249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.004138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:52.018782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:52.023328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:52.027124 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8109990e-2a52-439e-8491-f7c193e4e517 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.275114 Oct 19 01:19:52.028326 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2867/5616] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:51 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:52.143741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:52.155498 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60d90da3-b560-4879-b7bd-1e7d6d3c8aa3 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1505 microversion: 2.1 time: 0.483813 Oct 19 01:19:52.156414 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2750/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:51 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:52.180686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:52.181465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:52.188939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.189748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.190462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.191468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.192151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.192836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.224873 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:52.303859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-83e805bd-4821-4654-8dac-2259dfb24aa6 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.128707 Oct 19 01:19:52.304843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2868/5618] 10.222.0.27 () {58 vars in 1296 bytes} [Wed Oct 19 01:19:52 2022] DELETE /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5/os-server-password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:19:52.314837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:52.315441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:52.331810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.332436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.333025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.338252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.339343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.340040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.390964 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a763ab54-d86d-44a6-a019-a035a090d18b tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.081267 Oct 19 01:19:52.402710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2751/5619] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:19:52 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5/os-server-password => generated 16 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:19:52.408561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:52.409221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:52.420894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.425313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.426856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.427764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.430268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.434002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.507652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:19:52.711487 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a0166f4-a390-40dc-b37d-a12e9f4166c8 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 204 len: 0 microversion: 2.1 time: 0.306851 Oct 19 01:19:52.712658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2869/5620] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:19:52 2022] DELETE /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:19:52.726036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:52.734352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:52.744699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.745369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.746650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.747483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5da90a2e-92b1-4f25-b88b-8b6b6c2968b0", "name": "network-vif-deleted", "tag": "a1606c90-698d-4440-9cc4-179ab1a91d6a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:52.748478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.750401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.750979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.772373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:52.772956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:52.774531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:52.813837 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] Creating event network-vif-deleted:a1606c90-698d-4440-9cc4-179ab1a91d6a for instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 on n-h1-master-1 Oct 19 01:19:52.821369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c277e9fd-d3da-4f2d-a561-2ce4fc4a9976 req-9e06dcc3-84cd-43c6-92d8-825dc3483630 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079216 Oct 19 01:19:52.827969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2870/5621] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:19:53.061049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:53.062513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:53.095609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:53.096432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:53.097118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:53.098126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:53.100928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:53.101628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:53.126191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:53.135727 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-88fc49e6-a3c6-4f23-b324-c3e6d2cf9912 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1511 microversion: 2.1 time: 0.416028 Oct 19 01:19:53.136331 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2752/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:52 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1511 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:53.230978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:53.251855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:53.255180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:53.257520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97e6e4eb-e800-467f-9a3a-f057eb4c62a2 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.204535 Oct 19 01:19:53.258917 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2871/5623] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:53 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:54.164436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:54.165658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:54.179851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:54.180554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:54.182250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:54.183776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:54.184257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:54.184743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:54.289314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:54.290700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:54.298176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:54.298967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:54.299715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:54.300781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:54.301482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:54.302201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:54.877017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:54.894769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:54.897609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:54.900290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54ac0a04-e0d8-46e3-b8b4-0c85b3946d96 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.615924 Oct 19 01:19:54.925431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2872/5624] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:54 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:55.075132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:55.100686 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0634a6a4-d95c-4bf5-aa38-6cbf1db11644 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1511 microversion: 2.1 time: 0.940866 Oct 19 01:19:55.105992 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2753/5625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:54 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:19:55.750569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0a30480-4a91-4754-afd7-606a149cabe5", "name": "network-vif-deleted", "tag": "0b652d2c-978d-482a-9efd-787ef052bde8"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:19:55.775506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:55.776346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:55.777081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:55.793510 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] Creating event network-vif-deleted:0b652d2c-978d-482a-9efd-787ef052bde8 for instance d0a30480-4a91-4754-afd7-606a149cabe5 on n-h1-master-1 Oct 19 01:19:55.813581 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-0fabb9b9-b7a3-42bc-9beb-e6354e2d44c1 req-5939d1fe-0b9a-4d56-a0cc-e10b8e969a02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066613 Oct 19 01:19:55.815807 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2873/5626] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:19:55.931871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:55.932500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:55.946313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:55.948434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:55.949098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:55.951696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:55.952363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:55.954455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:56.109975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:56.125473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:56.128220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:56.129152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:56.136915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:56.139107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b3123ba-4359-49de-b864-5321526baca8 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.210442 Oct 19 01:19:56.140442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2754/5627] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:55 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:56.149970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:56.150582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:56.151233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:56.152075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:56.152714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:56.153395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:56.226817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:56.229591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:56.231569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:56.232079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lazy-loading 'fault' on Instance uuid d0a30480-4a91-4754-afd7-606a149cabe5 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:19:56.335501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a29461d7e91a431d9aa1bb77bcae9040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24871a8048b7422e8e4576360b3e81f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:56.345812 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f1440e54-b0e0-4fa4-a9ae-28249275be15 tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 200 len: 1306 microversion: 2.1 time: 0.222138 Oct 19 01:19:56.347011 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2874/5628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:56 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 1306 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:19:57.169878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:57.170515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:57.187167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:57.187678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:57.188128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:57.188889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:57.189531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:57.190666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:57.276201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:57.287492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:57.289002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:57.290393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e347f5dd-8ecd-44fc-a026-b58eba8fb14f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.124379 Oct 19 01:19:57.291131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2755/5629] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:57 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:19:57.375415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:57.376971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] [instance: d0a30480-4a91-4754-afd7-606a149cabe5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:57.390147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:57.397449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:57.398142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:57.399075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:57.399701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:57.400295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:57.429359 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] HTTP exception thrown: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Request method failure captured: Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 HTTP/1.1 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1Cma-r92Ler_6_0QaB-suNkHbxLD-ugKeV9tKXBW2o5zT1hh-92Kdm3H7FcQ7TcntojI54UIoSsCpzDnrq6MF4C_Lf5FJum4Xi1KEwZRa-yQxFACQgxCcFBbkhflzHbqUuINiOwdPuiVIU3HCsInx-9xrAqrjwfox6QXICtTBry2gw Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 24871a8048b7422e8e4576360b3e81f5 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerPasswordTestJSON-248231830 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24871a8048b7422e8e4576360b3e81f5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24871a8048b7422e8e4576360b3e81f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24871a8048b7422e8e4576360b3e81f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24871a8048b7422e8e4576360b3e81f5"}]}] Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerPasswordTestJSON-248231830 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 24871a8048b7422e8e4576360b3e81f5 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerPasswordTestJSON-248231830 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerPasswordTestJSON-248231830-project Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: a29461d7e91a431d9aa1bb77bcae9040 Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerPasswordTestJSON-248231830-project Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd0a30480-4a91-4754-afd7-606a149cabe5'} Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:19:57.436731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. Oct 19 01:19:57.441495 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:19:57.444753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] Returning 404 to user: Instance d0a30480-4a91-4754-afd7-606a149cabe5 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:19:57.446071 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8e26601-112a-4931-85d3-abcb38373aaf tempest-ServerPasswordTestJSON-248231830 tempest-ServerPasswordTestJSON-248231830-project] 10.222.0.27 "GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5" status: 404 len: 111 microversion: 2.1 time: 0.074555 Oct 19 01:19:57.452877 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2875/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:19:57 2022] GET /compute/v2.1/servers/d0a30480-4a91-4754-afd7-606a149cabe5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:19:58.319369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:58.320781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:58.338533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:58.339033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:58.339475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:58.340198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:58.340729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:58.341163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:58.461628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:58.475017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:58.476492 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:58.485695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-105960cd-65f6-490b-b3cd-154bb35a2759 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.163414 Oct 19 01:19:58.493112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2756/5631] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:58 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:19:59.512988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:19:59.514236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:19:59.517510 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:19:59.547621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:59.548317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:59.548807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:59.549603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:19:59.552588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:19:59.553524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:19:59.714625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:59.728641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:59.730439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:19:59.733473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae3ab2c0-f642-480c-ae31-4d844294b967 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.224402 Oct 19 01:19:59.736693 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2876/5632] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:19:59 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:00.769278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:00.769976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:00.779917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:00.780802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:00.781906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:00.783181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:00.786703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:00.787543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:01.122714 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:01.132449 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:01.148989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:01.152033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:01.157246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8c4b18f-44d7-4ecb-b1ac-1396975daa7f tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.392776 Oct 19 01:20:01.159517 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2757/5633] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:00 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:01.462965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:01.464105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:01.488803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:01.496432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:01.499890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:01.500704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:01.503272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:01.503730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:01.588614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:20:01.844589 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e140b46a-e418-4adf-9120-45f8b373cfea tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 204 len: 0 microversion: 2.1 time: 0.382886 Oct 19 01:20:01.845652 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2877/5634] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:20:01 2022] DELETE /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:20:01.857247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:01.857873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:01.883149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:01.884016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:01.885307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:01.889216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:01.891819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:01.896376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:02.188079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:02.188826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:02.199824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:02.200340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:02.200826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:02.202278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:02.202278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:02.214715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:02.601147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:02.610665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:02.612188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:02.631381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7365eba-3c1c-4519-81f3-e0e391617552 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.447536 Oct 19 01:20:02.632010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2878/5635] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:02 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:02.694859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:02.704226 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-764012e0-711b-4fab-b973-b752255d2bed tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1552 microversion: 2.1 time: 0.854013 Oct 19 01:20:02.709093 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2758/5636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:01 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1552 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:03.658129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:03.660342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:03.680966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:03.681587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:03.682233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:03.683056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:03.683623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:03.684161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:03.731925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:03.732882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:03.749277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:03.758444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:03.765558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:03.767944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:03.769720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:03.770937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:03.918658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:03.940926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:03.952976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:03.954615 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d863314b-71fd-4213-8722-f20f6f0f66a5 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.300508 Oct 19 01:20:03.956306 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2879/5637] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:03 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:04.069022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:04.078153 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1df006d5-3388-463a-bf70-f8195a06b9be tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1552 microversion: 2.1 time: 0.350547 Oct 19 01:20:04.078764 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2759/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:03 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1552 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:04.984375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:04.987249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:05.011459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:05.015282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:05.019130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:05.022614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:05.026488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:05.027796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:05.107240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:05.107857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:05.120060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:05.120554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:05.125261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:05.126217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:05.126846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:05.127995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:05.265666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:05.279366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d86b2bf1-027e-48f3-a6bc-0feda5ebef7d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 200 len: 1485 microversion: 2.1 time: 0.175530 Oct 19 01:20:05.279998 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2760/5639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:05 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 1485 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:05.288969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:05.300084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:05.309127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:05.312012 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1a7ac2a2-6c65-4cbf-bc76-d3e71ab98545 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.332041 Oct 19 01:20:05.314158 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2880/5640] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:04 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:20:05.650299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7668892f-1a6e-4ab5-bf17-7e8e311dd0f7", "name": "network-vif-deleted", "tag": "4097b171-3e9e-42f3-a526-4df748f89408"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:05.668677 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:05.674207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:05.677814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:05.679610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:05.701838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] Creating event network-vif-deleted:4097b171-3e9e-42f3-a526-4df748f89408 for instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 on n-h2-master-1 Oct 19 01:20:05.726999 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3256567a-0134-4c13-baa7-c32bfaf60024 req-b44d40d0-0956-4fd7-bb04-286ae853d0e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.388673 Oct 19 01:20:05.729252 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2761/5641] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:06.308483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:06.309138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:06.328070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:06.328566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:06.329042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:06.329853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:06.330363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:06.331124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:06.345000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:06.345702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:06.358565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:06.359062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:06.359505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:06.360208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:06.360688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:06.361122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:06.394411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] HTTP exception thrown: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Request method failure captured: Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 HTTP/1.1 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1BECFnGfoIxzvpu5y2WuJhmkvohNrJhwfLBIy741nQM8jPaU_9cbc6-tYfEBz6gR2KNgyZFM_tEB9m0QQlRiLjf2nn-QegOz18geLAfnQwA5OP9U0bp0LPPmJka-_-y_26kfkR6aD3v8Ol85qZUKkq71BvdOf7GiEA_KOhxs3NtVLw Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1eabce6bc9744aa9b56f5d3a24900020", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}] Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 0d12c0ca2333460bbf044ceb5178affb Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '7668892f-1a6e-4ab5-bf17-7e8e311dd0f7'} Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:06.398459 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. Oct 19 01:20:06.403075 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:06.409847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Returning 404 to user: Instance 7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:20:06.410975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08c530ef-63d4-494a-9071-6db16f102001 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7" status: 404 len: 111 microversion: 2.1 time: 0.108260 Oct 19 01:20:06.415254 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2881/5642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:06 2022] GET /compute/v2.1/servers/7668892f-1a6e-4ab5-bf17-7e8e311dd0f7 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:20:06.617110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:06.632405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:06.638160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:06.642411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8972783d-10c8-4d74-b733-fba941549a29 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.301903 Oct 19 01:20:06.644807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2762/5643] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:06 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:20:06.903995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-df27e1bf-1aab-4a29-bd79-b3381bb688a7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '.version_select at 0x7f2af4e7f8b0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:06.944307 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-df27e1bf-1aab-4a29-bd79-b3381bb688a7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-397242104" status: 202 len: 0 microversion: 2.1 time: 0.044062 Oct 19 01:20:06.945403 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2882/5644] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-397242104 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:20:07.671806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:07.673101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:07.685239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:07.689280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:07.690529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:07.693167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:07.694221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:07.696311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:08.063450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:08.083948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:08.087388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:08.089201 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f552fa3c-cffb-4245-a31d-73c613c2f775 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.422149 Oct 19 01:20:08.109957 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2763/5645] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:07 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:09.126330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:09.126957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:09.156921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:09.157496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:09.157943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:09.160954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:09.170436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:09.171178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:09.392133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:09.396026 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:09.410036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:09.417835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:09.419386 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-81696bd2-3d98-43bd-987b-5939e67787ff tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.298369 Oct 19 01:20:09.438438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2883/5646] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:09 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:10.451406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:10.452219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:10.475338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:10.488275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:10.488816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:10.489587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:10.498324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:10.498834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:10.702832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:10.722839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:10.730531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:10.732112 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43141f36-e5d6-4558-9ee8-0fa6292a24c4 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.284630 Oct 19 01:20:10.743445 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2764/5647] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:10 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:11.764280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:11.765716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:11.789480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:11.790267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:11.790875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:11.792249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:11.793034 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:11.793616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:12.043102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:12.061341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:12.062853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:12.067502 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0b629df-49ec-477b-9740-812d53bb2a55 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.308756 Oct 19 01:20:12.068161 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2884/5648] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:11 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:12.515339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:12.515902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:12.540335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:12.540882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:12.541337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:12.542070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:12.562501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:12.562983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:12.568024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b560eb7b-83e3-4758-b7fb-33dea48ee37a", "tag": "5a11ae38-b70d-4135-8823-882eaaadac86"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:12.583829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:12.584320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:12.584843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:12.631521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] Creating event network-changed:5a11ae38-b70d-4135-8823-882eaaadac86 for instance b560eb7b-83e3-4758-b7fb-33dea48ee37a on n-h2-master-1 Oct 19 01:20:12.652273 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2f573704-7507-43d3-8821-2baa51b82cae req-23642f29-7a87-4896-8e09-a394d1ff15c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088587 Oct 19 01:20:12.652772 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2885/5649] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:12.660423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:20:12.890942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d179fa18-8afa-403a-a37c-01a8e2ab24df tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 204 len: 0 microversion: 2.1 time: 0.379430 Oct 19 01:20:12.891886 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2765/5650] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:20:12 2022] DELETE /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:20:12.902302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:12.903017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:12.927709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:12.938727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:12.939193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:12.940507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:12.941191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:12.941819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:13.098442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:13.099356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:13.112989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:13.114003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:13.114608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:13.118279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:13.119067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:13.119672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:13.458699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:13.473095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:13.480567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:13.482179 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cecaca4e-0e00-4cf8-8f08-271da90b8cf1 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.388065 Oct 19 01:20:13.483354 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2766/5651] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:13 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:20:14.141458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:14.159738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ebfad232-fd06-4002-a7b8-d02aac34964a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1672 microversion: 2.1 time: 1.261871 Oct 19 01:20:14.165723 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2886/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:12 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1672 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:14.513619 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:14.514831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:14.534278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:14.541006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:14.541698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:14.545138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:14.550043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:14.555103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:14.950414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:14.967034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:14.981173 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:14.987631 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9339629-18e6-4cc9-82fc-6662417c203a tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.473794 Oct 19 01:20:14.988471 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2767/5653] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:14 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:20:15.194634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:15.195259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:15.208464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:15.209350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:15.210012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:15.210969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:15.211669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:15.212343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:16.018587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:16.020403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:16.031585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:16.033850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:16.037396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:16.038383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:16.039051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:16.039682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:16.117645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:16.130118 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a0052d2-80f4-4114-b58d-ac46120813de tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1553 microversion: 2.1 time: 0.940372 Oct 19 01:20:16.138108 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2887/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:15 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1553 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:16.312988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:16.331652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:16.351731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e394c9876db468caaf058abac55f3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69300f41e0bb41c191a9576afafccd63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:16.353119 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1dd64574-db4b-4f96-88af-42ac07e980d7 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 200 len: 1604 microversion: 2.42 time: 0.339603 Oct 19 01:20:16.354154 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2768/5655] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:16 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:20:17.094146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b560eb7b-83e3-4758-b7fb-33dea48ee37a", "name": "network-vif-deleted", "tag": "5a11ae38-b70d-4135-8823-882eaaadac86"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:17.128521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:17.129478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:17.130125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:17.168886 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] Creating event network-vif-deleted:5a11ae38-b70d-4135-8823-882eaaadac86 for instance b560eb7b-83e3-4758-b7fb-33dea48ee37a on n-h2-master-1 Oct 19 01:20:17.170607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:17.170607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:17.179749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9e52e82c-30bc-4425-bf26-e4557f241201 req-e5c2f57d-4681-4d80-ab1a-4acfbdb223b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089128 Oct 19 01:20:17.181032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2888/5656] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:17.198173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:17.198680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:17.199127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:17.199847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:17.206037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:17.206499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:17.347229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:17.358331 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-234ef058-8838-4cac-b237-79a008f147c6 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 200 len: 1333 microversion: 2.1 time: 0.192020 Oct 19 01:20:17.369980 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2769/5657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:17 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 1333 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:17.397126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:17.401002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:17.425206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:17.442491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:17.448112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:17.449391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:17.453859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:17.454805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:17.500961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] HTTP exception thrown: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Request method failure captured: Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 HTTP/1.1 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT09C9hX2-od6xSTc9lCiSYibmbhOW2IHOE-dDQL039Be0wZPRr0A74YUnuREMhZvJ2LWKv3I1oWEGBvY6S_No7wTv4gzvftDbanIInqT3PJu8wSZa9SYzkNO9UtL8xcboydLQ8gwmetYjTAKzecJUfchq4h05EXBZ8bIWyOmwn2zYCM Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69300f41e0bb41c191a9576afafccd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}] Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4e394c9876db468caaf058abac55f3fc Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5da90a2e-92b1-4f25-b88b-8b6b6c2968b0'} Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:17.503413 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Returning 404 to user: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:20:17.507322 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a64774e-e699-4302-b82f-987d6f8bcdd3 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 404 len: 111 microversion: 2.42 time: 0.118762 Oct 19 01:20:17.509724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2889/5658] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:17 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:20:17.519208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d9104e18-ef52-4efa-9145-c82b2a597314 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '.version_select at 0x7f2af43b2280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:17.558655 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d9104e18-ef52-4efa-9145-c82b2a597314 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636104169" status: 204 len: 0 microversion: 2.42 time: 0.048093 Oct 19 01:20:17.563914 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2770/5659] 10.222.0.27 () {60 vars in 1262 bytes} [Wed Oct 19 01:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1636104169 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:20:18.415551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:18.416292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: b560eb7b-83e3-4758-b7fb-33dea48ee37a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:18.450550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:18.454376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:18.455764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:18.458234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:18.460236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:18.463240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:18.497781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] HTTP exception thrown: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Request method failure captured: Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a HTTP/1.1 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1BECFnGfoIxzvpu5y2WuJhmkvohNrJhwfLBIy741nQM8jPaU_9cbc6-tYfEBz6gR2KNgyZFM_tEB9m0QQlRiLjf2nn-QegOz18geLAfnQwA5OP9U0bp0LPPmJka-_-y_26kfkR6aD3v8Ol85qZUKkq71BvdOf7GiEA_KOhxs3NtVLw Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1eabce6bc9744aa9b56f5d3a24900020", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}] Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 0d12c0ca2333460bbf044ceb5178affb Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b560eb7b-83e3-4758-b7fb-33dea48ee37a'} Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:18.499826 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:18.507422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Returning 404 to user: Instance b560eb7b-83e3-4758-b7fb-33dea48ee37a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:20:18.508345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb22a686-1bfd-446d-bfc8-4aecd192d4fb tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a" status: 404 len: 111 microversion: 2.1 time: 0.100127 Oct 19 01:20:18.512612 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2890/5660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:18 2022] GET /compute/v2.1/servers/b560eb7b-83e3-4758-b7fb-33dea48ee37a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:20:19.051052 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc3e119c-e21d-4e4f-bfe1-26664ebd6c99 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '.version_select at 0x7f2af4967430>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:19.104706 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc3e119c-e21d-4e4f-bfe1-26664ebd6c99 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-766194722" status: 202 len: 0 microversion: 2.1 time: 0.058032 Oct 19 01:20:19.109718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2771/5661] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-766194722 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:20:23.078981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1445190789", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:23.187538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] validate_networks() for [('d044355b-45b4-439a-9c90-7d8eb9a1c9f3', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:20:24.333168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:20:24.334300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:20:24.334957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:20:24.336094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:20:24.346308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:20:24.367005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:24.367682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:24.371716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:24.372798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:24.373439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:24.374060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:24.419469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:20:24.437628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for user fccb51cb03de4f50a1dd059a30a6c4bb and project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:20:24.493630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:20:24.501141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:20:24.697127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1bb4b46f-fcc6-4fe2-a520-e6aa8ebf7215 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.829578 Oct 19 01:20:24.711475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aa511f27-08c8-4220-a507-00d39be7e33c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:24.712109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aa511f27-08c8-4220-a507-00d39be7e33c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:24.722053 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2891/5662] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:20:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:20:25.142845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aa511f27-08c8-4220-a507-00d39be7e33c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:25.150455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aa511f27-08c8-4220-a507-00d39be7e33c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1222 microversion: 2.1 time: 0.443219 Oct 19 01:20:25.175139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2772/5663] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:24 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1222 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:25.293779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-419844661", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:25.408248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] validate_networks() for [('d044355b-45b4-439a-9c90-7d8eb9a1c9f3', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:20:28.271944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:20:28.272516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:20:28.273515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:20:28.273967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:20:28.274388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:20:28.319035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:28.319436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:28.319882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:28.322363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:28.322841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:28.323281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:28.379554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:20:28.394706 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for user fccb51cb03de4f50a1dd059a30a6c4bb and project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:20:28.415245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:20:28.419662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:20:28.489176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15b35639-d635-4955-9a16-a8d086650dd4 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.201896 Oct 19 01:20:28.490672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2892/5664] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:20:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 3204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:20:28.502487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63eb0140-9db3-46e8-a0aa-4587ae6d7720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:28.503638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63eb0140-9db3-46e8-a0aa-4587ae6d7720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:28.512125 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:28.818264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-63eb0140-9db3-46e8-a0aa-4587ae6d7720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:28.827028 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63eb0140-9db3-46e8-a0aa-4587ae6d7720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1221 microversion: 2.1 time: 0.329210 Oct 19 01:20:28.830701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2773/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:28 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1221 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:29.855988 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:29.858065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:29.866153 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:29.881656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:29.882168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:29.882628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:29.883371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:29.883838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:29.884280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:30.082523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:30.095997 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1b0b686-b4a3-4246-96f2-07f53a5dc416 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1273 microversion: 2.1 time: 0.243798 Oct 19 01:20:30.096942 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2893/5666] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:29 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:30.336278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:30.336962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:30.344117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:30.352294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:30.354190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:30.354966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:30.355453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:30.355895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:30.384684 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] HTTP exception thrown: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Request method failure captured: Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 HTTP/1.1 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT09C9hX2-od6xSTc9lCiSYibmbhOW2IHOE-dDQL039Be0wZPRr0A74YUnuREMhZvJ2LWKv3I1oWEGBvY6S_No7wTv4gzvftDbanIInqT3PJu8wSZa9SYzkNO9UtL8xcboydLQ8gwmetYjTAKzecJUfchq4h05EXBZ8bIWyOmwn2zYCM Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69300f41e0bb41c191a9576afafccd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}] Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 4e394c9876db468caaf058abac55f3fc Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '5da90a2e-92b1-4f25-b88b-8b6b6c2968b0'} Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:20:30.387520 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.391258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.395306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Returning 404 to user: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:20:30.396433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ba93495-0df5-46cd-99e4-5600e949dd84 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 404 len: 111 microversion: 2.42 time: 0.064910 Oct 19 01:20:30.397653 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2774/5667] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:20:30 2022] DELETE /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:20:30.405765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:30.406794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] [instance: 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:30.417472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:30.421727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:30.440286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:30.441576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:30.442221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:30.442828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:30.505157 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] HTTP exception thrown: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Request method failure captured: Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 HTTP/1.1 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT09C9hX2-od6xSTc9lCiSYibmbhOW2IHOE-dDQL039Be0wZPRr0A74YUnuREMhZvJ2LWKv3I1oWEGBvY6S_No7wTv4gzvftDbanIInqT3PJu8wSZa9SYzkNO9UtL8xcboydLQ8gwmetYjTAKzecJUfchq4h05EXBZ8bIWyOmwn2zYCM Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.42 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_69300f41e0bb41c191a9576afafccd63", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/69300f41e0bb41c191a9576afafccd63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/69300f41e0bb41c191a9576afafccd63"}]}] Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 69300f41e0bb41c191a9576afafccd63 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1092995995 Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4e394c9876db468caaf058abac55f3fc Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1092995995-project Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5da90a2e-92b1-4f25-b88b-8b6b6c2968b0'} Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.507024 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. Oct 19 01:20:30.511455 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:20:30.521504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] Returning 404 to user: Instance 5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:20:30.524192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a5f219f7-e41a-4ff1-b412-35a420abbb77 tempest-TaggedBootDevicesTest_v242-1092995995 tempest-TaggedBootDevicesTest_v242-1092995995-project] 10.222.0.27 "GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0" status: 404 len: 111 microversion: 2.42 time: 0.122523 Oct 19 01:20:30.527982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2894/5668] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:20:30 2022] GET /compute/v2.1/servers/5da90a2e-92b1-4f25-b88b-8b6b6c2968b0 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 19 01:20:31.124270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:31.127034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:31.149226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:31.149814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:31.150290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:31.151063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:31.151539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:31.151981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:31.343689 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:31.362866 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d6753ab-66bd-424d-8367-fe3e8b1c6f03 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1279 microversion: 2.1 time: 0.244700 Oct 19 01:20:31.381542 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2775/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:31 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1279 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:32.402640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:32.403182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:32.414673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:32.415503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:32.416122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:32.418217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:32.421205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:32.421837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:33.034153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:33.053038 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c577ea51-7eb8-48eb-9cc4-74f816a3058c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1279 microversion: 2.1 time: 0.654257 Oct 19 01:20:33.053679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2895/5670] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:32 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1279 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:33.453774 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af33025-a546-4db9-984f-99e971603f88", "tag": "0c1a9a6b-8d2e-4056-a580-4e8c64f1d636"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:33.478385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:33.480902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:33.481382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:33.519680 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] Creating event network-changed:0c1a9a6b-8d2e-4056-a580-4e8c64f1d636 for instance 0af33025-a546-4db9-984f-99e971603f88 on n-h1-master-1 Oct 19 01:20:33.531697 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-424e90f2-c040-447b-82aa-a63c04857c7d req-5065f5d5-2a5f-43f0-bc58-0cd02383d8e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083756 Oct 19 01:20:33.537070 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2776/5671] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:34.085310 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:34.086507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:34.099263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:34.105021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:34.105739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:34.106874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:34.111083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:34.111812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:34.524730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:34.540767 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e038016b-dfca-4cef-ba48-493bac0636ec tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.460098 Oct 19 01:20:34.541405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2896/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:34 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:35.570174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:35.571745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:35.608856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:35.616722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:35.617551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:35.623301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:35.624049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:35.625058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:36.128696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:36.141083 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54218fca-0487-4089-bfa0-3e031a13f668 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.579758 Oct 19 01:20:36.161335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2777/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:35 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:37.104027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "387b0977-337c-436e-8ce5-61e6b37a82fc", "tag": "e57b7b2f-7287-4991-8517-5c2b71efaa00"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:37.169010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:37.169544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:37.170318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:37.173284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:37.174459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:37.195087 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:37.214450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] Creating event network-changed:e57b7b2f-7287-4991-8517-5c2b71efaa00 for instance 387b0977-337c-436e-8ce5-61e6b37a82fc on n-h2-master-1 Oct 19 01:20:37.218176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:37.218685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:37.219130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:37.222956 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bcd8d232-8bbc-4108-8e46-6c3acf56a3a7 req-afcb7949-6771-4f6e-af4b-b606da312e07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133430 Oct 19 01:20:37.224310 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2897/5674] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:37.226342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:37.226889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:37.241398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:38.825440 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:39.194288 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:39.212597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e8764edb-0964-4b3a-bbee-6e8cdd0f6a8a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 2.047583 Oct 19 01:20:39.216125 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2778/5675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:37 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 2052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:40.241007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:40.241729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:40.245293 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:40.245989 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:40.264908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:40.265489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:40.265943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:40.267495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:40.267697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:40.268119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:40.967723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:40.979312 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69afea8b-1c2b-42d7-80d2-ed35b4ed7571 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.744162 Oct 19 01:20:41.000155 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2898/5676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:40 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:41.017656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-637d2cd1-89b3-455b-9807-2473c0c3afda tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: .version_select at 0x7f2aefe5f310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-885213905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdDw8BqxjNZ5+jYlpRNpRSBX7GmmraOAVsNHgTxJiKNbfImfs7y5GIDchXXof4Mnh32IRXo4WLYTJNKs+/KUr6lMtyBspOmFGjp7syu71F5zgIea9fd+Z6gb6asVXa4ig=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:41.062271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-637d2cd1-89b3-455b-9807-2473c0c3afda tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:20:41.073701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-637d2cd1-89b3-455b-9807-2473c0c3afda tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:20:41.119242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-637d2cd1-89b3-455b-9807-2473c0c3afda tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.107493 Oct 19 01:20:41.127518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2779/5677] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:20:41 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:42.008281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:42.008968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:42.023300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:42.023803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:42.024253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:42.041318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:42.041863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:42.042326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:42.046931 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=60 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:42.579512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:42.594316 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-49d84251-7981-4c34-af5f-6019b0e4a330 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.588341 Oct 19 01:20:42.596383 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2899/5678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:42 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:43.620420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:43.621590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:43.633361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:43.634125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:43.634770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:43.635686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:43.636501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:43.637125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:43.925270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:43.943031 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a68c7d5f-9d33-4ab7-9af9-99f89ee5912e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.327190 Oct 19 01:20:43.967710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2780/5679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:43 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:44.193452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af33025-a546-4db9-984f-99e971603f88", "name": "network-vif-plugged", "status": "completed", "tag": "0c1a9a6b-8d2e-4056-a580-4e8c64f1d636"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:44.206278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:44.206810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:44.207595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:44.222569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] Creating event network-vif-plugged:0c1a9a6b-8d2e-4056-a580-4e8c64f1d636 for instance 0af33025-a546-4db9-984f-99e971603f88 on n-h1-master-1 Oct 19 01:20:44.232748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-53a122b6-dfbd-4fdb-9d72-efe6ddb3bf86 req-430d22db-5c44-48e3-9fd0-8355349d5437 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234575 Oct 19 01:20:44.233729 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2900/5680] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:44.940776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1956580042", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "4ecf0ca6-908c-459f-b40f-38ccaff8e9d2"}], "key_name": "tempest-TestNetworkBasicOps-885213905", "security_groups": [{"name": "tempest-secgroup-smoke-410649163"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:44.974713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:44.975542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:45.001802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:45.006919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:45.007434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:45.008195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:45.018075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:45.018541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:45.383988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] validate_networks() for [('4ecf0ca6-908c-459f-b40f-38ccaff8e9d2', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:20:45.631649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:45.644950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b24f730-f1d8-4189-b67f-79923226270c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.677253 Oct 19 01:20:45.645574 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2901/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:44 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:46.361900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:20:46.362875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:20:46.363364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:20:46.363942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:20:46.364523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:20:46.383216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:46.383917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:46.384528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:46.385464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:46.386115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:46.394220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:46.435270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:20:46.442510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Getting quotas for user 0d12c0ca2333460bbf044ceb5178affb and project 1eabce6bc9744aa9b56f5d3a24900020. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:20:46.497624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:20:46.500261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:20:46.595206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f0fa7d5a-97ef-48b6-912e-3b309793afbd tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.658427 Oct 19 01:20:46.602047 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2781/5682] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:20:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:20:46.607965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1c83ba6-71c4-4a1f-90e9-b5d3c5522e58 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:46.609027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1c83ba6-71c4-4a1f-90e9-b5d3c5522e58 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:46.674300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:46.674964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:46.688528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:46.689079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:46.689527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:46.690256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:46.690740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:46.701189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:46.827015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e1c83ba6-71c4-4a1f-90e9-b5d3c5522e58 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:46.835401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1c83ba6-71c4-4a1f-90e9-b5d3c5522e58 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1248 microversion: 2.1 time: 0.231609 Oct 19 01:20:46.839535 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2902/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:46 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1248 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:47.792860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:47.802140 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1fe7da2f-0c05-4647-a10a-ec06d9ffb150 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 1.132199 Oct 19 01:20:47.805750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2782/5684] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:46 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:47.867915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:47.868543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:47.879417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387b0977-337c-436e-8ce5-61e6b37a82fc", "name": "network-vif-plugged", "status": "completed", "tag": "e57b7b2f-7287-4991-8517-5c2b71efaa00"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:47.909942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:47.913542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:47.916498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:47.917945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:47.919069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:47.921882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:47.925754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:47.926979 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:47.927945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:47.983291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] Creating event network-vif-plugged:e57b7b2f-7287-4991-8517-5c2b71efaa00 for instance 387b0977-337c-436e-8ce5-61e6b37a82fc on n-h2-master-1 Oct 19 01:20:48.011016 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-51da26d1-35af-4f9c-8e40-a207dcb73bd3 req-8fabdb96-9ffe-4372-b077-2b350016e62b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135794 Oct 19 01:20:48.014750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2783/5685] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:20:48.210345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:48.239126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1f08aed-2843-4db4-a439-7a29459b8a2a tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1300 microversion: 2.1 time: 0.376253 Oct 19 01:20:48.253558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2903/5686] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:47 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1300 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:48.834009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:48.835275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:48.853487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:48.854058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:48.854787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:48.855524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:48.856164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:48.856792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:49.232753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:49.242871 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f133b3be-ef45-46cd-bf8f-3fadd5d53921 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1321 microversion: 2.1 time: 0.413837 Oct 19 01:20:49.248283 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2784/5687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:48 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:49.280635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:49.282801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:49.316638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:49.323437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:49.323895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:49.325874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:49.326571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:49.327199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:49.555514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:49.570663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d409929-bd70-4f51-b242-1e32064e6c73 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1306 microversion: 2.1 time: 0.301409 Oct 19 01:20:49.587011 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2904/5688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:49 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1306 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:50.274810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:50.275817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:50.292831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.293678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.296101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.299522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.303535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.304227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.606550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:50.607300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:50.618046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.619412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.620341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.621384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.622059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.622986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.656050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:50.669188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2efa4fa5-6bc4-4198-a685-655d22bed8a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1514 microversion: 2.1 time: 0.399242 Oct 19 01:20:50.670593 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2785/5689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:50 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1514 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:50.698185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:50.700741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:50.712910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.717052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.717784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.718714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:50.721548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:50.724928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:50.788742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'flavor' on Instance uuid 387b0977-337c-436e-8ce5-61e6b37a82fc {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:20:50.964799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:50.966956 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b7bfdb3-60b4-4a20-9a11-e82c8ff018df tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action" status: 200 len: 32 microversion: 2.1 time: 0.272081 Oct 19 01:20:50.971039 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2786/5690] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:20:50 2022] POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action => generated 32 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 19 01:20:50.983913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:50.985858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:50.994799 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8e9d7c7f-26e2-47e7-8f16-0003a7aa0847 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.399242 Oct 19 01:20:50.997401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2905/5691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:50 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:51.004203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:51.006820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:51.007284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:51.008017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:51.008723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:51.009337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:51.376720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:51.388294 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7dc66a2c-d03f-41d4-8b04-da0170687eb2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.410753 Oct 19 01:20:51.392929 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2787/5692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:50 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:52.022234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:52.023340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:52.032170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:52.034826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:52.041049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:52.042037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:52.042755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:52.043351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:52.046985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653e5e58-f934-4281-917b-0d09973e5819", "tag": "1f9aa2be-86a2-44c4-ad16-5569e68f68d5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:52.076008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:52.077753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:52.079133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:52.112747 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] Creating event network-changed:1f9aa2be-86a2-44c4-ad16-5569e68f68d5 for instance 653e5e58-f934-4281-917b-0d09973e5819 on n-h1-master-1 Oct 19 01:20:52.117978 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a16666fc-6b07-4aa8-a5c1-9ca5c839c303 req-4e9b3ec1-2930-4fbc-8f06-5c3aaa21a190 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188767 Oct 19 01:20:52.119090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2906/5693] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:52.421161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:52.422180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:52.433842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:52.434384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:52.434864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:52.440084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:52.453071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:52.454233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:52.454658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:52.455649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b40c4191-1ed1-4379-a7a4-cc6fdd2f0810 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.434435 Oct 19 01:20:52.458659 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2788/5694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:52 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:52.790296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:52.801683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c5956386-b310-471d-b836-85c3c5bd87c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.386397 Oct 19 01:20:52.803379 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2907/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:52 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:20:53.482366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:53.483030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:53.504824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:53.505559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:53.507334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:53.508491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:53.509349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:53.510170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:53.707061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:53.720137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03cc2886-f7ea-4d62-8a8e-3dae9933992b tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.241287 Oct 19 01:20:53.721180 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2789/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:53 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:53.829458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:53.830120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:53.845439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:53.845943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:53.848158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:53.854554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:53.855501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:53.856381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:54.679031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:54.689172 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31580a97-98c9-4913-a20f-e369e7daa248 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.864565 Oct 19 01:20:54.690042 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2908/5697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:53 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:54.753364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:54.755377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:54.777036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:54.777808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:54.778427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:54.779311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:54.783135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:54.783798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:55.273481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:55.289416 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f9276262-8301-4c79-842c-f66fb09f4e00 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.541773 Oct 19 01:20:55.290934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2790/5698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:54 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:55.717189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:55.718588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:55.731483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:55.732794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:55.736267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:55.737451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:55.738486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:55.741357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:56.052364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:56.066189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bb2eb4c-f50c-4fed-9f08-d893b952c233 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.353371 Oct 19 01:20:56.068213 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2909/5699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:55 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:56.318652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:56.319436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:56.332311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:56.334159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:56.334867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:56.335910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:56.337601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:56.338313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:56.425332 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:56.482083 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:56.646745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:56.659331 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4b63fea-ad0c-4c28-9b2f-499a8edf6d9c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.343379 Oct 19 01:20:56.661227 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2791/5700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:56 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:57.091809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:57.100217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:57.106960 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:57.110029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:57.111198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:57.111863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:57.113471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:57.114285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:57.115099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:57.286177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:57.294610 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4a45369-fe76-425c-bdbd-9c2abb9b6466 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.207179 Oct 19 01:20:57.295214 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2910/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:57 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:57.687069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:57.688296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:57.698629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:57.699412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:57.700067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:57.701040 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:57.701582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:57.702229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:57.735627 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:20:57.910984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:57.922231 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25321a53-59a2-4bc8-9f18-d45425b8c8ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.239942 Oct 19 01:20:57.923579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2792/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:57 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:58.322789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:58.324589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653e5e58-f934-4281-917b-0d09973e5819", "name": "network-vif-plugged", "status": "completed", "tag": "1f9aa2be-86a2-44c4-ad16-5569e68f68d5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:20:58.327073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:58.351678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:58.352484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:58.354380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:58.360480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:58.363649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:58.364975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:58.368307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:58.371374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:58.372408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:58.401043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] Creating event network-vif-plugged:1f9aa2be-86a2-44c4-ad16-5569e68f68d5 for instance 653e5e58-f934-4281-917b-0d09973e5819 on n-h1-master-1 Oct 19 01:20:58.407218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4ef323b2-a132-4e1c-8a28-e375a423615e req-c3b6a5f0-1cae-4fe9-9d57-5fb3d85d937d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098026 Oct 19 01:20:58.413286 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2911/5703] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:20:58.716260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:58.731216 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2aedc812-9e76-454c-bb19-a2de62b4fe74 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.416097 Oct 19 01:20:58.732763 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2793/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:58 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:58.947232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:58.948180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:58.955478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:58.956169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:58.956819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:58.957681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:58.958291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:58.958871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:59.150803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:20:59.161815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13c73773-6838-4690-9b77-2955180b9c76 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1373 microversion: 2.1 time: 0.218791 Oct 19 01:20:59.163004 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2912/5705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:58 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1373 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:20:59.755655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:20:59.756281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:20:59.771450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:59.771982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:59.772425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:20:59.773329 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:20:59.773835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:20:59.774272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:00.189366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:00.190026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:00.195068 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=42 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:00.199459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:00.199967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:00.200413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:00.201821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:00.203127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:00.203769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:00.213219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:00.233675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c9207f3-2ec3-4154-9b77-ea3081ea5f81 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.472300 Oct 19 01:21:00.238311 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2794/5706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:20:59 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:00.478550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:00.489516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e0c052e-161a-4bca-a68a-98517a764e68 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1545 microversion: 2.1 time: 0.306927 Oct 19 01:21:00.490132 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2913/5707] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:00 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1545 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:00.522936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:00.523581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:00.537175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:00.537683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:00.540092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:00.541984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:00.544141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:00.544599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:00.866500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:00.880766 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a86905b7-4f15-4e12-ba70-f2273210bba7 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1545 microversion: 2.1 time: 0.367235 Oct 19 01:21:00.893085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2795/5708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:00 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1545 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:01.261321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:01.262629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:01.284347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:01.286135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:01.286777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:01.287760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:01.291031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:01.294220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:01.590208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:01.599560 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-47e6c52a-67a9-4dfc-934a-b14f835d4819 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.343818 Oct 19 01:21:01.613273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2914/5709] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:01 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:02.628089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:02.630797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:02.639537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:02.640297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:02.642148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:02.643055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:02.643688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:02.644293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:03.037081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:03.047526 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b26d4b1-c092-40f6-ae61-7dea2a70ef60 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.423956 Oct 19 01:21:03.058510 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2796/5710] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:02 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:04.083385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:04.084027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:04.092775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:04.093802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:04.094249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:04.095061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:04.098986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:04.100407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:04.357507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:04.371734 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fefb5092-fd0d-4d8e-9b5d-39d68c10e265 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.292130 Oct 19 01:21:04.372499 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2915/5711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:04 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:04.530936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653e5e58-f934-4281-917b-0d09973e5819", "tag": "1f9aa2be-86a2-44c4-ad16-5569e68f68d5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:04.556872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:04.557499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:04.557951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:04.575789 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] Creating event network-changed:1f9aa2be-86a2-44c4-ad16-5569e68f68d5 for instance 653e5e58-f934-4281-917b-0d09973e5819 on n-h1-master-1 Oct 19 01:21:04.599366 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e2ae8927-01f4-4063-9e6c-d50ed40dc09a req-7359de5f-796a-437d-87fa-5437cf9930c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065454 Oct 19 01:21:04.599366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2797/5712] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:05.396783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:05.397450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:05.414687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:05.415550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:05.416002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:05.416809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:05.417719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:05.418259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:05.643556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:05.655866 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9dd16fd1-a1f6-423c-a8d2-b97806ad0294 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.264106 Oct 19 01:21:05.657031 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2916/5713] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:05 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:06.681376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:06.681865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:06.709434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:06.712906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:06.714727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:06.721165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:06.722986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:06.723653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:07.010206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:07.021728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9126cd4c-cd23-4019-bec5-58b58f601f68 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.346354 Oct 19 01:21:07.029194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2798/5714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:06 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:08.053964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:08.053964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:08.061765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:08.062595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:08.063184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:08.070365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:08.071189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:08.072915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:08.299701 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:08.309608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4953d657-3c93-4278-ad6c-e252a06ce22c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.266891 Oct 19 01:21:08.311484 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2917/5715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:08 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:09.334588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:09.335817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:09.344842 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:09.348201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:09.353033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:09.355136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:09.356074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:09.358628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:09.361183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:09.762519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:09.771485 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19bfb053-af95-48ec-b897-5ebc41737eb7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.440906 Oct 19 01:21:09.772074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2799/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:09 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:10.798805 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:10.799340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:10.822920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:10.823845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:10.824461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:10.826523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:10.843135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:10.855013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:11.506851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:11.521279 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:11.525550 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b69fe949-9db6-482d-a705-c52d2e4514b6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.731534 Oct 19 01:21:11.527378 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2918/5717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:10 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:12.522064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Action: 'create', calling method: .version_select at 0x7f2aefe5f820>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:12.542391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Getting quotas for project f06e14eb8ea544e09633e2d786c67143. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:21:12.548367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Getting quotas for user 14bd2636440d4357a2dd9a8867636581 and project f06e14eb8ea544e09633e2d786c67143. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:21:12.551055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:12.552660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:12.571117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:12.571997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:12.572604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:12.573598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:12.574219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:12.574808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:12.602638 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Getting quotas for project f06e14eb8ea544e09633e2d786c67143. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:21:12.610005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Getting quotas for user 14bd2636440d4357a2dd9a8867636581 and project f06e14eb8ea544e09633e2d786c67143. Resources: {'server_groups'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:21:12.630123 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99c854d5-bb68-4cb9-93ff-9fe544ea6a1e tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.491887 Oct 19 01:21:12.637132 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2800/5718] 10.222.0.27 () {62 vars in 1214 bytes} [Wed Oct 19 01:21:12 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:21:12.644538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02b60738-2d01-48d7-ab96-95c04a5929c5 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:12.657580 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02b60738-2d01-48d7-ab96-95c04a5929c5 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018198 Oct 19 01:21:12.658498 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2801/5719] 10.222.0.27 () {60 vars in 1193 bytes} [Wed Oct 19 01:21:12 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:21:12.669828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0781de95-868a-4e7b-9fe6-32f24353bd48 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:12.689718 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0781de95-868a-4e7b-9fe6-32f24353bd48 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f" status: 200 len: 235 microversion: 2.64 time: 0.023846 Oct 19 01:21:12.697038 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2802/5720] 10.222.0.27 () {60 vars in 1304 bytes} [Wed Oct 19 01:21:12 2022] GET /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f => generated 235 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 19 01:21:12.703138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b8bd17b-6305-4703-aaf8-b47c7eb00a78 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:12.735627 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b8bd17b-6305-4703-aaf8-b47c7eb00a78 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f" status: 204 len: 0 microversion: 2.64 time: 0.036922 Oct 19 01:21:12.736317 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2803/5721] 10.222.0.27 () {60 vars in 1307 bytes} [Wed Oct 19 01:21:12 2022] DELETE /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:21:12.747972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54989cdf-2c0b-4e0e-824e-7d4a31595355 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:12.757217 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-54989cdf-2c0b-4e0e-824e-7d4a31595355 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] HTTP exception thrown: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54989cdf-2c0b-4e0e-824e-7d4a31595355 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Request method failure captured: Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f HTTP/1.1 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1EIW6gzOZ1vVPMqpy5DuwI89sZwQw9K0tWCm2nYOijr_olkmYCFT1NdBiGPG9dMCRe_MqoJPMRiy0p2iThujwjTcFq31Oi-9P8y4cPiof7YNKpchxOCPDcTRcys7C8Tt95jEEU-Puhq6rPVjlX2pyfTPKNfEl0PMbIid3lU_x88ZbU Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.64 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: f06e14eb8ea544e09633e2d786c67143 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerGroup264TestJSON-644138730 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f06e14eb8ea544e09633e2d786c67143", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f06e14eb8ea544e09633e2d786c67143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f06e14eb8ea544e09633e2d786c67143"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f06e14eb8ea544e09633e2d786c67143"}]}] Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerGroup264TestJSON-644138730 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: f06e14eb8ea544e09633e2d786c67143 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerGroup264TestJSON-644138730 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerGroup264TestJSON-644138730-project Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 14bd2636440d4357a2dd9a8867636581 Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerGroup264TestJSON-644138730-project Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: exception: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'd72da334-c0e8-4205-ba33-295bbba1202f'} Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:12.759600 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. Oct 19 01:21:12.765957 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:12.769311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-54989cdf-2c0b-4e0e-824e-7d4a31595355 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] Returning 404 to user: Instance group d72da334-c0e8-4205-ba33-295bbba1202f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:12.770232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-54989cdf-2c0b-4e0e-824e-7d4a31595355 tempest-ServerGroup264TestJSON-644138730 tempest-ServerGroup264TestJSON-644138730-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f" status: 404 len: 117 microversion: 2.64 time: 0.027852 Oct 19 01:21:12.770830 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2804/5722] 10.222.0.27 () {60 vars in 1307 bytes} [Wed Oct 19 01:21:12 2022] DELETE /compute/v2.1/os-server-groups/d72da334-c0e8-4205-ba33-295bbba1202f => generated 117 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:21:12.830052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:12.844144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0ce22d57-6828-4dd9-893f-ed6970732dc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.297506 Oct 19 01:21:12.847025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2919/5723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:12 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:13.869911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:13.871296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:13.880413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:13.881351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:13.882012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:13.882940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:13.883610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:13.884269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:14.091863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:14.101825 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-895ff88f-6253-41fd-87cb-6e6f36786edb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.235832 Oct 19 01:21:14.120715 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2805/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:13 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:15.137822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:15.139696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:15.159759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:15.160247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:15.160729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:15.161445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:15.169359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:15.170240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:15.706094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:15.715683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e699f5ff-85d5-4fb8-9287-23e8450cf6b2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.593065 Oct 19 01:21:15.716945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2920/5725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:15 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:16.744070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:16.745644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:16.755204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:16.755971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:16.756603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:16.757439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:16.758022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:16.758564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:17.063059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:17.073618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fef68a20-ce8b-427a-bbfd-afa420be69db tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.333839 Oct 19 01:21:17.095614 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2806/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:16 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:18.102161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:18.103958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:18.124575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:18.125347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:18.126125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:18.127234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:18.127889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:18.128510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:18.343249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:18.352576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0147e132-dd6f-4f6d-a7c0-e38d1271d984 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.254699 Oct 19 01:21:18.368829 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2921/5727] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:18 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:19.380067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:19.380709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:19.394112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:19.394703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:19.395390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:19.396307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:19.397129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:19.397760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:19.540696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:19.553072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95bdb286-31f3-4f97-9797-d88c50dad857 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1520 microversion: 2.1 time: 0.176839 Oct 19 01:21:19.565226 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2807/5728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:19 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:20.583814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:20.584483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:20.597910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:20.598458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:20.598751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:20.603929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:20.603929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:20.604980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:20.847435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:20.855404 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a9e3f9c-8beb-40df-bcff-4f328dab71aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1500 microversion: 2.1 time: 0.279712 Oct 19 01:21:20.855992 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2922/5729] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:20 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1500 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:20.880398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:20.881659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:20.888803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:20.890315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:20.890761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:20.891470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:20.891927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:20.892356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:21.418527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:21.429484 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac569ddc-c0d7-424a-aff2-48d0c9e28be9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1516 microversion: 2.1 time: 0.552874 Oct 19 01:21:21.430411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2808/5730] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:20 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1516 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:21.455545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:21.458416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 506de303-f141-43bc-9305-4d9f4cff1038] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:21.464895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/506de303-f141-43bc-9305-4d9f4cff1038/action HTTP/1.1 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 14 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: {"rescue": {}} Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '506de303-f141-43bc-9305-4d9f4cff1038', 'body': {'rescue': {}}} Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:21.477945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. Oct 19 01:21:21.481935 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:21.484054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 404 to user: Instance 506de303-f141-43bc-9305-4d9f4cff1038 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:21.484991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-910ff955-f4fb-4c2c-bde5-dfc4a69d3d40 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/506de303-f141-43bc-9305-4d9f4cff1038/action" status: 404 len: 111 microversion: 2.1 time: 0.034465 Oct 19 01:21:21.486563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2923/5731] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:21 2022] POST /compute/v2.1/servers/506de303-f141-43bc-9305-4d9f4cff1038/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:21:21.495815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:21.496850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:21.503946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:21.504491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:21.504967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:21.505741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:21.506262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:21.506933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:21.593996 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-61a43358-bad5-4ab6-911c-2b01fa222fc6 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action" status: 202 len: 0 microversion: 2.1 time: 0.101948 Oct 19 01:21:21.597938 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2809/5732] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:21 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:21:21.606047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:21.606704 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:21.615261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:21.615993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:21.616661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:21.617988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:21.618642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:21.619263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:21.947431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:21.957385 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8fc683c-5353-4d38-b3f0-b6a374fce925 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1521 microversion: 2.1 time: 0.354985 Oct 19 01:21:21.958007 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2924/5733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:21 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:22.981758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:22.982649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:22.986129 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=8 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:23.005222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.006084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.007277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.008256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.009055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.009730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.207450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:23.234838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37ae18b9-ab63-40d0-8d69-2b14a8d60e8b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1501 microversion: 2.1 time: 0.257576 Oct 19 01:21:23.241760 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2810/5734] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:22 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:23.269543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:23.273383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:23.282525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.283292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.284140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.285422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.286223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.286995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.321950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'flavor' on Instance uuid 0af33025-a546-4db9-984f-99e971603f88 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:21:23.340382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Cannot 'rescue' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state paused Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action HTTP/1.1 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 14 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: {"rescue": {}} Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'rescue' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state paused Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0af33025-a546-4db9-984f-99e971603f88', 'body': {'rescue': {}}} Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0af33025-a546-4db9-984f-99e971603f88 in vm_state paused. Cannot rescue while the instance is in this state. Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state paused Oct 19 01:21:23.343696 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state paused Oct 19 01:21:23.348125 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:23.350412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 409 to user: Cannot 'rescue' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state paused {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:23.351990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-89a4adb6-2fdb-4670-811f-53092acf9bbe tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action" status: 409 len: 144 microversion: 2.1 time: 0.090776 Oct 19 01:21:23.357062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2925/5735] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:23 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action => generated 144 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:21:23.364399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:23.364399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:23.373179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.374760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.375615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.377288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.378010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.378728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.473699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-554ee7dd-e27f-4610-b4c6-3a421f7ce679 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action" status: 202 len: 0 microversion: 2.1 time: 0.114839 Oct 19 01:21:23.500884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2811/5736] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:23 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:21:23.508073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:23.508960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:23.524363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.525348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.525929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.531065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:23.531562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:23.532194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:23.755476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:23.768517 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-288e862d-191b-4cb8-8543-235a2f984793 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1508 microversion: 2.1 time: 0.284411 Oct 19 01:21:23.769497 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2926/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:23 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:24.797519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:24.798746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:24.814745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:24.815159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:24.815615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:24.816342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:24.816883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:24.817988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:24.837132 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:24.978533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:24.989436 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2bb9cb73-e767-476a-9dca-642058513731 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1508 microversion: 2.1 time: 0.197371 Oct 19 01:21:24.990950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2812/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:24 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:26.013629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:26.016302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:26.027688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:26.029238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:26.032020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:26.032810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:26.034201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:26.046705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:26.209986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:26.218761 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c85a2b6c-fb98-4315-b3ff-2b304fa0e646 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1508 microversion: 2.1 time: 0.209370 Oct 19 01:21:26.219339 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2927/5739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:26 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:27.044892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:27.047605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:27.055557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:27.056159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:27.056933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:27.057719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:27.058890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:27.059334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:27.243890 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:27.245114 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:27.254335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:27.254914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:27.255422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:27.256196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:27.256830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:27.257326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:27.406751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:27.414637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00395303-9d11-428a-86dc-56d43dc943b5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1508 microversion: 2.1 time: 0.174903 Oct 19 01:21:27.415476 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2928/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:27 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:28.439783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:28.440595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:28.448546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:28.449087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:28.449539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:28.450259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:28.450720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:28.451399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:28.613846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:28.622044 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ac90e526-4e33-4348-b51c-df9c43bdb776 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1508 microversion: 2.1 time: 0.186604 Oct 19 01:21:28.622902 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2929/5741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:28 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:29.069841 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f88739b-8c53-42dc-b7bb-8ba98e56bdfc tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819/action" status: 200 len: 24570 microversion: 2.1 time: 2.029790 Oct 19 01:21:29.070749 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2813/5742] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:27 2022] POST /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819/action => generated 24570 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:21:29.648462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:29.649164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:29.668661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:29.669178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:29.669634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:29.670405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:29.670878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:29.671346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:29.893765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:29.902342 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f2d949f-1404-4aab-864e-1b649b01d4c1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1516 microversion: 2.1 time: 0.258196 Oct 19 01:21:29.902940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2930/5743] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:29 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1516 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:31.494296 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:31.501836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:31.510612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:31.511109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:31.511755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:31.512557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:31.513125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:31.513587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:31.541262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'flavor' on Instance uuid 0af33025-a546-4db9-984f-99e971603f88 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:21:31.626881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba34bee8-29d7-48df-80b5-2ba96485d3ba tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action" status: 200 len: 32 microversion: 2.1 time: 0.144707 Oct 19 01:21:31.627749 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2814/5744] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:31 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action => generated 32 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:21:31.639745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:31.641265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:31.646315 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:31.661169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:31.662294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:31.662823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:31.666851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:31.667542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:31.668449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:31.947286 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:31.955845 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d6a087c-ce29-43ff-b8ce-7d63ca49746c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.322287 Oct 19 01:21:31.956436 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2931/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:31 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:32.980560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:32.981440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:32.992153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:32.992845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:32.993364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:32.994070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:32.994524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:32.995167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:33.221450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:33.231238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f21df66-3dea-4fe3-9e31-b403d1511f62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.254619 Oct 19 01:21:33.232608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2815/5746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:32 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:33.903688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1527628317", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "060f5326-d243-4db2-a71a-687377ad0f42"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:33.965797 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] validate_networks() for [('060f5326-d243-4db2-a71a-687377ad0f42', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:21:34.255282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:34.255901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:34.262546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:34.263041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:34.263483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:34.268142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:34.268645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:34.269269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:34.395209 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:21:34.395751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:21:34.400506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:21:34.401043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:21:34.401726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:21:34.413883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:34.414406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:34.414923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:34.415738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:34.416273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:34.416811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:34.428248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:34.436983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3275233b-4aea-40c3-b75a-197113d84122 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.185396 Oct 19 01:21:34.449001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2816/5747] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:34 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:34.451233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Getting quotas for project 712de07c21e04da39299e7f53a7b6a29. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:21:34.457519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Getting quotas for user 2e17cb04dd32451fa3a46c941fe1ca81 and project 712de07c21e04da39299e7f53a7b6a29. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:21:34.470937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:21:34.473279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:21:34.522592 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d3451b4-ba09-4d73-8a1c-51c8bab146dc tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850231 Oct 19 01:21:34.523217 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2932/5748] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:21:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:21:34.534825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0eeb479d-6e67-4d62-bb22-4038b17ce52f tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:34.535443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0eeb479d-6e67-4d62-bb22-4038b17ce52f tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:34.590840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0eeb479d-6e67-4d62-bb22-4038b17ce52f tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:34.598344 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0eeb479d-6e67-4d62-bb22-4038b17ce52f tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1214 microversion: 2.1 time: 0.067238 Oct 19 01:21:34.598943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2817/5749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:34 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:35.463308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:35.464021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:35.472401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:35.472948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:35.473698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:35.474405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:35.475194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:35.475628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:35.620965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:35.621574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:35.630577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:35.631073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:35.631519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:35.632224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:35.633122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:35.633874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:35.635872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:35.648537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-50086de6-6ac4-4744-93bf-ce8490a512f5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.190767 Oct 19 01:21:35.649530 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2933/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:35 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:35.702732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:35.710512 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f6ad0b50-e02c-4e54-a4b4-f3d09adef223 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1266 microversion: 2.1 time: 0.093480 Oct 19 01:21:35.711028 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2818/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:35 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:36.674222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:36.676975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:36.686920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:36.687966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:36.688586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:36.689805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:36.690653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:36.691257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:36.736263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:36.737160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:36.744862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:36.745878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:36.746338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:36.747339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:36.747803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:36.749647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:36.972734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:36.984454 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44710912-feff-4153-8181-3a1492b2c020 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.314859 Oct 19 01:21:36.985841 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2934/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:36 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:37.014752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:37.022524 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1abb465-b001-4ff5-aaa5-b053f8541fe6 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.292355 Oct 19 01:21:37.023125 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2819/5753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:36 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:37.588151 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d7be14c-49e2-40ad-86f6-9a61798cac0a", "tag": "048bf7f5-84b9-4ca3-ae87-f295c0efd641"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:37.599898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:37.600562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:37.601231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:37.613004 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] Creating event network-changed:048bf7f5-84b9-4ca3-ae87-f295c0efd641 for instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a on n-h1-master-1 Oct 19 01:21:37.626782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-68dd4b55-b989-4106-b1e9-c51511061c98 req-82f407c0-326d-4dc2-9a2e-c3bc6969e0aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041912 Oct 19 01:21:37.631353 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2935/5754] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:38.009317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:38.009946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:38.017647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:38.018156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:38.018605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:38.019319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:38.019787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:38.020231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:38.048288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:38.049676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:38.057430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:38.058042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:38.059136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:38.060133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:38.060750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:38.061181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:38.281599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:38.289508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f7543f7-0a52-4025-a90c-d303eb7ff622 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.284063 Oct 19 01:21:38.290423 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2820/5755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:38 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:38.300801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:38.308536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af96d919-cb4b-44da-bea9-59bd8044adbb tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.265022 Oct 19 01:21:38.309157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2936/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:38 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:39.313853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:39.314481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:39.321479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:39.322104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:39.322599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:39.323421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:39.323887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:39.324320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:39.332320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:39.333527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:39.340200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:39.340713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:39.341338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:39.342288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:39.342925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:39.343350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:39.538065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:39.542755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:39.546681 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=100 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:39.548456 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-61aa91c7-46dd-427a-b113-65d075f86305 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.239715 Oct 19 01:21:39.554036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2b74c5a-7960-4123-891b-acf60b4e471e tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.225549 Oct 19 01:21:39.555012 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2937/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:39 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:39.564907 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2821/5758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:39 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:40.212329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:40.214728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:40.217136 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:40.222430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.222935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.223383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.224196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.224694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.225135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.303081 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24062920-a0d9-4680-a13f-f818025cdbc1 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "POST /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819/action" status: 200 len: 32639 microversion: 2.1 time: 0.094423 Oct 19 01:21:40.304034 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2822/5759] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:40 2022] POST /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819/action => generated 32639 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:21:40.575519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:40.575519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:40.581545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:40.582268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:40.592915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.593433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.593861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.595283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.595403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.595822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.600653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.604815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.605269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.611615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:40.612107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:40.612547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:40.911541 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:40.917976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:40.920474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-329adf3f-d118-4abc-a4af-9a650ecb255d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.349789 Oct 19 01:21:40.921682 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2938/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:40 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:40.932895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-602575df-f925-4c93-bd28-ce034598cd10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.354262 Oct 19 01:21:40.937573 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2823/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:40 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:41.585511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "653e5e58-f934-4281-917b-0d09973e5819", "tag": "1f9aa2be-86a2-44c4-ad16-5569e68f68d5"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:41.594190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:41.594707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:41.605590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.610391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.611110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.611539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.612254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.612968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.613313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.618056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.618499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.631256 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] Creating event network-changed:1f9aa2be-86a2-44c4-ad16-5569e68f68d5 for instance 653e5e58-f934-4281-917b-0d09973e5819 on n-h1-master-1 Oct 19 01:21:41.636330 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1b7d4489-12b3-49b0-b79f-5b7f7aa5b598 req-596e2b15-3dfb-4141-b3e6-1c78ea8ce85f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054917 Oct 19 01:21:41.637573 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2824/5762] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:21:41.663852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:21:41.778132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec43e5c7-8f74-43b6-9ac2-67603ee18fb4 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 204 len: 0 microversion: 2.1 time: 0.195711 Oct 19 01:21:41.778625 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2939/5763] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:21:41 2022] DELETE /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:41.787293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:41.791835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:41.805078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.805581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.806640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.807408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.808065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.808668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.948142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:41.948142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:41.959336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.960250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.960877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.962002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:41.962618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:41.963204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:41.989544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:41.998606 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b85d51f1-fafd-49e6-8fce-a3436ca8ad63 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1670 microversion: 2.1 time: 0.214891 Oct 19 01:21:42.000275 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2825/5764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:41 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:42.005545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:42.009135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:42.017084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:42.018031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:42.018907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:42.020133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:42.020791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:42.022105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:42.192019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:42.202194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08aa47b0-93fe-4246-8a58-38a655a056aa tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.260579 Oct 19 01:21:42.203021 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2940/5765] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:41 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:42.237313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:42.247269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf2a2eb6-3a0b-4e48-8ea0-e9fb57cbca43 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.245864 Oct 19 01:21:42.256797 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2826/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:42 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:42.443068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7be14c-49e2-40ad-86f6-9a61798cac0a", "name": "network-vif-plugged", "status": "completed", "tag": "048bf7f5-84b9-4ca3-ae87-f295c0efd641"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:42.453393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:42.453878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:42.454307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:42.465698 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] Creating event network-vif-plugged:048bf7f5-84b9-4ca3-ae87-f295c0efd641 for instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a on n-h1-master-1 Oct 19 01:21:42.471909 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dff75a06-3cc0-4c87-a7d2-3c7a358f2606 req-2d0ce03c-c637-4444-b8c0-a497bd78f1d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032444 Oct 19 01:21:42.472729 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2941/5767] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:43.023522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:43.024145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:43.031726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.032215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.032676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.033381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.033843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.034273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.205892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:43.214182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2adb8db-3417-4bff-9f79-70375e70c9b8 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1670 microversion: 2.1 time: 0.194732 Oct 19 01:21:43.214858 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2827/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:43 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:43.233477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:43.234227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:43.240467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.240991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.241438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.242145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.242608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.243041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.272023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:43.272596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:43.278844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.280264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.280644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.281374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:43.281844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:43.282291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:43.442625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:43.454892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28cf07cd-11a1-4ded-aed1-03e5ec06e216 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.231091 Oct 19 01:21:43.455614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2942/5769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:43 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:43.499076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:43.507370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cffa1f5e-4925-4ff9-a9d3-847c5c3b7a74 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.239411 Oct 19 01:21:43.507965 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2828/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:43 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:43.995212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "653e5e58-f934-4281-917b-0d09973e5819", "name": "network-vif-deleted", "tag": "1f9aa2be-86a2-44c4-ad16-5569e68f68d5"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:44.005068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.005495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.005934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.017325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] Creating event network-vif-deleted:1f9aa2be-86a2-44c4-ad16-5569e68f68d5 for instance 653e5e58-f934-4281-917b-0d09973e5819 on n-h1-master-1 Oct 19 01:21:44.022325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-94478e46-fa07-48fa-933d-19293bfb0a79 req-1e6c5491-6942-4bdd-8571-295f4969ad27 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030862 Oct 19 01:21:44.022945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2943/5771] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:44.239063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:44.239618 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:44.246462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.246952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.247403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.248106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.248570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.249034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.268342 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.316114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:44.324102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea345bd9-299a-45a3-9c20-e8f0b9d65e7e tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1603 microversion: 2.1 time: 0.088984 Oct 19 01:21:44.324916 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2829/5772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:44 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1603 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:44.476926 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.477736 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.484463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:44.485577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:44.494626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.495541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.496150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.496947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.497807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.498727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.532998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:44.533946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:44.540973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.541638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.542327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.543070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:44.543538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:44.543974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:44.595195 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:44.692658 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:44.701720 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc2c7169-ae0c-40f2-ae13-e6351fba4417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.225971 Oct 19 01:21:44.702995 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2944/5773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:44 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:44.722438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:44.731822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5520ef3a-e314-474a-84b6-adaa2d615d10 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1314 microversion: 2.1 time: 0.204588 Oct 19 01:21:44.733284 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2830/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:44 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:45.348672 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:45.349292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:45.355178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.355658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.356099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.356840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.357300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.358822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.388951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.389840 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.390467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.390927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lazy-loading 'fault' on Instance uuid 653e5e58-f934-4281-917b-0d09973e5819 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:21:45.431211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:45.439178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-66f1e326-4b47-4f95-8bb0-96db176342ef tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1489 microversion: 2.1 time: 0.094561 Oct 19 01:21:45.439760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2945/5775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:45 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1489 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:45.725599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:45.726253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:45.733195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.733726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.734361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.735086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.735557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.735998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.757320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:45.758026 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:45.765859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.766359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.766804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.767515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:45.768135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:45.768600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:45.927036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:45.935084 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e38e68e-7e62-4321-9f5b-5a980db1e12b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.213192 Oct 19 01:21:45.935798 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2831/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:45 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:45.949187 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:45.957678 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-899aea85-52c4-4127-896d-595afc7b8370 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1497 microversion: 2.1 time: 0.206134 Oct 19 01:21:45.958258 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2946/5777] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:45 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:46.462998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:46.463621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:46.470421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:46.470911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:46.471350 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:46.472039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:46.472494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:46.472955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:46.503816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:46.504219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:46.504677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:46.505130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lazy-loading 'fault' on Instance uuid 653e5e58-f934-4281-917b-0d09973e5819 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:21:46.550381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d12c0ca2333460bbf044ceb5178affb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eabce6bc9744aa9b56f5d3a24900020', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:46.562137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2c589ea-e37c-4746-b414-c1bf557c890c tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 200 len: 1489 microversion: 2.1 time: 0.102963 Oct 19 01:21:46.562829 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2832/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:46 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 1489 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:46.959841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:46.960465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:46.972445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:46.973046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:46.973540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:46.974265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:46.974776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:46.975194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.126077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:47.134488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-129b0798-f702-46c0-9d72-c51ad6545cb5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1502 microversion: 2.1 time: 0.178937 Oct 19 01:21:47.135348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2947/5779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:46 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:47.158270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2bcd149-16fe-463f-a162-2234f8901b31"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:47.160971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:47.167860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.168348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.168833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.169732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.170705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.171295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.198004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Cannot 'attach_volume' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state rescued Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/os-volume_attachments HTTP/1.1 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 74 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: {"volumeAttachment": {"volumeId": "e2bcd149-16fe-463f-a162-2234f8901b31"}} Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'attach_volume' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state rescued Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '0af33025-a546-4db9-984f-99e971603f88', 'body': {'volumeAttachment': {'volumeId': 'e2bcd149-16fe-463f-a162-2234f8901b31'}}} Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0af33025-a546-4db9-984f-99e971603f88 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 19 01:21:47.199711 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state rescued Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state rescued Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 409 to user: Cannot 'attach_volume' instance 0af33025-a546-4db9-984f-99e971603f88 while it is in vm_state rescued {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4cb3523-e1e6-4eb8-a3df-24d37d8e680a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047666 Oct 19 01:21:47.203766 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2833/5780] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:21:47 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 19 01:21:47.210566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:47.211117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:47.217328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.217930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.218375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.219078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.219539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.219969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.286465 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e4ea42-3d99-4a84-9486-fdc1796251a1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action" status: 202 len: 0 microversion: 2.1 time: 0.079859 Oct 19 01:21:47.287317 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2948/5781] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:21:47 2022] POST /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:21:47.297139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:47.298002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:47.304909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.305834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.306463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.307374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.308022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.308830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.587939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:47.588738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] [instance: 653e5e58-f934-4281-917b-0d09973e5819] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:47.595076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.595759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.596203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.596941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:47.597396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:47.598036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:47.612853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] HTTP exception thrown: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Request method failure captured: Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 HTTP/1.1 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1BECFnGfoIxzvpu5y2WuJhmkvohNrJhwfLBIy741nQM8jPaU_9cbc6-tYfEBz6gR2KNgyZFM_tEB9m0QQlRiLjf2nn-QegOz18geLAfnQwA5OP9U0bp0LPPmJka-_-y_26kfkR6aD3v8Ol85qZUKkq71BvdOf7GiEA_KOhxs3NtVLw Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1eabce6bc9744aa9b56f5d3a24900020", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1eabce6bc9744aa9b56f5d3a24900020"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1eabce6bc9744aa9b56f5d3a24900020"}]}] Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkBasicOps-375582524 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 1eabce6bc9744aa9b56f5d3a24900020 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkBasicOps-375582524 Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 0d12c0ca2333460bbf044ceb5178affb Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkBasicOps-375582524-project Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '653e5e58-f934-4281-917b-0d09973e5819'} Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:47.614868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Returning 404 to user: Instance 653e5e58-f934-4281-917b-0d09973e5819 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:47.618735 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68cd2e92-fc80-4ca7-beca-4896d6b3bd9d tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819" status: 404 len: 111 microversion: 2.1 time: 0.032707 Oct 19 01:21:47.620901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2949/5782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:47 2022] GET /compute/v2.1/servers/653e5e58-f934-4281-917b-0d09973e5819 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:21:47.796032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e6be9e9-beda-4b57-b614-f6f6f441c357 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] Calling method '.version_select at 0x7f2af54785e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:47.805250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:47.813571 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b96589b-5f69-450d-9c06-4993aeec0cde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1510 microversion: 2.1 time: 0.521583 Oct 19 01:21:47.814159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2834/5783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:47 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:47.841055 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e6be9e9-beda-4b57-b614-f6f6f441c357 tempest-TestNetworkBasicOps-375582524 tempest-TestNetworkBasicOps-375582524-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-885213905" status: 202 len: 0 microversion: 2.1 time: 0.053279 Oct 19 01:21:47.841971 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2950/5784] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 01:21:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-885213905 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:21:48.543254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:48.543895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:48.552137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.552746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.553272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.554047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.554577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.555035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.589799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:21:48.671328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f852cdcf-1de2-4053-93c4-0952c90daebd tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 204 len: 0 microversion: 2.1 time: 0.133540 Oct 19 01:21:48.672236 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2835/5785] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:21:48 2022] DELETE /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:21:48.681673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:48.682442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:48.689954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.690640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.691259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.692108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.692885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.693317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.840536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:48.841286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:48.847106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:48.849622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.850307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.850939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.851833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:48.852465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:48.853094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:48.855951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1da9e692-cb52-4c88-b356-9884d891e35a tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1503 microversion: 2.1 time: 0.179303 Oct 19 01:21:48.872890 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2951/5786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:48 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:49.038510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:49.047827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1225cefb-3d04-47a8-a2cd-29d26cdbc607 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1510 microversion: 2.1 time: 0.211797 Oct 19 01:21:49.049524 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2836/5787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:48 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:21:49.880505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:49.881967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:49.892641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:49.893095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:49.893611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:49.894461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:49.895019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:49.895514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:50.074556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:50.076117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:50.084064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:50.084983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:50.093148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:50.094508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:50.095873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:50.096540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:50.219759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:50.229710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-97b59c7d-d4bf-4dd6-ae09-0cdfad698bb2 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1503 microversion: 2.1 time: 0.354312 Oct 19 01:21:50.247721 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2952/5788] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:49 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1503 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:50.353660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:50.361962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07857ba4-691c-4ef0-b28a-f65ab33a4817 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1510 microversion: 2.1 time: 0.293321 Oct 19 01:21:50.362660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2837/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:50 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1510 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:51.256351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:51.257229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:51.277742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:51.278335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:51.278848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:51.279716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:51.280265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:51.281242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:51.386075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:51.389846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:51.397534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:51.398293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:51.399354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:51.401401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:51.402047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:51.402898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:51.634429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e17cb04dd32451fa3a46c941fe1ca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '712de07c21e04da39299e7f53a7b6a29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:51.645970 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d3aaf84-aac9-44a1-870c-fa03078053c8 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 200 len: 1503 microversion: 2.1 time: 0.393856 Oct 19 01:21:51.646582 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2953/5790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:51 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 1503 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:51.689210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:51.705246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a778df9b-b536-43c5-b5c4-c9b0fec8aa3c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1516 microversion: 2.1 time: 0.323115 Oct 19 01:21:51.705841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2838/5791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:51 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1516 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:51.995221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d7be14c-49e2-40ad-86f6-9a61798cac0a", "name": "network-vif-deleted", "tag": "048bf7f5-84b9-4ca3-ae87-f295c0efd641"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:52.023158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:52.023654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:52.024302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:52.056324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] Creating event network-vif-deleted:048bf7f5-84b9-4ca3-ae87-f295c0efd641 for instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a on n-h1-master-1 Oct 19 01:21:52.063645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2702ead6-f7b5-41fe-b706-767852eed263 req-84026236-0788-4f99-8dcd-233ce87fea39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077236 Oct 19 01:21:52.064728 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2954/5792] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:52.673158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:52.674345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] [instance: 7d7be14c-49e2-40ad-86f6-9a61798cac0a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:52.680711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:52.680976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:52.681439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:52.682412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:52.682857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:52.683474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:52.699391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] HTTP exception thrown: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Request method failure captured: Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a HTTP/1.1 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1EcaO6uIQb61rMz4csoBVabzSyYATd-LwP6B4N65nmBCuMmsuhj3Ej3saLr_B3VDHQ3rc2TqzNNDdqPuP6SOVzScTq7qPAkNw8ck9yDRywKxRDXeTLXgSJz3ky-7hfiqrN3vLootDq9M_jcq_SfzwrLyoNI615uCxM9n-qWMWywAuA Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 712de07c21e04da39299e7f53a7b6a29 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesActionsTest-1469343925 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_712de07c21e04da39299e7f53a7b6a29", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/712de07c21e04da39299e7f53a7b6a29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/712de07c21e04da39299e7f53a7b6a29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/712de07c21e04da39299e7f53a7b6a29"}]}] Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesActionsTest-1469343925 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 712de07c21e04da39299e7f53a7b6a29 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesActionsTest-1469343925 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesActionsTest-1469343925-project Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 2e17cb04dd32451fa3a46c941fe1ca81 Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesActionsTest-1469343925-project Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '7d7be14c-49e2-40ad-86f6-9a61798cac0a'} Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:21:52.701158 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] Returning 404 to user: Instance 7d7be14c-49e2-40ad-86f6-9a61798cac0a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e075f90-2d77-4f29-b924-99c8c3dde156 tempest-VolumesActionsTest-1469343925 tempest-VolumesActionsTest-1469343925-project] 10.222.0.27 "GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a" status: 404 len: 111 microversion: 2.1 time: 0.035427 Oct 19 01:21:52.705565 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2839/5793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:52 2022] GET /compute/v2.1/servers/7d7be14c-49e2-40ad-86f6-9a61798cac0a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:21:53.137395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33428d81-9535-45ac-aa4d-d76d142d77c2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: .version_select at 0x7f2af42ebdc0>, body: {"keypair": {"name": "tempest-keypair-1862808654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7a2fgmrmf8ARFlLlfLqBDsUtF5R0dcBuTFMZAasbltzNFRqOLqzxzBVChMPIxCPwvfzZa7D1KK5E78OntrVVz4G+pzpEESVDUOBTodQEMLV5WoFhQ/OmM92y02u2ATRA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:53.154319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-33428d81-9535-45ac-aa4d-d76d142d77c2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for project 8226ea08bb744d9c82b105fde33cc332. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:21:53.163970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-33428d81-9535-45ac-aa4d-d76d142d77c2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for user fccb51cb03de4f50a1dd059a30a6c4bb and project 8226ea08bb744d9c82b105fde33cc332. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:21:53.195512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33428d81-9535-45ac-aa4d-d76d142d77c2 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063135 Oct 19 01:21:53.196659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2955/5794] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:21:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:54.657028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-684465853", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d044355b-45b4-439a-9c90-7d8eb9a1c9f3"}], "security_groups": [{"name": "tempest-securitygroup--1364303176"}], "key_name": "tempest-keypair-1862808654", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:54.771805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] validate_networks() for [('d044355b-45b4-439a-9c90-7d8eb9a1c9f3', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:21:55.288462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:21:55.288933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:21:55.289423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:21:55.289844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:21:55.290264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:21:55.299879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:55.300373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:55.300857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:55.301605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:55.302073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:55.302515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:55.320082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:21:55.325365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Getting quotas for user fccb51cb03de4f50a1dd059a30a6c4bb and project 8226ea08bb744d9c82b105fde33cc332. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:21:55.337881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:21:55.340248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:21:55.388929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4e3d186-03a6-4a8a-aec8-5e301bf10978 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.736755 Oct 19 01:21:55.389590 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2840/5795] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:21:54 2022] POST /compute/v2.1/servers => generated 409 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 19 01:21:55.403583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32e7c830-4c0d-48a2-afe7-5edfeb15821c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:55.404387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32e7c830-4c0d-48a2-afe7-5edfeb15821c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:55.469343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-32e7c830-4c0d-48a2-afe7-5edfeb15821c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:55.476693 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32e7c830-4c0d-48a2-afe7-5edfeb15821c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1245 microversion: 2.1 time: 0.079686 Oct 19 01:21:55.481416 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2956/5796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:55 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:56.500241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:56.500930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:56.510245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:56.511052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:56.511490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:56.512281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:56.512779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:56.513432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:56.657030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:56.673241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77905b47-2da0-4a07-b40e-ebe1c22dc943 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1305 microversion: 2.1 time: 0.176929 Oct 19 01:21:56.674479 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2841/5797] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:56 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:57.698592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:57.699457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:57.708894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:57.709630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:57.710153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:57.710989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:57.711526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:57.712139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:57.717426 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:21:57.965309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:57.974178 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a11ae99-d41e-4050-8065-b37be2d2d88a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1371 microversion: 2.1 time: 0.279695 Oct 19 01:21:57.974772 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2957/5798] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:57 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1371 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:21:58.331302 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:21:58.343128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:58.343914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:58.344687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:58.356499 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] Creating event network-changed:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:21:58.362447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-71c1581a-34c5-43d8-b3ed-735ee8469203 req-b515be05-d127-4885-aaf3-98cba8f6e65e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034861 Oct 19 01:21:58.363067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2842/5799] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:21:58.998363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:21:58.999063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:21:59.007438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:59.007865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:59.008313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:59.009053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:21:59.009526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:21:59.009959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:21:59.187620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:21:59.198284 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d8a6cb8-f9b6-486e-b062-ece34c89aa30 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1371 microversion: 2.1 time: 0.204633 Oct 19 01:21:59.199740 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2958/5800] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:21:58 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:00.223670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:00.224393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:00.231156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:00.231687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:00.232977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:00.233783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:00.234249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:00.234685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:00.483608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:00.491902 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fa592112-17dd-4e29-8520-619620818aee tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1371 microversion: 2.1 time: 0.273504 Oct 19 01:22:00.508826 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2843/5801] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:00 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:22:01.516327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:01.516994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:01.525759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:01.526242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:01.526691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:01.527739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:01.528203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:01.528666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:01.670589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:01.678470 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f360831e-b829-44f9-a039-27b608df50d5 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1371 microversion: 2.1 time: 0.166703 Oct 19 01:22:01.679346 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2959/5802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:01 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:22:02.506945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "name": "network-vif-plugged", "status": "completed", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:02.521885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:02.522541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:02.523746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:02.540776 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] Creating event network-vif-plugged:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:22:02.546275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-77c0a825-5b87-473f-90eb-e332c435ae17 req-8833e6cf-8246-4398-a92f-19296e025182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043940 Oct 19 01:22:02.547478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2844/5803] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:02.703636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:02.704911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:02.707809 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:02.713598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:02.713772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:02.714214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:02.714923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:02.715554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:02.716001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:02.852320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:02.861260 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f1a18998-3778-4c29-a940-784a7df593cb tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1371 microversion: 2.1 time: 0.162716 Oct 19 01:22:02.861850 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2960/5804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:02 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:03.885850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:03.886693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:03.894390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:03.894890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:03.895336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:03.896050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:03.896510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:03.897198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:04.044652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:04.054319 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-031ce270-adfb-4132-b4d9-128269d93c51 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1564 microversion: 2.1 time: 0.171927 Oct 19 01:22:04.054319 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2845/5805] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:03 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:04.083554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:04.084255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:04.093331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:04.093940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:04.094488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:04.095306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:04.095869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:04.096419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:04.183392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1bfdef77-6a93-43fe-b9dc-e5f21909edf8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104447 Oct 19 01:22:04.184186 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2961/5806] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:22:04 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:22:05.223697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:05.236525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:05.237044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:05.237486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:05.251111 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] Creating event network-changed:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:22:05.256718 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6ee646a7-2fd9-4712-a766-f2fedbf4c7e0 req-9c6c664f-19dd-4620-98e7-a1fdae5613a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036538 Oct 19 01:22:05.257592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2846/5807] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:20.656498 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:20.658343 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:20.658977 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=27 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:20.663396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-51791460", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "e27441f0-f23b-4d15-a6ed-12795c83d77d"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:20.721957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] validate_networks() for [('e27441f0-f23b-4d15-a6ed-12795c83d77d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:22:21.111747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:22:21.112422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:22:21.112940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:22:21.113500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:22:21.113923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:22:21.124184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:21.124699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:21.125330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:21.126080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:21.126544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:21.126977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:21.160814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Getting quotas for project 6fe9e0a1d4b6422a8edac2ee53988325. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:22:21.166392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Getting quotas for user 52cd177eb1d645b5b802268db525ad9b and project 6fe9e0a1d4b6422a8edac2ee53988325. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:22:21.179262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:22:21.181652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:22:21.228480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b947b438-219e-4557-95a8-aae4cea02a15 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573715 Oct 19 01:22:21.229362 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2962/5808] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:22:21.238344 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:21.239402 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:21.241125 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:21.241792 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:21.246237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-173ec565-c948-4072-bfe0-94e5a01daab0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:21.247449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-173ec565-c948-4072-bfe0-94e5a01daab0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:21.316456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-173ec565-c948-4072-bfe0-94e5a01daab0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:21.324003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-173ec565-c948-4072-bfe0-94e5a01daab0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1212 microversion: 2.1 time: 0.086990 Oct 19 01:22:21.324867 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2847/5809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:21 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1212 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:22.349042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:22.350362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:22.358859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:22.359358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:22.359839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:22.360552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:22.361043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:22.361897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:22.510980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:22.519945 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-56045b5e-c3e9-490f-8917-068707b632e0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1272 microversion: 2.1 time: 0.175047 Oct 19 01:22:22.520696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2963/5810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:22 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:23.543770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:23.544476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:23.552444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:23.553019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:23.553468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:23.554178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:23.554646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:23.555106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:23.671952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:23.680107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee38b4b3-c0c2-4026-9efe-80d73a26dc66 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1270 microversion: 2.1 time: 0.140593 Oct 19 01:22:23.680919 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2848/5811] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:23 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:24.704764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:24.705389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:24.713098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:24.713826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:24.714337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:24.715241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:24.716317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:24.716790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:24.866094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ee7d43-d12e-419c-8f4b-f3e4fca316fb", "tag": "a34aeac2-7648-494a-bd98-371d8482ce1a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:24.885004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:24.887508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:24.889058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:24.906131 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] Creating event network-changed:a34aeac2-7648-494a-bd98-371d8482ce1a for instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb on n-h2-master-1 Oct 19 01:22:24.922843 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-68159285-b325-49f7-b6aa-c0273d384aa6 req-14373768-3fbf-4fd1-8ab4-c806497d7afa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061626 Oct 19 01:22:24.924086 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2849/5812] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:24.937409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:24.945797 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a045284-fd7d-47f2-8c1c-f27221a737f7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.245602 Oct 19 01:22:24.952861 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2964/5813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:24 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:25.970846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:25.971457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:25.977916 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:25.978395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:25.978831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:25.979524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:25.979971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:25.980397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:26.124164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:26.134917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1520c7ce-2610-4444-8f15-ae43ebe9c461 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.169152 Oct 19 01:22:26.135912 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2850/5814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:25 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:27.163606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:27.164368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:27.171602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:27.172100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:27.172547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:27.173281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:27.173745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:27.174184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:27.310963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:27.322173 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-565fb852-351d-45ec-82ff-e8d596ce5244 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.162711 Oct 19 01:22:27.322873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2965/5815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:27 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:28.346278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:28.347996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:28.354946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:28.355442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:28.355895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:28.356805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:28.357912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:28.358368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:28.500295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:28.508195 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a763c33-ee46-434b-a250-87ebff0fbabd tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.165835 Oct 19 01:22:28.508795 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2851/5816] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:28 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:29.533069 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:29.533681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:29.539673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:29.540154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:29.540582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:29.541292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:29.541743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:29.542167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:29.676795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:29.685144 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34375719-7473-4930-a10e-c88a83a2d834 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.157477 Oct 19 01:22:29.685737 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2966/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:29 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:29.942927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee7d43-d12e-419c-8f4b-f3e4fca316fb", "name": "network-vif-plugged", "status": "completed", "tag": "a34aeac2-7648-494a-bd98-371d8482ce1a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:29.957637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:29.958359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:29.958881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:29.971899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] Creating event network-vif-plugged:a34aeac2-7648-494a-bd98-371d8482ce1a for instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb on n-h2-master-1 Oct 19 01:22:29.977823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-42f3e089-1fbe-492e-943c-cec970d3e430 req-c7f1015d-cfc6-4218-bc60-9f0b5fa0e714 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041054 Oct 19 01:22:29.978681 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2852/5818] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:30.708575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:30.709256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:30.717461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:30.717946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:30.718578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:30.719298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:30.719936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:30.720178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:30.858141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:30.865973 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a5ba0c9-3859-4cbf-9426-bae57a8a0160 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1312 microversion: 2.1 time: 0.161392 Oct 19 01:22:30.866561 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2967/5819] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:30 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:31.889570 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:31.894030 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:31.894753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:31.901642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:31.902137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:31.902694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:31.904291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:31.904867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:31.905305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:32.056373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:32.066396 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7001739-e2d1-4fe7-bf83-a9b9acd5c917 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1495 microversion: 2.1 time: 0.179864 Oct 19 01:22:32.067260 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2853/5820] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:31 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1495 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:32.456204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:32.456833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:32.458688 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:32.459389 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:32.466671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:32.467162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:32.467597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:32.468301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:32.468789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:32.469214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:32.495293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:22:32.572912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b79370cb-fdfb-4b41-ac93-f824d943b3c1 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 204 len: 0 microversion: 2.1 time: 0.120491 Oct 19 01:22:32.577610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2968/5821] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:22:32 2022] DELETE /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:32.583065 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:32.583933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:32.590800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:32.591288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:32.591913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:32.592654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:32.593098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:32.593524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:32.722630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:32.731135 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e867e3db-57d2-4965-b952-1307b5a604d2 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1501 microversion: 2.1 time: 0.151839 Oct 19 01:22:32.731760 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2854/5822] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:32 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:33.762152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:33.763765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:33.775536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:33.776031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:33.776716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:33.777824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:33.778278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:33.778695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:33.919982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:33.927953 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-955c6d88-3422-4f16-ac3d-2cbcc1541cba tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1501 microversion: 2.1 time: 0.176730 Oct 19 01:22:33.928546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2969/5823] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:33 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:34.466126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ee7d43-d12e-419c-8f4b-f3e4fca316fb", "name": "network-vif-deleted", "tag": "a34aeac2-7648-494a-bd98-371d8482ce1a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:34.477270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:34.477771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:34.478231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:34.490597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] Creating event network-vif-deleted:a34aeac2-7648-494a-bd98-371d8482ce1a for instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb on n-h2-master-1 Oct 19 01:22:34.495410 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0865ee87-3bba-4da5-bac6-306ebbb25372 req-202b74c6-9cbd-4b9c-b36a-e1373bcac2fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Oct 19 01:22:34.496859 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2855/5824] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:34.951468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:34.952790 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:34.959578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:34.960201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:34.960782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:34.961607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:34.962152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:34.962650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:34.998131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:34.998641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:34.999083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:34.999542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lazy-loading 'fault' on Instance uuid b4ee7d43-d12e-419c-8f4b-f3e4fca316fb {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:22:35.048170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:35.058383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0d86c0f-4772-48da-b293-6c8b3dc4276d tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 200 len: 1302 microversion: 2.1 time: 0.110928 Oct 19 01:22:35.059273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2970/5825] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:34 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 1302 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:36.085242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:36.085949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: b4ee7d43-d12e-419c-8f4b-f3e4fca316fb] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:36.093166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:36.093762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:36.094472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:36.095298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:36.095820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:36.096313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:36.110766 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] HTTP exception thrown: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Request method failure captured: Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb HTTP/1.1 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1FKgBRvy18DR22Ku3rYERSZcyma4aI8RfyBP7rqxJ7KqHls00_zb2BIMAxHwXTAqe1iJwmJNJsv1h1rv1Dv3AARdhE6YsueLViEzHQvB1Fgtz-Er0pNftWVVO_yt8dK6kXq7g6dux32Vq1102RmoAQgmCon2EvCgBAAzfRvqr4GjWo Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6fe9e0a1d4b6422a8edac2ee53988325 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fe9e0a1d4b6422a8edac2ee53988325", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fe9e0a1d4b6422a8edac2ee53988325"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fe9e0a1d4b6422a8edac2ee53988325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fe9e0a1d4b6422a8edac2ee53988325"}]}] Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6fe9e0a1d4b6422a8edac2ee53988325 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesActionsTest-1666369302-project Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 52cd177eb1d645b5b802268db525ad9b Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesActionsTest-1666369302-project Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: exception: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b4ee7d43-d12e-419c-8f4b-f3e4fca316fb'} Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:22:36.112418 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Returning 404 to user: Instance b4ee7d43-d12e-419c-8f4b-f3e4fca316fb could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5403b5f-82f1-4acc-90a6-dce8919cb3a4 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb" status: 404 len: 111 microversion: 2.1 time: 0.034045 Oct 19 01:22:36.126691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2856/5826] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:36 2022] GET /compute/v2.1/servers/b4ee7d43-d12e-419c-8f4b-f3e4fca316fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:22:36.166045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-245394308", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "e27441f0-f23b-4d15-a6ed-12795c83d77d"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:36.222991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] validate_networks() for [('e27441f0-f23b-4d15-a6ed-12795c83d77d', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:22:36.589975 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:22:36.590386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:22:36.590868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:22:36.591287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:22:36.591720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:22:36.600556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:36.601084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:36.601643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:36.602450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:36.602914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:36.603374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:36.621940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Getting quotas for project 6fe9e0a1d4b6422a8edac2ee53988325. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:22:36.627327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Getting quotas for user 52cd177eb1d645b5b802268db525ad9b and project 6fe9e0a1d4b6422a8edac2ee53988325. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:22:36.639914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:22:36.642365 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:22:36.689706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-813afa49-1254-4ff2-a18e-161c245403c7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527578 Oct 19 01:22:36.690589 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2971/5827] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:22:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:22:36.702131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3362ae5-38aa-4964-828d-6b88fcc7d1ad tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:36.709323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3362ae5-38aa-4964-828d-6b88fcc7d1ad tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:36.768983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3362ae5-38aa-4964-828d-6b88fcc7d1ad tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:36.775952 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3362ae5-38aa-4964-828d-6b88fcc7d1ad tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1213 microversion: 2.1 time: 0.077969 Oct 19 01:22:36.776527 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2857/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:36 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:37.801486 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:37.802388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:37.810853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:37.811842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:37.812537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:37.813717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:37.814403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:37.815065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:37.898281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:37.909888 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4ee7145-f123-4415-9738-bc823d990320 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1273 microversion: 2.1 time: 0.113139 Oct 19 01:22:37.910730 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2972/5829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:37 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:38.938965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:38.939666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:38.947966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:38.948744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:38.951588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:38.954092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:38.955044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:38.955044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:39.174610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:39.183049 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffdc6def-8c08-4d22-8bd6-9260395ea92a tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.248004 Oct 19 01:22:39.184711 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2858/5830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:38 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:39.607963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6a023b-fcb2-4e70-b060-a0eec884e460", "tag": "95bdfb82-9ef4-40fc-996c-97eda55a64d7"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:39.630732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:39.631391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:39.632751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:39.655345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] Creating event network-changed:95bdfb82-9ef4-40fc-996c-97eda55a64d7 for instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 on n-h2-master-1 Oct 19 01:22:39.660803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3d521edc-3de2-4d0e-8bd8-2137968dd160 req-5c872350-58f3-4f2c-ad77-dab7c06a1c6f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065791 Oct 19 01:22:39.661618 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2973/5831] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:40.207464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:40.208083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:40.215262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:40.215773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:40.216211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:40.216931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:40.217387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:40.217815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:40.349479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:40.360025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6cee5238-a7a0-47c5-bd08-06a1ca068abf tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.156412 Oct 19 01:22:40.360604 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2859/5832] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:40 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:22:41.390458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:41.391657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:41.398280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:41.398775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:41.399222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:41.399938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:41.400400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:41.400871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:41.550046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:41.557976 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c806026c-e24b-45f6-85cd-607c15d85c67 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.177799 Oct 19 01:22:41.559692 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2974/5833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:41 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:42.583113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:42.583737 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:42.591512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:42.592007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:42.592452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:42.593184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:42.593648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:42.594083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:42.724170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:42.732411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-630beb35-0b37-4d8b-b9e9-906b511a57fb tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.153904 Oct 19 01:22:42.733030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2860/5834] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:42 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:22:43.755531 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:43.756147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:43.764147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:43.764666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:43.765113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:43.765833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:43.766293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:43.766723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:43.899596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:43.911697 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d1ca64d-4032-4e58-9524-0846bc8174ed tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.160135 Oct 19 01:22:43.912301 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2975/5835] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:43 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:44.068600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6a023b-fcb2-4e70-b060-a0eec884e460", "name": "network-vif-plugged", "status": "completed", "tag": "95bdfb82-9ef4-40fc-996c-97eda55a64d7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:44.081535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:44.082181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:44.082680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:44.098332 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] Creating event network-vif-plugged:95bdfb82-9ef4-40fc-996c-97eda55a64d7 for instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 on n-h2-master-1 Oct 19 01:22:44.103556 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8c827caf-350f-4b1a-b7d8-59aa110dcb7e req-13c05e72-558a-4fa2-bc7e-48b9dcbdb359 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038999 Oct 19 01:22:44.104212 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2861/5836] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:44.936293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:44.937115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:44.944352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:44.944945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:44.945466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:44.946248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:44.946780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:44.947307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:45.090793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:45.099573 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d14643a-e15b-45f7-83e4-7422c425a75f tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1313 microversion: 2.1 time: 0.168082 Oct 19 01:22:45.100173 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2976/5837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:44 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:46.124860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:46.125604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:46.131701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:46.132186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:46.132637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:46.133339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:46.133800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:46.134230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:46.333564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:46.351021 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cdcd8d44-1293-4b95-96ec-ba1faa454062 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1497 microversion: 2.1 time: 0.231302 Oct 19 01:22:46.351981 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2862/5838] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:46 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1497 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:46.849344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:46.850480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:46.858240 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:46.859262 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:46.861470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:46.862360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:46.863494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:46.864379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:46.865088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:46.865667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:46.907629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:22:46.942052 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:47.002286 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-227e424c-7098-41b0-a992-3fdae6ce8868 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 204 len: 0 microversion: 2.1 time: 0.156663 Oct 19 01:22:47.003590 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2977/5839] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:22:46 2022] DELETE /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:22:47.012234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:47.013067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:47.015157 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:22:47.021405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:47.021894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:47.022334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:47.023297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:47.023928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:47.024521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:47.222402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:47.233067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc3569e6-543c-4e16-8ed4-1e63922e0db7 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1503 microversion: 2.1 time: 0.225417 Oct 19 01:22:47.234267 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2863/5840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:47 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:48.258371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:48.259703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:48.267877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:48.268688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:48.269130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:48.270316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:48.270316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:48.270698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:48.488495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:48.509606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02faef52-8b74-404b-a799-b34c105a69d0 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1503 microversion: 2.1 time: 0.255585 Oct 19 01:22:48.520608 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2978/5841] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:48 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:48.649057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f8549c-46c9-48b1-b03b-65d5c7a659d6"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:48.654086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:48.673519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:48.674168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:48.677335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:48.678665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:48.685888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:48.686635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:49.185206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5b33970b-eb28-4f44-8163-04b206ae059c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.538387 Oct 19 01:22:49.193049 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2864/5842] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:22:48 2022] POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:49.549838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:49.552451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:49.560825 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6a023b-fcb2-4e70-b060-a0eec884e460", "name": "network-vif-deleted", "tag": "95bdfb82-9ef4-40fc-996c-97eda55a64d7"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:22:49.580909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:49.582159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:49.583276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:49.587133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:49.588219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:49.590394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:49.596218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:49.597093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:49.601131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:49.629049 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] Creating event network-vif-deleted:95bdfb82-9ef4-40fc-996c-97eda55a64d7 for instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 on n-h2-master-1 Oct 19 01:22:49.643544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f09555c3-271b-49a8-9d5f-ec8fffe60a9e req-b70fa1f9-e6b2-4b7b-9a17-97a5fd9f46a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088264 Oct 19 01:22:49.644546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2865/5843] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:22:49.706886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52cd177eb1d645b5b802268db525ad9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe9e0a1d4b6422a8edac2ee53988325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:22:49.717099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fca69527-ef23-42f8-8e69-be137cb06a4b tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 200 len: 1461 microversion: 2.1 time: 0.172075 Oct 19 01:22:49.718190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2979/5844] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:49 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 1461 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:22:50.747244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:22:50.748660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] [instance: 2d6a023b-fcb2-4e70-b060-a0eec884e460] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:22:50.754994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:50.755494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:50.756108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:50.756855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:22:50.757323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:22:50.757758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:22:50.773243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] HTTP exception thrown: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Request method failure captured: Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 HTTP/1.1 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1FKgBRvy18DR22Ku3rYERSZcyma4aI8RfyBP7rqxJ7KqHls00_zb2BIMAxHwXTAqe1iJwmJNJsv1h1rv1Dv3AARdhE6YsueLViEzHQvB1Fgtz-Er0pNftWVVO_yt8dK6kXq7g6dux32Vq1102RmoAQgmCon2EvCgBAAzfRvqr4GjWo Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 6fe9e0a1d4b6422a8edac2ee53988325 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6fe9e0a1d4b6422a8edac2ee53988325", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fe9e0a1d4b6422a8edac2ee53988325"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6fe9e0a1d4b6422a8edac2ee53988325"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6fe9e0a1d4b6422a8edac2ee53988325"}]}] Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 6fe9e0a1d4b6422a8edac2ee53988325 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesActionsTest-1666369302 Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesActionsTest-1666369302-project Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 52cd177eb1d645b5b802268db525ad9b Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesActionsTest-1666369302-project Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2d6a023b-fcb2-4e70-b060-a0eec884e460'} Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:22:50.775317 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] Returning 404 to user: Instance 2d6a023b-fcb2-4e70-b060-a0eec884e460 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:22:50.783566 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ed19f14a-e5d0-492f-8d85-da85f5023110 tempest-VolumesActionsTest-1666369302 tempest-VolumesActionsTest-1666369302-project] 10.222.0.27 "GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460" status: 404 len: 111 microversion: 2.1 time: 0.037428 Oct 19 01:22:50.790562 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2866/5845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:22:50 2022] GET /compute/v2.1/servers/2d6a023b-fcb2-4e70-b060-a0eec884e460 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:23:01.443984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:23:01.447628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:01.455509 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:01.457843 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=16,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:01.459556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:01.461149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:01.461842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:01.462765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:01.463453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:01.464997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:01.508559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'flavor' on Instance uuid 824cf8c6-e083-46e3-a0eb-585df88c7048 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:23:01.718645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0915e933-7f09-467a-bcc9-920d82c027b1 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/action" status: 200 len: 32 microversion: 2.1 time: 0.280286 Oct 19 01:23:01.724270 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2980/5846] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:23:01 2022] POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:23:01.732636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:01.733478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:01.755059 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=44 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:01.756070 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:23:01.758348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:01.765515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:01.765983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:01.767233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:01.768104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:01.768701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:02.064495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:02.076977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-396d4531-8d70-419f-b7b4-7834b6b6d901 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.351124 Oct 19 01:23:02.077580 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2867/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:01 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:03.106025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:03.106922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:03.120924 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:03.121421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:03.133385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:03.134459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:03.135099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:03.135728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:03.348669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:03.358208 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e36f5e92-e7ec-45ca-afa1-2ca9963cd4d7 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.257282 Oct 19 01:23:03.375918 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2981/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:03 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:04.390246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:04.391575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:04.408254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:04.408788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:04.409891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:04.410619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:04.411093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:04.411536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:04.616723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:04.635857 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d382e487-e5df-4729-9e4b-05638b842ef9 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.251560 Oct 19 01:23:04.636494 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2868/5849] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:04 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:05.664009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:05.665224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:05.677888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:05.680595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:05.681092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:05.681831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:05.682861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:05.683304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:05.935505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:05.947365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03c68399-a81d-4cca-9d21-4edb41398f46 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.287225 Oct 19 01:23:05.982033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2982/5850] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:05 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:06.982981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:06.983645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:07.002348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:07.003950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:07.004416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:07.007068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:07.010609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:07.012348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:07.253368 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:07.267975 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0abb818c-f993-4130-a8e6-021e8cf7c79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.292172 Oct 19 01:23:07.269606 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2869/5851] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:06 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:23:08.295416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:08.296242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:08.325196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:08.327163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:08.328679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:08.332795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:08.333607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:08.334224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:08.744353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:08.759395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40559be4-ad2b-44dc-bcb2-f71d95273d62 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.468093 Oct 19 01:23:08.764565 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2983/5852] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:08 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:09.792257 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:09.793533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:09.803104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:09.803898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:09.804571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:09.805705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:09.806353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:09.807538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:10.201621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:10.226568 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a444c901-d877-46c6-9e16-d4bc07a5ae1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.438778 Oct 19 01:23:10.227291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2870/5853] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:09 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:11.252040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:11.252665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:11.267057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:11.267565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:11.268011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:11.268914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:11.269375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:11.269804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:11.749147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:11.779943 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-230ce6ee-7f4e-4fc5-9fdf-9c5efbc0023d tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.531758 Oct 19 01:23:11.795329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2984/5854] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:11 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:12.821946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:12.824135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:12.860815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:12.861609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:12.862245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:12.863142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:12.863762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:12.864352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:13.160581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:13.170565 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a9a2915-c34a-42ff-9d0e-61bc89fa7a6a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.354404 Oct 19 01:23:13.185641 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2871/5855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:12 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:14.198455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:14.199336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:14.207563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:14.208380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:14.209126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:14.210247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:14.210889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:14.211504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:14.483864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:14.492715 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e4ca425-0b1e-4f64-bf0e-65ab41265ba8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.300007 Oct 19 01:23:14.493401 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2985/5856] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:14 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:15.517316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:15.517860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:15.524788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:15.525274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:15.526404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:15.527110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:15.527567 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:15.527995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:15.768223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:15.777320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da2cad51-6238-4743-90e8-c81401b60551 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.264006 Oct 19 01:23:15.777920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2872/5857] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:15 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:16.800924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:16.802260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:16.810835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:16.811609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:16.812235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:16.813167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:16.813789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:16.814388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:17.342987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:17.353461 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64be7f40-b968-44de-a4d5-3a5efd0f2417 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.556454 Oct 19 01:23:17.354349 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2986/5858] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:16 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:18.378996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:18.380345 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:18.392484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:18.393093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:18.393545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:18.394927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:18.394927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:18.395215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:18.571059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:18.581254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd690692-d99e-4839-817e-cf7412c86d08 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.207566 Oct 19 01:23:18.582245 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2873/5859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:18 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:19.607611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:19.608425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:19.621123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:19.621628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:19.622081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:19.622811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:19.623279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:19.623714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:19.957817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:19.969928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa4791cd-e512-46e5-b873-285cdd30bf26 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.366409 Oct 19 01:23:19.971083 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2987/5860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:19 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:20.997535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:20.998730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:21.006103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:21.006915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:21.007951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:21.009257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:21.010128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:21.011022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:21.192726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:21.204156 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ae27ad7-3fc6-477c-8dec-586d09b5a341 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1734 microversion: 2.1 time: 0.212314 Oct 19 01:23:21.205417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2874/5861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:20 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:22.228037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:22.229323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:22.245726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.246290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.246839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:22.247630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.248149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.248816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:22.543218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:22.563022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5792e579-6056-4547-b6aa-2445eabfa474 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1714 microversion: 2.1 time: 0.338952 Oct 19 01:23:22.563542 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2988/5862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:22 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1714 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:22.789769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:22.790268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:22.797637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.798733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.799425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:22.800375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.801130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.801813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:22.912162 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Cannot 'detach_volume' instance 824cf8c6-e083-46e3-a0eb-585df88c7048 while it is in vm_state rescued Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments/d3f8549c-46c9-48b1-b03b-65d5c7a659d6 HTTP/1.1 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'detach_volume' instance 824cf8c6-e083-46e3-a0eb-585df88c7048 while it is in vm_state rescued Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '824cf8c6-e083-46e3-a0eb-585df88c7048', 'id': 'd3f8549c-46c9-48b1-b03b-65d5c7a659d6'} Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 824cf8c6-e083-46e3-a0eb-585df88c7048 while it is in vm_state rescued Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:23:22.914051 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 824cf8c6-e083-46e3-a0eb-585df88c7048 while it is in vm_state rescued Oct 19 01:23:22.918516 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:23:22.920025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 409 to user: Cannot 'detach_volume' instance 824cf8c6-e083-46e3-a0eb-585df88c7048 while it is in vm_state rescued {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:23:22.920991 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-665d18e7-a826-451b-abb2-6f2102d69b57 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments/d3f8549c-46c9-48b1-b03b-65d5c7a659d6" status: 409 len: 152 microversion: 2.1 time: 0.135470 Oct 19 01:23:22.922191 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2875/5863] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:23:22 2022] DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments/d3f8549c-46c9-48b1-b03b-65d5c7a659d6 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:23:22.930685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:23:22.931841 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:22.939105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.939492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.939940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:22.940669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:22.941167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:22.941537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:23.067125 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1829786e-7abd-4fdc-9106-3007b831f1dc tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/action" status: 202 len: 0 microversion: 2.1 time: 0.140073 Oct 19 01:23:23.068918 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2989/5864] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:23:22 2022] POST /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:23:23.079619 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:23.080679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:23.105443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:23.106424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:23.107061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:23.107776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:23.108242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:23.108773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:23.549151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:23.559681 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-164bc42d-5f58-4e5d-920a-5f2b08c18720 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1722 microversion: 2.1 time: 0.484587 Oct 19 01:23:23.573222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2876/5865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:23 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:24.589494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:24.591728 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:24.606713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:24.607690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:24.608516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:24.609496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:24.610161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:24.610987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:24.944302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:24.954192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39575a12-ef43-4200-81c8-966cb3c07d1e tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1722 microversion: 2.1 time: 0.372874 Oct 19 01:23:24.954782 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2990/5866] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:24 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:25.986822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:25.986822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:25.995064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:25.995843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:25.996523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:25.997481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:25.998041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:25.998708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:26.373833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:26.384968 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-698b251b-498f-4c7c-9ca8-2db58a774c63 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1722 microversion: 2.1 time: 0.402966 Oct 19 01:23:26.385674 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2877/5867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:25 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:27.413282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:27.414897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:27.427323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:27.428273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:27.429089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:27.430441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:27.431169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:27.432401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:27.622515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:23:27.632210 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94bdd193-c10e-43d9-bfde-d4ef42c73ece tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1728 microversion: 2.1 time: 0.224626 Oct 19 01:23:27.633348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2991/5868] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:23:27 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1728 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:23:27.657189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:23:27.658427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:23:27.665225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:27.665958 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:27.666570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:27.667452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:27.668076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:27.668764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:27.766196 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64fe901c-7e3e-407f-8272-e4d52bad9566 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113352 Oct 19 01:23:27.780566 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2878/5869] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:23:27 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:23:28.957517 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:23:28.980780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:28.981272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:28.981709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:28.997541 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] Creating event network-changed:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:23:29.007250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-25334f22-7871-4b06-b55f-cbbaa2aaf244 req-d014b427-3c6c-4cb2-8a15-d3e5981e9b59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052459 Oct 19 01:23:29.008433 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2992/5870] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:23:31.029108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:23:31.049134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:23:31.052676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:23:31.053403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:23:31.090760 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] Creating event network-changed:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:23:31.100067 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9caaaa16-6e25-4056-96fa-0d6b8587a9d5 req-6acd6e8e-2423-47aa-9b91-c6212a0a3f05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077405 Oct 19 01:23:31.105742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2879/5871] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:01.446819 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=26 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:01.447944 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:01.454472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:01.455089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:01.472797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:01.473503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:01.474119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:01.475040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:01.479789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:01.480489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:01.667378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'services' on Instance uuid 824cf8c6-e083-46e3-a0eb-585df88c7048 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:24:01.783014 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79738151-5e5f-4596-8df1-94b60d52ad72 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments/d3f8549c-46c9-48b1-b03b-65d5c7a659d6" status: 202 len: 0 microversion: 2.1 time: 0.338072 Oct 19 01:24:01.784200 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2993/5872] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:24:01 2022] DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments/d3f8549c-46c9-48b1-b03b-65d5c7a659d6 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:24:01.804378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:01.807011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:01.833843 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=26 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:01.837102 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=72 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:01.848302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:01.850919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:01.852179 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:01.856674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:01.857956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:01.858586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:01.911407 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad99d379-8bf4-49a7-af3c-09d1179a47ed tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121425 Oct 19 01:24:01.917247 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2880/5873] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:01 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:02.925025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:02.929095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:02.951473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:02.952052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:02.954339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:02.955099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:02.957137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:02.959760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:03.034816 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c05ceb01-efd7-4d05-a2e3-843bd168d79c tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114394 Oct 19 01:24:03.053009 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2994/5874] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:02 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:04.053634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:04.056484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:04.077018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:04.077525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:04.077973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:04.078702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:04.079169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:04.079609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:04.165926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-807c3fec-dc41-4e1d-b6a6-acf6c4ca7936 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121436 Oct 19 01:24:04.177001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2881/5875] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:04 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:05.179369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:05.182577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:05.196890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:05.200159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:05.201376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:05.202496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:05.203171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:05.203838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:05.283154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7230b1a8-b040-4d78-851e-bb51d0d38e16 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108095 Oct 19 01:24:05.284423 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2995/5876] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:05 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:06.297238 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:06.299724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:06.308582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:06.309113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:06.309562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:06.310280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:06.310745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:06.311185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:06.354611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cef47633-b302-4566-b20f-496eb5237794 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061834 Oct 19 01:24:06.355554 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2882/5877] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:06 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:07.368446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:07.371119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:07.387801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:07.388403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:07.388952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:07.389746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:07.390275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:07.397178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:07.439558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e0233eb-6a4b-4ebb-9e27-8a5ecc93ac75 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076100 Oct 19 01:24:07.440388 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2996/5878] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:07 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:08.451499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:08.453858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:08.461119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.461828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.462662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.463388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.463858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.464295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.495555 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-852fe4fd-4d4e-458d-b82c-686a0de8f7bd tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048094 Oct 19 01:24:08.496339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2883/5879] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:24:08 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:24:08.576987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:08.579490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:08.587100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.587881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.588395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.589150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.589609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.590043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Cannot 'reboot' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action HTTP/1.1 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 28 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: {"reboot": {"type": "HARD"}} Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: exception: Cannot 'reboot' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '387b0977-337c-436e-8ce5-61e6b37a82fc', 'body': {'reboot': {'type': 'HARD'}}} Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 19 01:24:08.620679 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 409 to user: Cannot 'reboot' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:24:08.625898 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2c94ab7e-dee0-48e8-8386-8c0beb362760 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action" status: 409 len: 145 microversion: 2.1 time: 0.048711 Oct 19 01:24:08.627155 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2997/5880] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:24:08 2022] POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action => generated 145 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:24:08.636311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:08.639648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:08.645942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.646521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.647558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.647810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.649630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.650138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.680601 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Cannot 'rebuild' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action HTTP/1.1 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 65 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: exception: Cannot 'rebuild' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '387b0977-337c-436e-8ce5-61e6b37a82fc', 'body': {'rebuild': {'imageRef': '8df5ee37-9b8e-48da-9f04-6c7fec506340'}}} Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:24:08.682550 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 409 to user: Cannot 'rebuild' instance 387b0977-337c-436e-8ce5-61e6b37a82fc while it is in vm_state rescued {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c74e8dc-4c38-497d-8959-bbaa21395c22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action" status: 409 len: 146 microversion: 2.1 time: 0.055960 Oct 19 01:24:08.686684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2884/5881] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:24:08 2022] POST /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc/action => generated 146 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 19 01:24:08.693768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:08.694278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:08.701010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.701749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.702366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.703239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.703857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.704466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.734177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:24:08.827016 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a1d7324c-08e6-43bc-b65c-d2d0f060ffce tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 204 len: 0 microversion: 2.1 time: 0.136700 Oct 19 01:24:08.828320 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2998/5882] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:24:08 2022] DELETE /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:24:08.837881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:08.838505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:08.846023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.846722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.847238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:08.847909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:08.848374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:08.848854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:09.332042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:09.341189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb57b9f2-3bc2-4870-a8a9-e5034e7f7f97 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1688 microversion: 2.1 time: 0.508115 Oct 19 01:24:09.354266 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2885/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:08 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1688 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:10.366627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:10.368254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:10.376764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:10.377530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:10.378543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:10.380359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:10.381970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:10.400032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:10.757257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:10.769333 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85195533-05e9-4ab3-9ae4-66808b7be61b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1688 microversion: 2.1 time: 0.406284 Oct 19 01:24:10.770519 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 2999/5884] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:10 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:11.794484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:11.795177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:11.807856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:11.807992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:11.808516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:11.809098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:11.821378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:11.821853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:12.024827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:12.042490 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-855907ed-ae24-4ac7-9eb9-975b4347c6f8 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1688 microversion: 2.1 time: 0.252250 Oct 19 01:24:12.058067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2886/5885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:11 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1688 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:13.068331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:13.069139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:13.085085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:13.085619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:13.094188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:13.097368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:13.118834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:13.119518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:13.842918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:13.851942 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-040dc621-5600-4f5f-809a-7917c8906f22 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1688 microversion: 2.1 time: 0.787385 Oct 19 01:24:13.852533 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3000/5886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:13 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1688 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:14.671604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824cf8c6-e083-46e3-a0eb-585df88c7048", "name": "network-vif-deleted", "tag": "35223d4b-ac61-444b-b06f-ba2b9c69671d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:14.685883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:14.686736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:14.688108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:14.702035 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] Creating event network-vif-deleted:35223d4b-ac61-444b-b06f-ba2b9c69671d for instance 824cf8c6-e083-46e3-a0eb-585df88c7048 on n-h1-master-1 Oct 19 01:24:14.711741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1a55d5bc-7b8a-4d64-8947-3bdbe791e03b req-c8123dae-848d-4805-aacc-7a9ca04518f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042629 Oct 19 01:24:14.716418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2887/5887] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:14.876065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:14.877431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:14.894761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:14.895307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:14.896007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:14.897439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:14.897992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:14.898576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:14.974653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:14.975163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:14.980019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:14.980797 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'fault' on Instance uuid 824cf8c6-e083-46e3-a0eb-585df88c7048 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:24:15.061682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:15.070749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9949a962-443d-45cd-ae32-84c0e6d68bde tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 200 len: 1335 microversion: 2.1 time: 0.198554 Oct 19 01:24:15.071986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3001/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:14 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 1335 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:16.099904 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:16.100876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 824cf8c6-e083-46e3-a0eb-585df88c7048] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:16.108339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:16.108988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:16.109532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:16.110348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:16.110904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:16.111431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:16.127955 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 HTTP/1.1 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '824cf8c6-e083-46e3-a0eb-585df88c7048'} Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:16.129822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:24:16.135359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 404 to user: Instance 824cf8c6-e083-46e3-a0eb-585df88c7048 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:24:16.137745 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e20ffef2-48f5-40ea-839b-1df4070cb116 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048" status: 404 len: 111 microversion: 2.1 time: 0.043908 Oct 19 01:24:16.138461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2888/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:16 2022] GET /compute/v2.1/servers/824cf8c6-e083-46e3-a0eb-585df88c7048 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:24:16.150994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00bdcc83-e098-4c03-9aa8-bf92e8cb7c96 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '.version_select at 0x7f2aefd54670>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:16.187228 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00bdcc83-e098-4c03-9aa8-bf92e8cb7c96 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862808654" status: 202 len: 0 microversion: 2.1 time: 0.041381 Oct 19 01:24:16.187790 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3002/5890] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862808654 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:24:24.072640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:24.073669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:24.076736 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:24:24.077079 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:24:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc (ip 10.222.0.27) !!! Oct 19 01:24:24.085891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:24.086596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:24.087229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:24.088097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:24.088736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:24.089352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:24.120876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:24:24.218850 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77708071-eaa6-4b86-bfdb-567e50cf23ac tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 204 len: 0 microversion: 2.1 time: 0.149531 Oct 19 01:24:24.219650 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2889/5891] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:24:24 2022] DELETE /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:24:24.229920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:24.230547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:24.237819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:24.238592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:24.239233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:24.240212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:24.240877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:24.241506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:24.402895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:24.411603 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55992d54-8334-4d7a-98f3-f6274717d1de tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1506 microversion: 2.1 time: 0.187467 Oct 19 01:24:24.412205 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3003/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:24 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:25.437017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:25.437735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:25.445907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:25.446403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:25.447038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:25.447756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:25.448218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:25.448674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:25.607621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:25.616083 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d78c9831-2f27-4d71-91d5-16d3d578d58b tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1506 microversion: 2.1 time: 0.183665 Oct 19 01:24:25.616830 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2890/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:25 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:26.640323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:26.641663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:26.651945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:26.652778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:26.653473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:26.654608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:26.655900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:26.656650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:26.881096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:26.890067 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d9de33a-8494-447d-aeb4-3bfbd6b96f09 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 200 len: 1506 microversion: 2.1 time: 0.253863 Oct 19 01:24:26.890784 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3004/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:26 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:27.002233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "387b0977-337c-436e-8ce5-61e6b37a82fc", "name": "network-vif-deleted", "tag": "e57b7b2f-7287-4991-8517-5c2b71efaa00"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:27.021685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:27.023167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:27.023974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:27.042300 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] Creating event network-vif-deleted:e57b7b2f-7287-4991-8517-5c2b71efaa00 for instance 387b0977-337c-436e-8ce5-61e6b37a82fc on n-h2-master-1 Oct 19 01:24:27.048942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-13882c32-d338-434d-8d4d-951d0333c66e req-5888c27a-aaee-4a5c-b6eb-2e0814f29065 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051478 Oct 19 01:24:27.068241 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2891/5895] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:27.914054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:27.914964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 387b0977-337c-436e-8ce5-61e6b37a82fc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:27.922411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:27.922928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:27.923574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:27.924308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:27.924964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:27.925397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:27.941713 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc HTTP/1.1 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '387b0977-337c-436e-8ce5-61e6b37a82fc'} Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:27.943578 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 404 to user: Instance 387b0977-337c-436e-8ce5-61e6b37a82fc could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-465a0002-47e5-4b48-bd78-633b5e84ca87 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc" status: 404 len: 111 microversion: 2.1 time: 0.036091 Oct 19 01:24:27.948731 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3005/5896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:27 2022] GET /compute/v2.1/servers/387b0977-337c-436e-8ce5-61e6b37a82fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:24:27.955420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:27.956069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:27.967229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:27.967691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:27.968419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:27.969207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:27.969853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:27.970289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:28.009722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:24:28.160528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffbc1293-0e2a-459e-8a4e-35c6820fdc95 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 204 len: 0 microversion: 2.1 time: 0.208907 Oct 19 01:24:28.161691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2892/5897] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:24:27 2022] DELETE /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:24:28.171681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:28.172561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:28.179423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:28.179909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:28.180345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:28.181079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:28.181531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:28.181955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:28.325464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:28.334390 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d2ff9e7-39d1-4eed-9917-a2ac69dd6208 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.167907 Oct 19 01:24:28.335153 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3006/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:28 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:24:29.358290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:29.359012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:29.366853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:29.367558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:29.367977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:29.368752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:29.369221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:29.369658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:29.523496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:29.531433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-34f93e5e-e3ff-46cc-993c-2cf477ecbb4a tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.177492 Oct 19 01:24:29.532110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2893/5899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:29 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:30.555796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:30.557256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:30.565046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:30.565710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:30.566220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:30.567011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:30.567595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:30.568130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:30.713397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:30.721525 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-085e777b-179b-4f66-801a-8e30a5c28d83 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.169893 Oct 19 01:24:30.722116 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3007/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:30 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:31.745429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:31.746248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:31.753360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:31.754151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:31.754549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:31.755326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:31.755853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:31.756655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:31.915872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:31.918582 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:31.927552 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec676667-2a5c-4dd3-80ba-0e4f0812eaab tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1522 microversion: 2.1 time: 0.186675 Oct 19 01:24:31.932011 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2894/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:31 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:32.559046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af33025-a546-4db9-984f-99e971603f88", "name": "network-vif-deleted", "tag": "0c1a9a6b-8d2e-4056-a580-4e8c64f1d636"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:32.566777 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:32.571522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:32.572035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:32.572731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:32.584007 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:32.601162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] Creating event network-vif-deleted:0c1a9a6b-8d2e-4056-a580-4e8c64f1d636 for instance 0af33025-a546-4db9-984f-99e971603f88 on n-h1-master-1 Oct 19 01:24:32.607176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8da3dc24-8ca3-4136-bb8c-bc69811965a6 req-dfab7c66-faa0-4756-8af6-bba52bb84abc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053420 Oct 19 01:24:32.609006 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3008/5902] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:32.954631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:32.955448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:32.965177 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:32.967353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:32.967970 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:32.968525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:32.969376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:32.970571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:32.971266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:33.024093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:33.024787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:33.025464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:33.026089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lazy-loading 'fault' on Instance uuid 0af33025-a546-4db9-984f-99e971603f88 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:24:33.074840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fccb51cb03de4f50a1dd059a30a6c4bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8226ea08bb744d9c82b105fde33cc332', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:33.084106 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-301d04d5-2c9b-4d40-a1cf-bb35e742b999 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 200 len: 1312 microversion: 2.1 time: 0.136281 Oct 19 01:24:33.105206 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2895/5903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:32 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 1312 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:34.118242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:34.119835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] [instance: 0af33025-a546-4db9-984f-99e971603f88] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:34.132338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:34.133027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:34.133646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:34.134359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:34.134986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:34.135412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:34.155326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] HTTP exception thrown: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Request method failure captured: Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 HTTP/1.1 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1DWWMWEzKyKDkyI6arn5cQhK85WLMsP9hO4ZNO7UsTFHdH31FZ4AzS5ZHGLPZMq3qD0ZwGaROeV6pCKX14c-8zv7y9LqEYiSdY5ulRCL59rzdS6KZghnXrFsTTq466deihGt6DbRd3gFA_9g-aoCUKzGEEtJJFVH9Ee_o1TcwjxjHg Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8226ea08bb744d9c82b105fde33cc332", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8226ea08bb744d9c82b105fde33cc332"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8226ea08bb744d9c82b105fde33cc332"}]}] Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8226ea08bb744d9c82b105fde33cc332 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-997674386 Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fccb51cb03de4f50a1dd059a30a6c4bb Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerRescueNegativeTestJSON-997674386-project Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '0af33025-a546-4db9-984f-99e971603f88'} Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:34.157463 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. Oct 19 01:24:34.161758 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:24:34.163770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] Returning 404 to user: Instance 0af33025-a546-4db9-984f-99e971603f88 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:24:34.164943 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29c8833f-0841-4f5b-93ea-7fd00b0a83d3 tempest-ServerRescueNegativeTestJSON-997674386 tempest-ServerRescueNegativeTestJSON-997674386-project] 10.222.0.27 "GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88" status: 404 len: 111 microversion: 2.1 time: 0.051560 Oct 19 01:24:34.170239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3009/5904] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:34 2022] GET /compute/v2.1/servers/0af33025-a546-4db9-984f-99e971603f88 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:24:39.769884 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-606605400", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:39.834799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:24:39.835268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:24:39.835753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:24:39.836359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:24:39.836846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:24:39.845940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:39.846389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:39.846946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:39.847545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:39.848003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:39.848436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:39.868160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Getting quotas for project b78f9f6c05124b8ebf03595244c9320c. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:24:39.874675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Getting quotas for user 9885f8a436684a0392e63b784cbe84fd and project b78f9f6c05124b8ebf03595244c9320c. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:24:39.890263 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:24:39.892664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:24:39.943565 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cd49cf65-8574-4199-894c-14a275585a51 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.326956 Oct 19 01:24:39.944646 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2896/5905] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 01:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 329 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:24:39.955478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:39.956552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:40.031674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.040608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.042249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.043994 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80b8cd41-dd5a-468f-b7a0-83893f55e691 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 200 len: 1277 microversion: 2.47 time: 0.091886 Oct 19 01:24:40.044851 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3010/5906] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:39 2022] GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:24:40.126627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1171129608", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": "none"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:40.199418 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:24:40.199858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:24:40.200356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:24:40.200865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:24:40.201656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:24:40.212828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:40.213333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:40.213830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:40.215374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:40.216160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:40.216804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:40.252123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Getting quotas for project b78f9f6c05124b8ebf03595244c9320c. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:24:40.258683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Getting quotas for user 9885f8a436684a0392e63b784cbe84fd and project b78f9f6c05124b8ebf03595244c9320c. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:24:40.276479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:24:40.280226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:24:40.338752 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fdf54155-c219-47c5-bc8f-a0905d5af79f tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.215726 Oct 19 01:24:40.347148 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2897/5907] 10.222.0.27 () {62 vars in 1188 bytes} [Wed Oct 19 01:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 19 01:24:40.352825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d3f20dc-01f0-4a0d-96f6-8670b0662d02 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:40.355579 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0d3f20dc-01f0-4a0d-96f6-8670b0662d02 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:40.478143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d3f20dc-01f0-4a0d-96f6-8670b0662d02 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "PUT /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 992 microversion: 2.47 time: 0.129586 Oct 19 01:24:40.478753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3011/5908] 10.222.0.27 () {62 vars in 1297 bytes} [Wed Oct 19 01:24:40 2022] PUT /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 992 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 01:24:40.500591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:40.509218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:40.590326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.602271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.604570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:40.607418 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-392d27eb-753f-4dcf-b301-aa1f9dcbb1da tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1278 microversion: 2.47 time: 0.111961 Oct 19 01:24:40.608787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2898/5909] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:40 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:41.637832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:41.638516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:41.647221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:41.647983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:41.648434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:41.649239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:41.649714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:41.650150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:41.734845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:41.748382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:41.750280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:41.752116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e0a2da3-393e-4960-aba4-80436bd66953 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1274 microversion: 2.47 time: 0.118237 Oct 19 01:24:41.753438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3012/5910] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:41 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:42.781220 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:42.781855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:42.792692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:42.793171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:42.793623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:42.794349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:42.794879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:42.795235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:42.876434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:42.887215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:42.888768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:42.889995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb024094-4b97-4c59-9557-4da1df3d6932 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1338 microversion: 2.47 time: 0.113090 Oct 19 01:24:42.890786 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2899/5911] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:42 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:43.616663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1235994698", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1e82c6e9-2f0f-4709-9fff-50c8cce4b112"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:43.680020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] validate_networks() for [('1e82c6e9-2f0f-4709-9fff-50c8cce4b112', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:24:43.918942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:43.919559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:43.928080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:43.928706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:43.929357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:43.930232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:43.930847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:43.931432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:44.011650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:44.022739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:44.024195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:44.025386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0debcb47-ba50-46a7-aa2e-d31d17b08f7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1336 microversion: 2.47 time: 0.110403 Oct 19 01:24:44.026152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2900/5912] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:43 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:24:44.197047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:24:44.197821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:24:44.198381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:24:44.198869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:24:44.199360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:24:44.208398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:44.209987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:44.210512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:44.211741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:44.212213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:44.212667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:44.229886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Getting quotas for project 568de9170fba47f09ef0d3cfdc9b34df. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:24:44.235528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Getting quotas for user 25a73a5fe5644dac874ce5d3e2558566 and project 568de9170fba47f09ef0d3cfdc9b34df. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:24:44.248717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:24:44.251071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:24:44.301667 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-347addbb-758f-40c3-884d-727f080e17e0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688950 Oct 19 01:24:44.302450 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3013/5913] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:24:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:24:44.318069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-433b84a9-1641-402f-be32-4babbc3444c7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:44.319438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-433b84a9-1641-402f-be32-4babbc3444c7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:44.385611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-433b84a9-1641-402f-be32-4babbc3444c7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:44.395929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-433b84a9-1641-402f-be32-4babbc3444c7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1219 microversion: 2.1 time: 0.084392 Oct 19 01:24:44.397407 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2901/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:44 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:45.052210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:45.053142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:45.063884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:45.065366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:45.066038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:45.066991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:45.077889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:45.078762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:45.156091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:45.167387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:45.169589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:45.171238 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec8bce99-3807-4b57-8710-355c5b439e2c tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1336 microversion: 2.47 time: 0.123199 Oct 19 01:24:45.177129 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3014/5915] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:45 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1336 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:45.420771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:45.422003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:45.431302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:45.431902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:45.432823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:45.433712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:45.434337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:45.435045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:45.518710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:45.529333 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81662118-4a5c-4f3b-80d3-0d93500d76f4 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1271 microversion: 2.1 time: 0.113779 Oct 19 01:24:45.530579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2902/5916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:45 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1271 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:46.200659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:46.201291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:46.207790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:46.208274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:46.210296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:46.211027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:46.211792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:46.212388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:46.317932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:46.328443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:46.330351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:46.331606 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-602c064f-5ff0-4593-844a-37c7fc7b7c18 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1336 microversion: 2.47 time: 0.135300 Oct 19 01:24:46.332560 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3015/5917] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:46 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1336 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:24:46.556528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:46.557348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:46.564738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:46.565420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:46.565937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:46.566993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:46.567503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:46.567943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:46.780382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:46.789060 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e7676c8-5862-4948-bf03-2ceb38709491 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.237527 Oct 19 01:24:46.789793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2903/5918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:46 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:47.128759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e3160b-4442-46db-8fe2-1efcab573448", "tag": "5e8de3ee-efdb-4294-96fe-4a4f8e778906"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:47.142794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.143405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.143852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.156158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] Creating event network-changed:5e8de3ee-efdb-4294-96fe-4a4f8e778906 for instance e2e3160b-4442-46db-8fe2-1efcab573448 on n-h2-master-1 Oct 19 01:24:47.162516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-635b8b53-fb73-44e5-8e60-9f4a572fcac2 req-f0d61a51-8e2c-4100-80cc-5ef2f472abd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037820 Oct 19 01:24:47.163923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3016/5919] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:47.358447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:47.359362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:47.367786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.368281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.368746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.369483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.369945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.370376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.450535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.460549 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.462044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.463233 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dfb6e55a-0cf5-451b-94f5-c65b2ddb3740 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1357 microversion: 2.47 time: 0.108720 Oct 19 01:24:47.463809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2904/5920] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:47 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:47.489432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:47.493861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:47.509901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.510502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.511083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.511926 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.512451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.512973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.604263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:24:47.604732 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:24:47.605215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:24:47.605629 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:24:47.606046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:24:47.667123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:47.673059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.673550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.673988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.674710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.675352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.675820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.709681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d46da75-d1bc-4bfc-b33e-c3211ce6350e tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "POST /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a/action" status: 202 len: 1079 microversion: 2.47 time: 0.223930 Oct 19 01:24:47.710341 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3017/5921] 10.222.0.27 () {62 vars in 1319 bytes} [Wed Oct 19 01:24:47 2022] POST /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a/action => generated 1079 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 19 01:24:47.736981 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:47.738053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:47.748184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.748709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.749181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.749881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.750349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.750783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.813327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:47.815573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:47.828658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.831326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.831904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.832772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:47.835049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:47.835854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:47.841363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.852971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.856037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:47.864386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9778315c-c391-49b9-a6c5-2ab211086b1a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.134647 Oct 19 01:24:47.865964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2905/5922] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:47 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:48.044132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:48.054231 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-688ebb46-5da7-441d-a2e0-d5de8b9df43f tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.245737 Oct 19 01:24:48.057624 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3018/5923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:47 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:48.894952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:48.895866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:48.904206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:48.904763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:48.905409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:48.906433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:48.907077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:48.907522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:49.081048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:49.082766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:49.107437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:49.108173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:49.108952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:49.109993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:49.111544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:49.112243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:49.188645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:49.199217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:49.201140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:49.202547 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df572c5b-1bb6-4857-89d4-7dee5c073c13 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.311724 Oct 19 01:24:49.203126 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2906/5924] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:48 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:24:49.354243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:49.375313 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3bee3217-4c74-442a-9a64-d33d6931c350 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.299419 Oct 19 01:24:49.376239 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3019/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:49 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:50.230093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:50.230732 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:50.237852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:50.238341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:50.238778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:50.239480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:50.240473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:50.241108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:50.245128 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:50.304675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:50.312887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:50.314328 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:50.315491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-58f92e0b-8d58-4e4c-a127-5d10846d4f91 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.089540 Oct 19 01:24:50.316057 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2907/5926] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:50 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:50.400809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:50.401427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:50.408221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:50.408744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:50.409182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:50.409873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:50.410324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:50.410747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:50.561719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:50.573925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cffc508f-a441-49dc-95eb-d887f43362ea tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.176888 Oct 19 01:24:50.574742 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3020/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:50 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:51.341575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:51.342228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:51.349327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:51.349826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:51.350281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:51.351001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:51.351468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:51.351905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:51.416650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:51.424867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:51.426330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:51.427637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f211a77-81c2-490c-b5f7-39aef8a7db31 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.089927 Oct 19 01:24:51.428207 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2908/5928] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:51 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:51.598547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:51.599700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:51.606236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:51.606721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:51.607163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:51.607864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:51.608320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:51.608785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:51.743620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:51.751331 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc58e18d-4ce4-4d0e-856c-217797a8fd1a tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.157846 Oct 19 01:24:51.752001 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3021/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:51 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:52.454417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:52.455041 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:52.462449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:52.462939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:52.463387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:52.464095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:52.464590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:52.465062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:52.534149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:52.542916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:52.544383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:52.545698 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2233d981-a265-4ef8-a71f-ab556cfe1819 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.095351 Oct 19 01:24:52.546273 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2909/5930] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:52 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:52.624535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e3160b-4442-46db-8fe2-1efcab573448", "name": "network-vif-plugged", "status": "completed", "tag": "5e8de3ee-efdb-4294-96fe-4a4f8e778906"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:24:52.636493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:52.637003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:52.637437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:52.649066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] Creating event network-vif-plugged:5e8de3ee-efdb-4294-96fe-4a4f8e778906 for instance e2e3160b-4442-46db-8fe2-1efcab573448 on n-h2-master-1 Oct 19 01:24:52.655034 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-28c817f8-e861-425e-89a6-0e3890e4bff7 req-f40b7016-d362-4166-aa33-f772dc49a8f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034252 Oct 19 01:24:52.656125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3022/5931] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:24:52.774504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:52.775299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:52.781618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:52.782151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:52.782609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:52.783377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:52.783846 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:52.784287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:52.931163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:52.939450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-351bdfa7-8643-468e-8981-070084b3ce96 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.168868 Oct 19 01:24:52.940035 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2910/5932] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:52 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:53.574018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:53.574652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:53.580942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:53.581427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:53.581870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:53.582618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:53.584904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:53.584904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:53.650569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:53.659055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:53.660500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:53.661919 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31e8ae35-493e-4ba0-a608-835eac0c46d8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.092179 Oct 19 01:24:53.662660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3023/5933] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:53 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:53.963352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:53.964128 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:53.971739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:53.972319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:53.972863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:53.973642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:53.974817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:53.975405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:54.111560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:54.120278 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf397c84-af55-4dd8-9be5-e5e00226cad7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1319 microversion: 2.1 time: 0.161551 Oct 19 01:24:54.120896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2911/5934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:53 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:54.687961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:54.688607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:54.690623 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:54.691452 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:54.699530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:54.700022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:54.700466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:54.701247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:54.701710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:54.702142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:54.773569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:54.782995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:54.784649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:54.785891 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4b0ceb22-adfc-4c52-9bdd-3490c732eb25 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.102033 Oct 19 01:24:54.786506 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3024/5935] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:54 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:55.140828 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:55.145733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:55.147473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:55.153782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:55.154300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:55.154749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:55.155470 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:55.155911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:55.156347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:55.289659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:55.297472 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c76d86e-3a83-4333-9c85-a6bca9159c89 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1505 microversion: 2.1 time: 0.157488 Oct 19 01:24:55.298054 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2912/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:24:55 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:24:55.814375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:55.815650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:55.824286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:55.825067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:55.825701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:55.826598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:55.827222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:55.827813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:55.899765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:55.915198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:55.920965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:55.922392 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8843cbbb-b495-42c1-9718-1b1dc8138c7d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.112065 Oct 19 01:24:55.923517 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3025/5937] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:55 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:56.953059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:56.954441 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:56.963160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:56.964092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:56.964685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:56.965788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:56.966366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:56.966910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:57.036051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:57.044927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:57.046406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:57.047612 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afb8ba52-9180-4c1d-ab17-ef534ca13574 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.100152 Oct 19 01:24:57.048377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2913/5938] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:56 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:58.089098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:58.090316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:58.100419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:58.101324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:58.101953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:58.102675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:58.103395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:58.103813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:58.191562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:58.204961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:58.206661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:58.207850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f305e6b-978a-4810-94a1-a18a6078dc5d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.126424 Oct 19 01:24:58.208457 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3026/5939] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:58 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:24:59.235282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:24:59.235908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:24:59.243410 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:59.243903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:59.244539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:59.245478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:24:59.246109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:24:59.246712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:24:59.264103 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:24:59.317447 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:59.325829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:59.327266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:24:59.328452 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b22274ec-c595-4131-b966-49137c78ede8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.097328 Oct 19 01:24:59.335474 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2914/5940] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:24:59 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:00.355913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:00.356543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:00.363921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:00.365108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:00.365786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:00.366490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:00.367138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:00.367855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:00.443523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:00.456179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:00.457844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:00.459649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a622e20-6049-49a9-aa4a-43bbc664d777 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.107880 Oct 19 01:25:00.460363 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3027/5941] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:00 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:01.490064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:01.490730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:01.498651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:01.499560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:01.500027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:01.501214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:01.501780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:01.502314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:01.573357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:01.582119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:01.584365 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:01.585689 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f30e432-9630-44c9-9829-24926e8e3382 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.100158 Oct 19 01:25:01.586405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2915/5942] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:01 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:25:02.616159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:02.617500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:02.626105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:02.626601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:02.627275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:02.628028 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:02.628930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:02.629365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:02.634787 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:02.709003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:02.719778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:02.721645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:02.723558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b43b51b-137a-4a45-94c7-ebb2d02cd8b3 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.112253 Oct 19 01:25:02.724323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3028/5943] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:02 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:03.750533 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:03.751260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:03.762138 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:03.764279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:03.765119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:03.765809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:03.787262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:03.790208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:03.791110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:04.133985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:04.142427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:04.144021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:04.146144 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b76e4381-6691-4006-ba18-21ee5ff470ce tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.398922 Oct 19 01:25:04.146553 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2916/5944] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:03 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:05.178044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:05.178956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:05.183379 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:05.188576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:05.189408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:05.189862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:05.190588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:05.191057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:05.191496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:05.295347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:05.305055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:05.307106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:05.308475 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3db5931-9bbf-4e83-991c-33ff4bc14485 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.135547 Oct 19 01:25:05.309586 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3029/5945] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:05 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:06.335151 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:06.335815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:06.345081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:06.345852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:06.346562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:06.347502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:06.347974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:06.348423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:06.417212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:06.430129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:06.432074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:06.433290 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-609789dd-d792-4503-be9b-db25cd4095c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.102900 Oct 19 01:25:06.433916 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2917/5946] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:06 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:07.461556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:07.462937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:07.470269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:07.471110 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:07.471781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:07.472763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:07.474005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:07.475306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:07.550406 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:07.561600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:07.563305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:07.564714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6218b7e9-0873-48d9-afde-9330df4c2a83 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.108374 Oct 19 01:25:07.565785 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3030/5947] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:07 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:08.607435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:08.608672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:08.635546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:08.638154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:08.638624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:08.639355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:08.639819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:08.640430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:08.724778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:08.737545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:08.739315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:08.743388 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2da81f40-27a1-43c7-95cd-050d53c92e04 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.150752 Oct 19 01:25:08.743976 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2918/5948] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:08 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:09.774587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:09.776004 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:09.795838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:09.796344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:09.796875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:09.797535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:09.797997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:09.798475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:09.962722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:09.971910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:09.973998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:09.987526 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f5dc287e-73e0-46a5-8295-513e7d13c3de tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.205929 Oct 19 01:25:09.989038 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3031/5949] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:09 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:11.015563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:11.016184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:11.024386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:11.024908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:11.025348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:11.026059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:11.026713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:11.027156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:11.211625 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:11.228267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:11.230481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:11.232435 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c57dfc8d-9b8c-4a44-bee6-c9dab2efa8f8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.220934 Oct 19 01:25:11.244647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2919/5950] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:11 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:12.261781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:12.263442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:12.271745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:12.273203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:12.273956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:12.274993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:12.275626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:12.276531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:12.436293 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:12.447515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:12.464488 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:12.466227 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-947d52e7-d1ff-4033-a929-3b9bd95b5c2a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.208446 Oct 19 01:25:12.469650 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3032/5951] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:12 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:13.500017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:13.506803 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:13.525545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:13.526529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:13.527166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:13.528066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:13.528772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:13.529545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:13.625177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:13.646979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:13.651367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:13.652787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6340eac-bfa0-4067-a2ba-f2f4a0ec54d2 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.157232 Oct 19 01:25:13.655373 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2920/5952] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:13 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:14.248171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c443ded-f431-46c1-bb46-eea6df127197", "device": "/dev/sdb"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:14.252606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:14.262002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:14.262591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:14.263347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:14.264333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:14.265072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:14.265722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:14.620340 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8643174-7263-42d9-bbf1-81f02ecc5e18 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "POST /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377791 Oct 19 01:25:14.621453 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3033/5953] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:25:14 2022] POST /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:14.683508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:14.684554 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:14.694104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:14.695268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:14.696080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:14.698177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:14.698816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:14.699427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:14.800225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:14.811217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:14.812704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:14.813927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a9b8cbfb-bd23-412e-996d-48a973c676b8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.135116 Oct 19 01:25:14.814965 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2921/5954] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:14 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:15.845466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:15.846303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:15.868704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:15.870547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:15.872660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:15.873625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:15.876191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:15.881060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:16.148259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:16.157604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:16.165010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:16.166464 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4ed53a09-ea6c-4f09-936d-b40f46d7f630 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.329616 Oct 19 01:25:16.168886 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3034/5955] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:15 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:17.195929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:17.196925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:17.210800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:17.211307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:17.211823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:17.212545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:17.225123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:17.225879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:17.375266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:17.397545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:17.400729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:17.403026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e7bd3cc-db00-420d-b194-52180436d3c4 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.211265 Oct 19 01:25:17.404159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2922/5956] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:17 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:18.170653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db1cb204-88c9-4d1e-824d-ff07d41ceb4a tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Action: 'create', calling method: .version_select at 0x7f2af4fc6e50>, body: {"keypair": {"name": "tempest-TestServerBasicOps-929268275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Bps+HrVgXxhHqyx+FZE4ul7+Q5xRRh7eRmJqOXqhhmY3gTGsKa9AA84Ii85rTxm8T+TayW+OTwDRJ1Isqz2oEYhgbascVC9iMurOLOANp06B6dd3/ErjURz7xsU3X9w=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:18.188758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-db1cb204-88c9-4d1e-824d-ff07d41ceb4a tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for project 50c481b6746440f99c673ba61a1ed915. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:18.194952 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-db1cb204-88c9-4d1e-824d-ff07d41ceb4a tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for user 20779cd4f9734fb89d2144414b4630e8 and project 50c481b6746440f99c673ba61a1ed915. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:18.223534 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db1cb204-88c9-4d1e-824d-ff07d41ceb4a tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.322453 Oct 19 01:25:18.225145 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3035/5957] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:25:17 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:18.433534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:18.435091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:18.445504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:18.446131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:18.446824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:18.447701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:18.448539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:18.449669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:18.529003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:18.539406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:18.541098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:18.542566 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba477567-5d6d-4f2a-b677-774f38f429c8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.113236 Oct 19 01:25:18.543112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2923/5958] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:18 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:19.361882 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1448549204", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-929268275", "security_groups": [{"name": "tempest-secgroup-smoke-1670769927"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "77f094bd-1026-463b-8969-d14870042c0e"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:19.473081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] validate_networks() for [('77f094bd-1026-463b-8969-d14870042c0e', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:25:19.572010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:19.572646 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:19.587356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:19.588898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:19.589614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:19.591127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:19.591798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:19.592638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:19.698558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:19.707160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:19.709832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:19.711254 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55a9a1b4-a5a5-4f88-8ad1-db8950d3baad tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1366 microversion: 2.47 time: 0.143242 Oct 19 01:25:19.711855 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2924/5959] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:19 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:25:19.990749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for project 50c481b6746440f99c673ba61a1ed915. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:19.998175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for user 20779cd4f9734fb89d2144414b4630e8 and project 50c481b6746440f99c673ba61a1ed915. Resources: dict_keys(['metadata_items']) {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:20.011742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:25:20.012164 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:25:20.012881 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:25:20.013296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:25:20.013711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:25:20.023394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:20.023888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:20.024406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:20.025419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:20.025884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:20.026304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:20.046152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for project 50c481b6746440f99c673ba61a1ed915. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:20.052679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Getting quotas for user 20779cd4f9734fb89d2144414b4630e8 and project 50c481b6746440f99c673ba61a1ed915. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:20.067920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:25:20.070627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:25:20.148649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9fec0abd-2597-4948-b965-2ea66612c3c1 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.791477 Oct 19 01:25:20.154228 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3036/5960] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:25:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:25:20.163443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ae7e68f-43ad-44d4-a17c-159d2c37adbe tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:20.164059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9ae7e68f-43ad-44d4-a17c-159d2c37adbe tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:20.223440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ae7e68f-43ad-44d4-a17c-159d2c37adbe tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:20.231928 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ae7e68f-43ad-44d4-a17c-159d2c37adbe tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1302 microversion: 2.1 time: 0.073302 Oct 19 01:25:20.245840 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2925/5961] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:20 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:20.739765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:20.741168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:20.748643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:20.749458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:20.750137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:20.751075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:20.751755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:20.752415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:20.831811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:20.843242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:20.844800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:20.846771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-98f67f55-7907-46f4-b2a5-20e2a1312dc8 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1372 microversion: 2.47 time: 0.112520 Oct 19 01:25:20.848387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3037/5962] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:20 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:21.257530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:21.258223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:21.266220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:21.267304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:21.267988 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:21.269277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:21.271032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:21.271580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:21.344733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:21.355469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1be36a68-f873-4e8d-b163-6f72216ef001 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1354 microversion: 2.1 time: 0.103132 Oct 19 01:25:21.356319 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2926/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:21 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:21.876450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:21.877118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:21.884844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:21.885453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:21.885966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:21.886920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:21.887459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:21.887967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:21.982500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:21.992053 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:21.993928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:21.995161 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf241686-7416-4148-bf8c-5d05dee59b82 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1372 microversion: 2.47 time: 0.122963 Oct 19 01:25:21.995731 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3038/5964] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:21 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:22.380210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:22.381572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:22.388746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:22.389482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:22.390258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:22.391826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:22.392506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:22.393165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:22.640806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:22.648728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-07443a62-17c2-4575-bf62-aa7e6ff73e1c tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.273116 Oct 19 01:25:22.649408 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2927/5965] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:22 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:23.022712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:23.028179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:23.035963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.036736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.037137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.037858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.038324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.038761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.125477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.133923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.135385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.136569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-281b2fee-6802-4252-86b9-5196e9911a49 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1357 microversion: 2.47 time: 0.118724 Oct 19 01:25:23.137241 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3039/5966] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:23 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1357 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:23.166942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:23.174703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.176793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Searching by: {'deleted': False, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c'} {{(pid=131450) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 01:25:23.183080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.183731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.184173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.184985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.185452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.185896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.227981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700eb9ef-68ff-488d-9182-0eb5cf340c5f", "tag": "9447a5e0-f6db-4305-abb4-5dc7e0d71254"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:23.243759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.244252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.244782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.259641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] Creating event network-changed:9447a5e0-f6db-4305-abb4-5dc7e0d71254 for instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f on n-h2-master-1 Oct 19 01:25:23.265120 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-383721d1-0a9f-4a7d-a761-52427a99f053 req-f42c43b3-8f4b-490f-9136-a69a5d779dd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Oct 19 01:25:23.265835 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3040/5967] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:23.345274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.multi_cell_list [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131450) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 01:25:23.463175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.470778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.471632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.472202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.485941 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.487510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.537024 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c646bf7f-fc13-4f36-84d7-e8db8787016a tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.374658 Oct 19 01:25:23.537625 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2928/5968] 10.222.0.27 () {60 vars in 1187 bytes} [Wed Oct 19 01:25:23 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:23.570274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:23.570858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:23.577208 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.577779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.578214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.579045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.579497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.579920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.607515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:25:23.672438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:23.673169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:23.681028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.682084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.682608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.683702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.684305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.684966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.688043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74061525-a955-4cf7-815b-0bb751703ec7 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 204 len: 0 microversion: 2.47 time: 0.122516 Oct 19 01:25:23.689047 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3041/5969] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:25:23 2022] DELETE /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:25:23.698308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:23.699086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:23.704978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.705540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.706048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.706831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:23.708334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:23.708465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:23.815259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.824442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.826176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.827488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94d2bbde-4b4e-494c-a7fb-92c812dd1859 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1363 microversion: 2.47 time: 0.133340 Oct 19 01:25:23.828351 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3042/5970] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:23 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1363 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:25:23.898984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:23.907006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2628b91f-42a0-4ae5-b085-962b6f418f86 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.238786 Oct 19 01:25:23.907587 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2929/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:23 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:25:24.854302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:24.854931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:24.861757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:24.862238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:24.862678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:24.863499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:24.863960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:24.865472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:24.932448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:24.933099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:24.939954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:24.940438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:24.940910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:24.941611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:24.942069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:24.942496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:24.945636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:24.954134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:24.955600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:24.956819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bea05ee7-5f7a-4b5b-970c-41871448ea2b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1363 microversion: 2.47 time: 0.106717 Oct 19 01:25:24.957717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3043/5972] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:24 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1363 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 19 01:25:25.174034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:25.184279 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afa8264f-fb2b-4e68-902b-6bf95ce78566 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.256150 Oct 19 01:25:25.184927 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2930/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:24 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:25:25.983327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:25.983980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:25.991696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:25.992191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:25.992683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:25.993380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:25.993889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:25.994317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:25.997055 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:26.029631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:26.030032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:26.030476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:26.030994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lazy-loading 'fault' on Instance uuid e13925e7-3094-409e-8a0d-813e0abbc19a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:25:26.209333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:26.210848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:26.219103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:26.220017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:26.220734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:26.221710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:26.222423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:26.223151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:26.253855 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=100 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:26.390887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:26.399106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:26.400835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:26.402051 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-398cb2e3-477f-43ef-b61d-94aeee9a965d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 200 len: 1368 microversion: 2.47 time: 0.422707 Oct 19 01:25:26.402628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3044/5974] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:25 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:26.486469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:26.494300 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ab46d4b-c1a8-4952-b043-a761f0a356d0 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.289662 Oct 19 01:25:26.494884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2931/5975] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:26 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:25:27.428066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:27.428844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: e13925e7-3094-409e-8a0d-813e0abbc19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:27.435976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.436455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.436933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.437661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.438152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.438576 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.454513 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] HTTP exception thrown: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Request method failure captured: Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a HTTP/1.1 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1HXO0tezAUg8Zk4nDwBC2J4sTyPGnFEY2sO59oj7S7rmb951jAvTlWnZBTNzvqYm70yidtAhgtAZhqyMQjWcBVcUNJjVK3uehuuqPdSQzVDEW-9AZ9VGmVVForszUXbsSqjolV5Fy99wtNJb0TUA95Pr7Utzj9v7nS942ZD1QDN0QU Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: b78f9f6c05124b8ebf03595244c9320c Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerShowV247Test-293225953 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b78f9f6c05124b8ebf03595244c9320c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b78f9f6c05124b8ebf03595244c9320c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b78f9f6c05124b8ebf03595244c9320c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b78f9f6c05124b8ebf03595244c9320c"}]}] Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerShowV247Test-293225953 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: b78f9f6c05124b8ebf03595244c9320c Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerShowV247Test-293225953 Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerShowV247Test-293225953-project Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 9885f8a436684a0392e63b784cbe84fd Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerShowV247Test-293225953-project Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e13925e7-3094-409e-8a0d-813e0abbc19a'} Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:27.456216 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Returning 404 to user: Instance e13925e7-3094-409e-8a0d-813e0abbc19a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8ddaf2e-c9e1-43be-b040-8a2e1da5cb46 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a" status: 404 len: 111 microversion: 2.47 time: 0.034302 Oct 19 01:25:27.461970 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3045/5976] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:27 2022] GET /compute/v2.1/servers/e13925e7-3094-409e-8a0d-813e0abbc19a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:25:27.466815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:27.467527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:27.475505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.476046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.476495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.477238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.477793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.478230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.504945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:25:27.518149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:27.518696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:27.525330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.525816 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.526252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.526948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.527402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.527846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.586957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dc6c9dc3-24c9-4faf-9a2c-b74490815a6d tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 204 len: 0 microversion: 2.47 time: 0.123682 Oct 19 01:25:27.587974 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2932/5977] 10.222.0.27 () {60 vars in 1280 bytes} [Wed Oct 19 01:25:27 2022] DELETE /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 19 01:25:27.597589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:27.598330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:27.605573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.606072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.606522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.607236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:27.607724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:27.608182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:27.698773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:27.709011 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:27.710544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:27.711693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eb765877-f07d-4fda-a7a4-9312cb9d150b tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 200 len: 1362 microversion: 2.47 time: 0.119395 Oct 19 01:25:27.712515 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2933/5978] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:27 2022] GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 1362 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:27.747930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:27.759364 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-797d8052-3e65-4115-89db-4dbf3be52769 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.244543 Oct 19 01:25:27.772644 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3046/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:27 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:25:28.742501 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:28.743191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:28.751257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:28.751865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:28.752366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:28.753212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:28.754114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:28.754742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:28.767636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eb9ef-68ff-488d-9182-0eb5cf340c5f", "name": "network-vif-plugged", "status": "completed", "tag": "9447a5e0-f6db-4305-abb4-5dc7e0d71254"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:28.780196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:28.780982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:28.781593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:28.798257 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] Creating event network-vif-plugged:9447a5e0-f6db-4305-abb4-5dc7e0d71254 for instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f on n-h2-master-1 Oct 19 01:25:28.804770 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e175dda2-bac8-4f01-a792-a2dc268dc1f8 req-3e5c091c-8be4-4ab3-8c29-12831c9e0afd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042658 Oct 19 01:25:28.805857 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3047/5980] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:28.811621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:28.812726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:28.819843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:28.820569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:28.821251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:28.822288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:28.823007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:28.824384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:28.837023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:28.848662 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:28.851495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:28.852910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a7904050-7999-490e-a6b9-e29fb9a61912 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 200 len: 1362 microversion: 2.47 time: 0.117281 Oct 19 01:25:28.854133 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2934/5981] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:28 2022] GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 1362 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:29.028018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:29.036329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad8f8555-d9e0-4d79-9423-195d290e2974 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.228851 Oct 19 01:25:29.038046 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3048/5982] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:28 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:29.881850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:29.882429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:29.889414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:29.889906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:29.890351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:29.891084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:29.891565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:29.891980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:29.925531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:29.926024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:29.926469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:29.926921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lazy-loading 'fault' on Instance uuid 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:25:29.970321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:29.980113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:29.981730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9885f8a436684a0392e63b784cbe84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b78f9f6c05124b8ebf03595244c9320c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:29.983439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d1eab1d-b34c-4141-a90f-8b4268d21318 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 200 len: 1367 microversion: 2.47 time: 0.106657 Oct 19 01:25:29.984215 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2935/5983] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:29 2022] GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 1367 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 19 01:25:30.060661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:30.061304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:30.064127 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:30.064839 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:30.071180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:30.071667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:30.072102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:30.073016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:30.073493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:30.073952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:30.228097 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:30.237888 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb8d1e4d-3b57-4916-820a-69f3ad5faafd tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1428 microversion: 2.1 time: 0.181248 Oct 19 01:25:30.238505 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3049/5984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:30 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1428 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:31.018870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:31.019493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] [instance: 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:31.026982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.027482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.027934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.028665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.029142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.029580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.043548 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] HTTP exception thrown: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Request method failure captured: Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c HTTP/1.1 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1HXO0tezAUg8Zk4nDwBC2J4sTyPGnFEY2sO59oj7S7rmb951jAvTlWnZBTNzvqYm70yidtAhgtAZhqyMQjWcBVcUNJjVK3uehuuqPdSQzVDEW-9AZ9VGmVVForszUXbsSqjolV5Fy99wtNJb0TUA95Pr7Utzj9v7nS942ZD1QDN0QU Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Openstack-Nova-Api-Version: 2.47 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: b78f9f6c05124b8ebf03595244c9320c Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerShowV247Test-293225953 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b78f9f6c05124b8ebf03595244c9320c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b78f9f6c05124b8ebf03595244c9320c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b78f9f6c05124b8ebf03595244c9320c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b78f9f6c05124b8ebf03595244c9320c"}]}] Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerShowV247Test-293225953 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: b78f9f6c05124b8ebf03595244c9320c Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerShowV247Test-293225953 Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerShowV247Test-293225953-project Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 9885f8a436684a0392e63b784cbe84fd Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerShowV247Test-293225953-project Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c'} Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:31.045272 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] Returning 404 to user: Instance 36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:25:31.049338 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96b35cdf-2ec8-44fe-9d54-91e12760fff1 tempest-ServerShowV247Test-293225953 tempest-ServerShowV247Test-293225953-project] 10.222.0.27 "GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c" status: 404 len: 111 microversion: 2.47 time: 0.031817 Oct 19 01:25:31.050563 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2936/5985] 10.222.0.27 () {60 vars in 1277 bytes} [Wed Oct 19 01:25:31 2022] GET /compute/v2.1/servers/36dfd7b8-b2b1-446a-a32e-1ea5de0f9b0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:25:31.263193 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:31.264249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:31.271162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.271648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.272239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.273137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.273617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.274319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.436515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:31.445507 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc702c6a-bfb8-4a35-a458-29bb3c28ca68 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1608 microversion: 2.1 time: 0.186863 Oct 19 01:25:31.446178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3050/5986] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:31 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1608 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:31.469249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:31.469867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:31.477963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.478467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.479112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.480025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.481581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.482685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.732877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:31.741995 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-331a8dbf-3742-44f7-8148-9c0d6236a861 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1608 microversion: 2.1 time: 0.276654 Oct 19 01:25:31.743301 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2937/5987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:31 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1608 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:31.765070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:31.765718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:31.772785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.773401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.773843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.774581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:31.775369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:31.775948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:31.938009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:31.948007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aac986b3-02be-48b1-b661-b579bcbdfa74 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1608 microversion: 2.1 time: 0.186970 Oct 19 01:25:31.948597 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3051/5988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:31 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1608 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:34.216310 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:34.217572 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:34.385189 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "700eb9ef-68ff-488d-9182-0eb5cf340c5f", "tag": "9447a5e0-f6db-4305-abb4-5dc7e0d71254"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:34.394587 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:34.397759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:34.398437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:34.399188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:34.414443 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] Creating event network-changed:9447a5e0-f6db-4305-abb4-5dc7e0d71254 for instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f on n-h2-master-1 Oct 19 01:25:34.420875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8b24d378-9ee5-4837-8817-60d6c1915f73 req-2cb013b7-de36-4c69-93a7-7afd5b22823b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209902 Oct 19 01:25:34.425799 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2938/5989] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:38.643339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ecfbc47e-563e-4ef0-9795-157f42728673 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: .version_select at 0x7f2af4504280>, body: {"keypair": {"name": "tempest-keypair-344292322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOgX/N872ktIrV+gp2wg8HaB3CNfAlg9C2tOY6AaYO105Ea0JDVEDBvSbu4Ue+XhnCieYaDg7xTIZ7vGnbJjLRz2WqyeWzoJy1uvfmuTLXUVop2ds031rH91wmgRmvw7nQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:38.650187 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:38.663820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ecfbc47e-563e-4ef0-9795-157f42728673 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:38.669379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ecfbc47e-563e-4ef0-9795-157f42728673 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:38.694463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ecfbc47e-563e-4ef0-9795-157f42728673 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.139338 Oct 19 01:25:38.695222 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3052/5990] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:25:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:40.080412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-609665086", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e1f6504-8740-456f-8181-f37ae2fef3b3"}], "security_groups": [{"name": "tempest-securitygroup--605507523"}], "key_name": "tempest-keypair-344292322", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:40.204517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] validate_networks() for [('2e1f6504-8740-456f-8181-f37ae2fef3b3', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:25:40.660380 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:25:40.660899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:25:40.661362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:25:40.662021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:25:40.662221 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:25:40.673896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:40.674413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:40.674863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:40.675773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:40.676279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:40.676725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:40.696043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:40.701647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:40.714745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:25:40.717273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:25:40.764654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25e48fb2-c9ea-4820-9208-3c52ac2ea298 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.690334 Oct 19 01:25:40.765315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2939/5991] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:25:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:25:40.777415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-484e71df-ddc9-41fe-a4a8-7dadaa6ca0db tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:40.778116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-484e71df-ddc9-41fe-a4a8-7dadaa6ca0db tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:40.840055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-484e71df-ddc9-41fe-a4a8-7dadaa6ca0db tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:40.848485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-484e71df-ddc9-41fe-a4a8-7dadaa6ca0db tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1240 microversion: 2.1 time: 0.074902 Oct 19 01:25:40.849657 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3053/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:40 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:41.160858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:41.161446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:41.170113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:41.170612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:41.171052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:41.171819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:41.172279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:41.173193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:41.302136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lazy-loading 'services' on Instance uuid e2e3160b-4442-46db-8fe2-1efcab573448 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:25:41.420355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-959ed2fd-bb6d-4a7f-aced-bed46aa5f8a7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448/os-volume_attachments/6c443ded-f431-46c1-bb46-eea6df127197" status: 202 len: 0 microversion: 2.1 time: 0.266286 Oct 19 01:25:41.421793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2940/5993] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:25:41 2022] DELETE /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448/os-volume_attachments/6c443ded-f431-46c1-bb46-eea6df127197 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:25:41.871554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:41.872268 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:41.880121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:41.880916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:41.881434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:41.882232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:41.882771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:41.883277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:41.952480 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:41.962571 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8264b619-da2b-4252-a2bb-36711dba92aa tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1292 microversion: 2.1 time: 0.094599 Oct 19 01:25:41.963190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3054/5994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:41 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:42.995948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:42.997672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:43.008581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:43.009682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:43.010582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:43.011794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:43.012436 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:43.013146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:43.217760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:43.227833 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d662804-66f2-4e22-9df3-cca8c6dd4696 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.243710 Oct 19 01:25:43.246219 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2941/5995] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:42 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:43.969020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27f133c-76f8-4919-8d4c-e3db56167bf6", "tag": "e088f840-a4a1-4785-a62f-3a152d47c10e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:43.979993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:43.980488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:43.980942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:43.993819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] Creating event network-changed:e088f840-a4a1-4785-a62f-3a152d47c10e for instance e27f133c-76f8-4919-8d4c-e3db56167bf6 on n-h1-master-1 Oct 19 01:25:43.999066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-28d8dacd-fe1e-4df4-ab3c-b80e6cfcc92f req-90132367-7765-4e8d-ae15-486bb84d8088 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034203 Oct 19 01:25:43.999928 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3055/5996] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:25:44.251337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:44.251971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:44.259975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:44.260474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:44.261008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:44.261733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:44.262204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:44.262824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:44.484526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:44.493755 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5fe74a13-ac92-4f29-8f94-f39d9ba03c79 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.246291 Oct 19 01:25:44.494626 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2942/5997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:44 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:45.531478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:45.532309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:45.538856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:45.539413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:45.539880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:45.540577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:45.541058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:45.541482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:45.772867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:45.782476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bd35b678-1797-49a2-9286-16d1809fc22a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.256046 Oct 19 01:25:45.783595 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3056/5998] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:45 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:46.807837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:46.808462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:46.815925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:46.816416 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:46.816888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:46.817600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:46.818548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:46.819018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:46.863232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:46.863835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:46.871407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:46.871988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:46.872503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:46.873331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:46.873859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:46.874364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:46.901222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:25:46.961599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:46.970169 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f31d1d9-3838-4451-91a8-5a0cabbc4c8f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.167848 Oct 19 01:25:46.970965 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2943/5999] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:46 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:46.983385 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-333ff103-33d3-4a06-8762-6bb8889f1042 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 204 len: 0 microversion: 2.1 time: 0.123871 Oct 19 01:25:46.983953 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3057/6000] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:25:46 2022] DELETE /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:25:46.995019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:46.995691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:47.001648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:47.002130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:47.002565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:47.003251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:47.003712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:47.004136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:47.134525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:47.142590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f8a1398-1c67-4367-838e-7f238a3bb64e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1511 microversion: 2.1 time: 0.152544 Oct 19 01:25:47.143174 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2944/6001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:46 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:47.996713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:47.997457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:48.004843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:48.005961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:48.006542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:48.007259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:48.007721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:48.008155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:48.148075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:48.158990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9268c21f-212c-482b-b943-8dc49f48ffb2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.166324 Oct 19 01:25:48.159823 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3058/6002] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:47 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:48.174003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:48.175309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:48.183887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:48.184496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:48.185049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:48.185976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:48.186506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:48.186949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:48.320197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:48.328636 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cab9f32c-eff2-436e-87ef-1277ead9015e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1511 microversion: 2.1 time: 0.160055 Oct 19 01:25:48.329450 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2945/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:48 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:49.128810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e3160b-4442-46db-8fe2-1efcab573448", "name": "network-vif-deleted", "tag": "5e8de3ee-efdb-4294-96fe-4a4f8e778906"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:49.139824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.140303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.140760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.152796 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] Creating event network-vif-deleted:5e8de3ee-efdb-4294-96fe-4a4f8e778906 for instance e2e3160b-4442-46db-8fe2-1efcab573448 on n-h2-master-1 Oct 19 01:25:49.157799 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-7b9b82a1-db60-4722-9bc6-2f5749d3f4ae req-63a01e52-da69-4e58-8df6-ff51d2f39dc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032937 Oct 19 01:25:49.158409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3059/6004] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:49.183940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:49.184856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:49.191875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.192364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.193417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.194237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.194718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.195127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.333264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:49.341962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2489a129-559f-4801-bded-69cfb3b58e64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.163230 Oct 19 01:25:49.342551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2946/6005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:49 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:49.353186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:49.353905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:49.360866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.361360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.361806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.362512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.362968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.363400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.397999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.398578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.399030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.399489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lazy-loading 'fault' on Instance uuid e2e3160b-4442-46db-8fe2-1efcab573448 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:25:49.444958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:49.452707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63fce4fb-e93b-4d77-86c1-42ffc894df86 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 200 len: 1309 microversion: 2.1 time: 0.104906 Oct 19 01:25:49.453296 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3060/6006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:49 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:49.574723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27f133c-76f8-4919-8d4c-e3db56167bf6", "name": "network-vif-plugged", "status": "completed", "tag": "e088f840-a4a1-4785-a62f-3a152d47c10e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:49.584961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:49.585447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:49.585892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:49.598020 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] Creating event network-vif-plugged:e088f840-a4a1-4785-a62f-3a152d47c10e for instance e27f133c-76f8-4919-8d4c-e3db56167bf6 on n-h1-master-1 Oct 19 01:25:49.604259 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-42f4046a-644f-46b6-81b0-a1e75c036ca0 req-eb94512b-7f59-4986-856b-23e4e1a508ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104729 Oct 19 01:25:49.604964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2947/6007] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:50.368496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:50.369119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:50.375987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:50.376514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:50.376925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:50.377612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:50.378070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:50.378491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:50.478162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:50.478882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: e2e3160b-4442-46db-8fe2-1efcab573448] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:50.487256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:50.487759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:50.488208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:50.488955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:50.489425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:50.490628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:50.495000 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:50.506295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] HTTP exception thrown: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Request method failure captured: Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 HTTP/1.1 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1GaJZU3OO4h5XAHHNubUjz5t7nxkiBURR6rDiumaEqisFfKv0WmX6FFbv07-dq0B54QLEzk1KcP0q-scjfeiTqWXZR_M6TtBp4hKQS8PUQa_xl5PcpVajT0_ijLllEz6eb40CVedeEom8GB0ACDCb-IYfwEUnZEZtLLOtpCosP21VY Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 568de9170fba47f09ef0d3cfdc9b34df Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_568de9170fba47f09ef0d3cfdc9b34df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/568de9170fba47f09ef0d3cfdc9b34df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/568de9170fba47f09ef0d3cfdc9b34df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/568de9170fba47f09ef0d3cfdc9b34df"}]}] Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 568de9170fba47f09ef0d3cfdc9b34df Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesSnapshotTestJSON-1750209833-project Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 25a73a5fe5644dac874ce5d3e2558566 Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesSnapshotTestJSON-1750209833-project Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e2e3160b-4442-46db-8fe2-1efcab573448'} Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:25:50.508109 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Returning 404 to user: Instance e2e3160b-4442-46db-8fe2-1efcab573448 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a192b7f2-911e-47de-a5c0-01c47701fe39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448" status: 404 len: 111 microversion: 2.1 time: 0.037987 Oct 19 01:25:50.512525 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2948/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:50 2022] GET /compute/v2.1/servers/e2e3160b-4442-46db-8fe2-1efcab573448 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:25:50.513643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:50.524430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe80999f-583b-4890-b1c3-811cfe1b432f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1365 microversion: 2.1 time: 0.156554 Oct 19 01:25:50.524430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3061/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:50 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:51.544410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:51.544983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:51.546799 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:51.547605 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:51.557531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:51.558033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:51.558483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:51.559192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:51.559657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:51.560094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:51.698275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:51.706731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7bfed05-4c31-4b26-ae31-355d13e316cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1556 microversion: 2.1 time: 0.166847 Oct 19 01:25:51.707312 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2949/6010] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:51 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:51.729049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:51.729552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:51.731717 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:51.737307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:51.737785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:51.738226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:51.738916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:51.739368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:51.740294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:51.823655 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbded4ad-7c16-40dd-8ad6-6bc9b6bbf69e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098457 Oct 19 01:25:51.824445 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3062/6011] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:25:51 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:25:53.225654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e27f133c-76f8-4919-8d4c-e3db56167bf6", "tag": "e088f840-a4a1-4785-a62f-3a152d47c10e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:53.235499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:53.235985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:53.236419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:53.248011 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] Creating event network-changed:e088f840-a4a1-4785-a62f-3a152d47c10e for instance e27f133c-76f8-4919-8d4c-e3db56167bf6 on n-h1-master-1 Oct 19 01:25:53.252992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b4a404ad-a02d-4989-9a2f-6c7f5174600e req-98c4d6a4-ad47-45bb-a3e6-718c09e56bac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099479 Oct 19 01:25:53.253603 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2950/6012] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:25:57.345332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-595463365", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "1e82c6e9-2f0f-4709-9fff-50c8cce4b112"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:25:57.399467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] validate_networks() for [('1e82c6e9-2f0f-4709-9fff-50c8cce4b112', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:25:57.762489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:25:57.762945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:25:57.763427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:25:57.763840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:25:57.764254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:25:57.773284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:57.773768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:57.774207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:57.775014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:57.775455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:57.775917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:57.782524 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:25:57.794817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Getting quotas for project 568de9170fba47f09ef0d3cfdc9b34df. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:25:57.800236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Getting quotas for user 25a73a5fe5644dac874ce5d3e2558566 and project 568de9170fba47f09ef0d3cfdc9b34df. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:25:57.813301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:25:57.815578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:25:57.862207 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e090f34f-28de-4b6c-b2ac-ac797313dd39 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521741 Oct 19 01:25:57.862985 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3063/6013] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:25:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:25:57.876311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-543c7528-9739-4051-ada2-6f2b7f88c3f6 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:57.877205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-543c7528-9739-4051-ada2-6f2b7f88c3f6 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:57.932726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-543c7528-9739-4051-ada2-6f2b7f88c3f6 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:57.939863 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-543c7528-9739-4051-ada2-6f2b7f88c3f6 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1218 microversion: 2.1 time: 0.068815 Oct 19 01:25:57.940449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2951/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:57 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:25:58.963108 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:25:58.963767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:25:58.971190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:58.971717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:58.972206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:58.972958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:25:58.973412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:25:58.973951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:25:59.056682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:25:59.066425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ba3ab225-ecf1-491b-92e7-33efed47edce tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1278 microversion: 2.1 time: 0.107166 Oct 19 01:25:59.073804 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3064/6015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:25:58 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1278 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:00.094993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:00.095721 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:00.105159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:00.105684 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:00.106113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:00.106835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:00.107292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:00.107746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:00.332584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:00.340998 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2254c72-67fe-4f1a-bdc3-9dd84ee254d7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.250095 Oct 19 01:26:00.341893 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2952/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:00 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:00.470465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80c8d1a-9fcf-4d18-a0e6-09f131649465", "tag": "ace83261-96bf-4d3e-ba2a-4eb96c767485"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:00.481903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:00.482718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:00.483293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:00.495806 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] Creating event network-changed:ace83261-96bf-4d3e-ba2a-4eb96c767485 for instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 on n-h1-master-1 Oct 19 01:26:00.500614 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6868d8d2-b265-481d-af67-416d4e2c04b5 req-b0f550cc-88f6-4616-be06-01ce82a9574d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033890 Oct 19 01:26:00.501252 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3065/6017] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:01.364136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:01.364795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:01.371349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:01.371917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:01.372372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:01.373108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:01.373575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:01.374027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:01.505129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:01.512924 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80240a19-ac69-40f0-af61-f73d1c8e1c97 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.152933 Oct 19 01:26:01.513504 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2953/6018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:01 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:02.537507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:02.538116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:02.544236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:02.544757 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:02.545204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:02.545900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:02.546359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:02.546793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:02.678817 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:02.686868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e560336e-9d36-442a-9558-1134e5262b35 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.154622 Oct 19 01:26:02.687458 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3066/6019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:02 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:03.710772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:03.711410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:03.719110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:03.719547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:03.720003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:03.720748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:03.721251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:03.721727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:03.910000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:03.918757 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d8208d23-ddd1-486f-97fa-57578ce5edf0 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.212406 Oct 19 01:26:03.919350 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2954/6020] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:03 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:04.942086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:04.942688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:04.949897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:04.950778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:04.951217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:04.951921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:04.952369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:04.952825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:05.100037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:05.108060 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c02b563-a319-45bc-9112-75fe2fe3c6de tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.169867 Oct 19 01:26:05.108674 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3067/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:04 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:05.549292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80c8d1a-9fcf-4d18-a0e6-09f131649465", "name": "network-vif-plugged", "status": "completed", "tag": "ace83261-96bf-4d3e-ba2a-4eb96c767485"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:05.557345 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:05.562245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:05.562726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:05.563163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:05.576547 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] Creating event network-vif-plugged:ace83261-96bf-4d3e-ba2a-4eb96c767485 for instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 on n-h1-master-1 Oct 19 01:26:05.581632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5c6d3382-157b-4f83-ab76-169cb5c7af32 req-56e82c6b-1d8a-42c7-87ec-3d3ef3545163 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036412 Oct 19 01:26:05.582422 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2955/6022] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:06.132454 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:06.133094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:06.139906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:06.140383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:06.140850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:06.141542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:06.141988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:06.142412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:06.274424 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:06.282333 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c6ec9f8-00dc-41a4-be70-e332bc82e55e tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1318 microversion: 2.1 time: 0.154880 Oct 19 01:26:06.282969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3068/6023] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:06 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:07.308812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:07.309528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:07.316643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:07.317291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:07.317881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:07.318586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:07.319051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:07.319486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:07.458200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:07.465936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bfb19f1a-b95e-4756-899d-a086392f9d90 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1504 microversion: 2.1 time: 0.162619 Oct 19 01:26:07.466756 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2956/6024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:07 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:07.488812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e753056-a968-42a9-9347-3be13775dc9c", "device": "/dev/sdb"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:07.491269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:07.498070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:07.498562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:07.499003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:07.499694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:07.500153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:07.500584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:07.761736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b938ee2-c672-4d94-a160-eb69b6a65fd5 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "POST /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277011 Oct 19 01:26:07.762471 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3069/6025] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:26:07 2022] POST /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:09.304262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:09.306090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:09.308550 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:09.314608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:09.315116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:09.315557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:09.316277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:09.316767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:09.317538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:09.344972 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ae420dab-af67-4d57-a77b-47c84553dd72 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.045424 Oct 19 01:26:09.345586 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2957/6026] 10.222.0.27 () {58 vars in 1293 bytes} [Wed Oct 19 01:26:09 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:29.282707 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.284045 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.285435 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.286795 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.291936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:29.292506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:29.301545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:29.302245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:29.302788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:29.303645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:29.304089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:29.304556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:29.309815 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:29.310576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:29.313978 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=5 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.314709 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=39 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:29.320854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:29.321360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:29.321813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:29.322534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:29.323003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:29.323444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:29.350984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4202af57-fb1d-42a3-97d2-01e3f4c9e827 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/ips" status: 200 len: 150 microversion: 2.1 time: 0.045331 Oct 19 01:26:29.352208 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2958/6027] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:26:29 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:29.393358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lazy-loading 'services' on Instance uuid c80c8d1a-9fcf-4d18-a0e6-09f131649465 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:26:29.472962 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fcfe622c-359b-4a6c-815b-7deb26641f91 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465/os-volume_attachments/2e753056-a968-42a9-9347-3be13775dc9c" status: 202 len: 0 microversion: 2.1 time: 0.190761 Oct 19 01:26:29.473614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3070/6028] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:26:29 2022] DELETE /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465/os-volume_attachments/2e753056-a968-42a9-9347-3be13775dc9c => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:26:30.750493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc797a76-11b2-4ab5-97b5-33aba022b8bd"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:30.752930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:30.759539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:30.760032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:30.760509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:30.761270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:30.761732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:30.762168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:31.035913 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d90418a-0d6b-415a-a509-8c7824155585 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289584 Oct 19 01:26:31.036772 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2959/6029] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:26:30 2022] POST /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:34.188450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:34.189319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:34.198335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:34.199006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:34.199462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:34.200183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:34.200827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:34.201324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:34.230442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:26:34.309752 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9aec107-0e67-4dd7-8ce0-d6e9c7b62dc9 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 204 len: 0 microversion: 2.1 time: 0.125938 Oct 19 01:26:34.314290 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3071/6030] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:26:34 2022] DELETE /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:26:34.320512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:34.321266 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:34.327603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:34.328086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:34.328528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:34.329247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:34.329706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:34.330135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:34.474986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:34.482991 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9aff6a8c-99d0-4cf9-9455-fd6bd45b9c77 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1510 microversion: 2.1 time: 0.167807 Oct 19 01:26:34.483592 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2960/6031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:34 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:35.508201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:35.508902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:35.516429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:35.516966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:35.517495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:35.518301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:35.518762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:35.519222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:35.659804 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:35.668145 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f4dae65-1d55-4ec5-a76b-90d2e76c331b tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1510 microversion: 2.1 time: 0.164831 Oct 19 01:26:35.668754 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3072/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:35 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:36.615895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80c8d1a-9fcf-4d18-a0e6-09f131649465", "name": "network-vif-deleted", "tag": "ace83261-96bf-4d3e-ba2a-4eb96c767485"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:36.626587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:36.627080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:36.627523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:36.640351 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] Creating event network-vif-deleted:ace83261-96bf-4d3e-ba2a-4eb96c767485 for instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 on n-h1-master-1 Oct 19 01:26:36.646227 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9ab7b85a-ad80-4fca-8a48-0dc25f1add25 req-bb4556ba-53d1-449e-9e26-eee2e8515817 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034681 Oct 19 01:26:36.648873 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2961/6033] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:36.691827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:36.693071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:36.707685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:36.708421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:36.710117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:36.710117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:36.710431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:36.710938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:36.778867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a73a5fe5644dac874ce5d3e2558566', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '568de9170fba47f09ef0d3cfdc9b34df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:36.787242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-368bc3b4-218e-4466-8422-25e3f4473c58 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 200 len: 1303 microversion: 2.1 time: 0.099228 Oct 19 01:26:36.788064 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3073/6034] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:36 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:37.813370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:37.814138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] [instance: c80c8d1a-9fcf-4d18-a0e6-09f131649465] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:37.820854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:37.821514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:37.822004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:37.822773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:37.823242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:37.823681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:37.837977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] HTTP exception thrown: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Request method failure captured: Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 HTTP/1.1 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1GaJZU3OO4h5XAHHNubUjz5t7nxkiBURR6rDiumaEqisFfKv0WmX6FFbv07-dq0B54QLEzk1KcP0q-scjfeiTqWXZR_M6TtBp4hKQS8PUQa_xl5PcpVajT0_ijLllEz6eb40CVedeEom8GB0ACDCb-IYfwEUnZEZtLLOtpCosP21VY Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 568de9170fba47f09ef0d3cfdc9b34df Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_568de9170fba47f09ef0d3cfdc9b34df", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/568de9170fba47f09ef0d3cfdc9b34df"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/568de9170fba47f09ef0d3cfdc9b34df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/568de9170fba47f09ef0d3cfdc9b34df"}]}] Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 568de9170fba47f09ef0d3cfdc9b34df Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1750209833 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-VolumesSnapshotTestJSON-1750209833-project Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 25a73a5fe5644dac874ce5d3e2558566 Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-VolumesSnapshotTestJSON-1750209833-project Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: exception: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'c80c8d1a-9fcf-4d18-a0e6-09f131649465'} Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:26:37.839644 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] Returning 404 to user: Instance c80c8d1a-9fcf-4d18-a0e6-09f131649465 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0504b88b-cba6-4fe3-9f9a-0ccf947d94e7 tempest-VolumesSnapshotTestJSON-1750209833 tempest-VolumesSnapshotTestJSON-1750209833-project] 10.222.0.27 "GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465" status: 404 len: 111 microversion: 2.1 time: 0.033087 Oct 19 01:26:37.844481 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2962/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:37 2022] GET /compute/v2.1/servers/c80c8d1a-9fcf-4d18-a0e6-09f131649465 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:26:43.922726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c3de5b28-2ac7-41ad-b4be-106d505ffcc2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: .version_select at 0x7f2af4528ca0>, body: {"keypair": {"name": "tempest-keypair-2053112989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz8erjheTr505gZG8ZV+Ga0M+4ZNFEMnyVo7Uvo0z0iI6bhu8GowmRph6gdTTNb/UkFiBOb3IDMEG/4MO/NhkLo89WIYR70GeKfSvGg5QrrPIuaS7Jfraa6aiExVr/vvA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:43.939948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c3de5b28-2ac7-41ad-b4be-106d505ffcc2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:26:43.945839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-c3de5b28-2ac7-41ad-b4be-106d505ffcc2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:26:43.970434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c3de5b28-2ac7-41ad-b4be-106d505ffcc2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051564 Oct 19 01:26:43.971140 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3074/6036] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:26:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:45.299124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1405609053", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e1f6504-8740-456f-8181-f37ae2fef3b3"}], "security_groups": [{"name": "tempest-securitygroup--646363170"}], "key_name": "tempest-keypair-2053112989", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:45.418715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] validate_networks() for [('2e1f6504-8740-456f-8181-f37ae2fef3b3', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:26:45.834525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:26:45.835067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:26:45.835609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:26:45.836017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:26:45.836639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:26:45.847964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:45.848459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:45.848967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:45.849770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:45.850464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:45.851157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:45.869854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:26:45.875498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:26:45.889241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:26:45.891863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:26:45.941341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f26b5b25-4aea-44ae-bce3-32b8af0bb76a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.646622 Oct 19 01:26:45.942429 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2963/6037] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:26:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:26:45.960994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07c0e0e0-5ea0-4e83-b480-19ee7c7639c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:45.961625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-07c0e0e0-5ea0-4e83-b480-19ee7c7639c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:46.034067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-07c0e0e0-5ea0-4e83-b480-19ee7c7639c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:46.042982 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07c0e0e0-5ea0-4e83-b480-19ee7c7639c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1242 microversion: 2.1 time: 0.087330 Oct 19 01:26:46.043836 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3075/6038] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:45 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:47.069205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:47.069902 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:47.076897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:47.077645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:47.078315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:47.079032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:47.079712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:47.080187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:47.160937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:47.170057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-226c2a88-6c49-4ef4-a995-4b37d69a6337 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1294 microversion: 2.1 time: 0.105654 Oct 19 01:26:47.170839 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2964/6039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:47 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:48.196914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:48.198469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:48.205645 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:48.208280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:48.209319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:48.211404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:48.212326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:48.212991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:48.213605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:48.297334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:48.308027 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2fac0226-028d-433a-921f-aa95ce31e7cd tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1300 microversion: 2.1 time: 0.117131 Oct 19 01:26:48.308656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3076/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:48 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:49.333707 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:49.334917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:49.342235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:49.342738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:49.343189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:49.343947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:49.344406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:49.344879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:49.365328 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dab01b1-78a0-469b-9031-c19500d24b41", "tag": "95e276ac-042d-401d-8b33-1b64bd3f0743"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:49.379781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:49.380560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:49.381275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:49.396121 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] Creating event network-changed:95e276ac-042d-401d-8b33-1b64bd3f0743 for instance 9dab01b1-78a0-469b-9031-c19500d24b41 on n-h1-master-1 Oct 19 01:26:49.404983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-750498d5-77c2-495b-9276-f71eaf21c62e req-001ec5c6-e9f9-452c-89e0-9fb95d6c4c2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046546 Oct 19 01:26:49.405662 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3077/6041] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:26:49.580259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:49.588788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98675784-4fe0-40cc-b91d-4dd2a472f65f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.259161 Oct 19 01:26:49.589377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2965/6042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:49 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:50.613774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:50.614582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:50.621940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:50.622438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:50.622882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:50.623591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:50.624050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:50.624483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:50.757696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:50.765623 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5b2d3f06-d121-41fc-9b5b-4f84c431d3e7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.156938 Oct 19 01:26:50.766213 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3078/6043] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:50 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:51.789255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:51.789817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:51.796747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:51.797232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:51.797673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:51.798371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:51.798824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:51.799257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:51.930246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:51.938595 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8896f09b-591d-49f8-9c1b-3682777b0a25 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.153632 Oct 19 01:26:51.939294 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2966/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:51 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:52.963396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:52.964029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:52.971021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:52.971517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:52.971959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:52.972772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:52.973232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:52.973665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:53.113984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:53.122913 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18e308a4-e6f5-4923-a727-542083e389e9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.164366 Oct 19 01:26:53.123644 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3079/6045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:52 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:54.146495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:54.147179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:54.154461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:54.154953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:54.155418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:54.156163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:54.156641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:54.157098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:54.298645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:54.308368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab9610ed-4b20-46e8-bd29-6f3dd7c54b8e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.165854 Oct 19 01:26:54.309004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2967/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:54 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:55.333581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:55.334812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:55.340461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:55.340982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:55.341421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:55.342134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:55.342590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:55.343108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:55.487449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:55.495882 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c4365ed-24a0-4de1-8e4f-93779d6e72d8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.168149 Oct 19 01:26:55.496674 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3080/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:55 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:55.765045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dab01b1-78a0-469b-9031-c19500d24b41", "name": "network-vif-plugged", "status": "completed", "tag": "95e276ac-042d-401d-8b33-1b64bd3f0743"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:55.776425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:55.776943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:55.777372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:55.789383 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] Creating event network-vif-plugged:95e276ac-042d-401d-8b33-1b64bd3f0743 for instance 9dab01b1-78a0-469b-9031-c19500d24b41 on n-h1-master-1 Oct 19 01:26:55.794509 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2e1913b8-8bb2-4b20-907e-84275c84e7b4 req-0f6f504b-052c-4960-b396-8ea1a79d84f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033139 Oct 19 01:26:55.795122 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2968/6048] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:56.520793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:56.522072 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:56.524082 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:56.530515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:56.530997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:56.531483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:56.532195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:56.532669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:56.533107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:56.675371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:56.684512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9369a41c-2fef-4a45-a515-3ceb06a25361 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1367 microversion: 2.1 time: 0.167699 Oct 19 01:26:56.685148 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3081/6049] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:56 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:57.704503 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:57.705334 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:26:57.711187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:57.711926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:57.718937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:57.719427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:57.719870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:57.720574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:57.721055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:57.721486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:57.857014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:26:57.865317 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de8e6316-2c79-4cc4-afee-5354cc03b40f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1557 microversion: 2.1 time: 0.161565 Oct 19 01:26:57.866632 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2969/6050] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:26:57 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:26:57.890543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:26:57.891139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:26:57.899204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:57.899770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:57.900287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:57.901114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:57.901644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:57.902150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:57.979803 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dfa1caf6-16d5-4f05-98e1-b78775ad41ee tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093369 Oct 19 01:26:57.980526 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3082/6051] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:26:57 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:26:59.276759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dab01b1-78a0-469b-9031-c19500d24b41", "tag": "95e276ac-042d-401d-8b33-1b64bd3f0743"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:26:59.290019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:26:59.290797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:26:59.291480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:26:59.306235 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] Creating event network-changed:95e276ac-042d-401d-8b33-1b64bd3f0743 for instance 9dab01b1-78a0-469b-9031-c19500d24b41 on n-h1-master-1 Oct 19 01:26:59.312071 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3fcf4c0e-0600-44ba-a405-949e940528ea req-cc6e7512-0c0d-43bd-968c-6baadba5528b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040398 Oct 19 01:26:59.313325 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2970/6052] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:35.363890 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:35.364706 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:35.370409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:35.370911 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:35.378640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.379132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.379575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.380278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.380766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.381730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.411762 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40a4bbf9-2e5d-4990-89ae-5ba8ffaa3126 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/ips" status: 200 len: 150 microversion: 2.1 time: 0.049819 Oct 19 01:27:35.413000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3083/6053] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:27:35 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:35.423143 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:35.423979 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:27:35.430136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc797a76-11b2-4ab5-97b5-33aba022b8bd"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:35.432558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:35.443308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.444591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.446136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.446848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.447316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.447751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.527981 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/os-volume_attachments HTTP/1.1 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 74 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: {"volumeAttachment": {"volumeId": "cc797a76-11b2-4ab5-97b5-33aba022b8bd"}} Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: exception: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '9dab01b1-78a0-469b-9031-c19500d24b41', 'body': {'volumeAttachment': {'volumeId': 'cc797a76-11b2-4ab5-97b5-33aba022b8bd'}}} Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:27:35.529784 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 400 to user: Invalid volume: volume cc797a76-11b2-4ab5-97b5-33aba022b8bd is already attached to instances: e27f133c-76f8-4919-8d4c-e3db56167bf6 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4e54957-dad0-4ea8-9d42-e95c5dc8a17c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110484 Oct 19 01:27:35.536459 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2971/6054] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:27:35 2022] POST /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:27:35.540905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:35.541416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:35.547324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.547814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.548256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.548984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.549439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.549867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.576477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:27:35.653110 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b7cf899-9ba9-4bc0-951b-34ac9c0f4fab tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 204 len: 0 microversion: 2.1 time: 0.116416 Oct 19 01:27:35.653651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3084/6055] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:27:35 2022] DELETE /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:27:35.663101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:35.663729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:35.669948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.670444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.670893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.671602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:35.672066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:35.672502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:35.806085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:35.814203 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c7280a2-7b63-4d25-b523-fa243631c623 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1682 microversion: 2.1 time: 0.156149 Oct 19 01:27:35.814788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2972/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:35 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:36.839929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:36.840656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:36.847550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:36.848040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:36.848484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:36.849222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:36.849730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:36.850234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:36.983331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:36.991608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b8b45713-db2b-41e1-af24-ed0dd531b35e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1682 microversion: 2.1 time: 0.155928 Oct 19 01:27:36.992195 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3085/6057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:36 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:38.015577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:38.016191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:38.023980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:38.024479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:38.025207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:38.026137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:38.026700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:38.027242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:38.109048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:38.123383 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31fc2869-83ad-443c-a200-4d5fd58bd872 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 200 len: 1615 microversion: 2.1 time: 0.111178 Oct 19 01:27:38.125041 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2973/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:38 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 1615 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:38.180605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dab01b1-78a0-469b-9031-c19500d24b41", "name": "network-vif-deleted", "tag": "95e276ac-042d-401d-8b33-1b64bd3f0743"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:38.193235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:38.194068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:38.194728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:38.207990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] Creating event network-vif-deleted:95e276ac-042d-401d-8b33-1b64bd3f0743 for instance 9dab01b1-78a0-469b-9031-c19500d24b41 on n-h1-master-1 Oct 19 01:27:38.213893 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e50a39d7-a973-4f30-9a57-c9cf726ab29f req-fab8557e-1987-474d-ab85-43aa15a3a4c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037602 Oct 19 01:27:38.219085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3086/6059] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:39.149390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:39.149952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:39.156824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:39.157328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:39.157755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:39.158448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:39.158902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:39.159446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:39.173583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 HTTP/1.1 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9dab01b1-78a0-469b-9031-c19500d24b41'} Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:39.175984 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d8231ce-24d3-4f68-ac4b-fb81f8fafd7e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 404 len: 111 microversion: 2.1 time: 0.033704 Oct 19 01:27:39.181143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2974/6060] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:39 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:27:39.187974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e881459-140c-4de5-bd63-66ba86e01133 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '.version_select at 0x7f2aefba4160>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:39.210223 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e881459-140c-4de5-bd63-66ba86e01133 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053112989" status: 202 len: 0 microversion: 2.1 time: 0.026647 Oct 19 01:27:39.210815 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3087/6061] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053112989 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:27:39.874298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:39.874804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:39.881338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:39.881816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:39.882261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:39.882997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:39.883464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:39.883903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:39.968216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lazy-loading 'services' on Instance uuid e27f133c-76f8-4919-8d4c-e3db56167bf6 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:27:40.038528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9538e6b8-6f1c-42cf-803d-5c730a170ba7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments/cc797a76-11b2-4ab5-97b5-33aba022b8bd" status: 202 len: 0 microversion: 2.1 time: 0.167955 Oct 19 01:27:40.039137 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2975/6062] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:27:39 2022] DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments/cc797a76-11b2-4ab5-97b5-33aba022b8bd => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:27:40.047751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:40.050171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:40.058256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:40.058749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:40.059456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:40.060223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:40.060721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:40.061225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:40.092690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26af810b-4163-4b47-9cff-2841e1acbcd7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049010 Oct 19 01:27:40.093572 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3088/6063] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:40 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:41.107643 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:41.110106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:41.117482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:41.117981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:41.118432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:41.119144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:41.119607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:41.120046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:41.150432 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c763926-6ff1-4a66-92da-0cc94634550c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Oct 19 01:27:41.151031 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2976/6064] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:41 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:42.163820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:42.166035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:42.173117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:42.173610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:42.174055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:42.174758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:42.175217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:42.175647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:42.208205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1e63f4e3-62b5-4133-8eb6-9cd60d30d617 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048802 Oct 19 01:27:42.208893 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3089/6065] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:42 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:43.221419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:43.223766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:43.231445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:43.231875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:43.232318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:43.233155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:43.233618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:43.234057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:43.264949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9569f1b6-2cbd-4764-be90-e99de9c72ab8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047664 Oct 19 01:27:43.265529 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2977/6066] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:43 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:44.277392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:44.279532 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:44.286437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:44.286925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:44.288443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:44.289190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:44.289651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:44.290084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:44.324026 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-472da9d5-08db-4c78-9b56-e46fb4761ece tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050658 Oct 19 01:27:44.324533 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3090/6067] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:44 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:45.336495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:45.338724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:45.345674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.346166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.346618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.347319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.347785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.348221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.377637 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ed90b18-61d9-4899-9369-12a47b2c6284 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045222 Oct 19 01:27:45.378205 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2978/6068] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:27:45 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:27:45.441299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:45.441818 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:45.449376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.449854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.450286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.450975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.451424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.451850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.476645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:27:45.555106 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7239378d-bb88-4531-84d3-49fc189a909a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 204 len: 0 microversion: 2.1 time: 0.117376 Oct 19 01:27:45.555743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3091/6069] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:27:45 2022] DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:27:45.565538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:45.566166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:45.568447 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:27:45.568590 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 (ip 10.222.0.27) !!! Oct 19 01:27:45.579425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.579922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.580371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.581114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:45.581580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:45.582016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:45.712925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:45.720763 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29b2cd6f-4732-4d4c-a834-88d3b538e99b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1680 microversion: 2.1 time: 0.160146 Oct 19 01:27:45.721349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2979/6070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:45 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:27:46.750916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:46.751619 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:46.758792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:46.759253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:46.759684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:46.760372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:46.760854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:46.761277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:46.895130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:46.902974 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31fa21e0-4996-4eef-9613-a476ccadf473 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1680 microversion: 2.1 time: 0.156457 Oct 19 01:27:46.903560 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3092/6071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:46 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:47.927277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:47.928310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:47.937328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:47.938227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:47.938678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:47.939405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:47.939870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:47.940365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:48.311026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:48.319417 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6fecb45b-04b5-443c-b930-9e555f5dfbe9 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1680 microversion: 2.1 time: 0.395546 Oct 19 01:27:48.320353 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2980/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:47 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:48.736071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e27f133c-76f8-4919-8d4c-e3db56167bf6", "name": "network-vif-deleted", "tag": "e088f840-a4a1-4785-a62f-3a152d47c10e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:48.752701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:48.753192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:48.753631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:48.786281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] Creating event network-vif-deleted:e088f840-a4a1-4785-a62f-3a152d47c10e for instance e27f133c-76f8-4919-8d4c-e3db56167bf6 on n-h1-master-1 Oct 19 01:27:48.794990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-62a195e2-fbc8-4e01-9fd7-0a4776f4af68 req-97701652-d793-4c89-a613-584ebbf129cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069884 Oct 19 01:27:48.800134 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3093/6073] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:49.343010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:49.343639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:49.351289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:49.351776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:49.352463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:49.353561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:49.354032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:49.355138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:49.388952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:49.389442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:49.389879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:49.390333 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lazy-loading 'fault' on Instance uuid e27f133c-76f8-4919-8d4c-e3db56167bf6 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:27:49.434599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:49.444984 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cab9aa06-1912-4c1f-98e6-2b9046966e01 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 200 len: 1330 microversion: 2.1 time: 0.105728 Oct 19 01:27:49.445579 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2981/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:49 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 1330 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:50.470537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:50.471236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:50.478311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:50.478804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:50.479248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:50.480226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:50.480396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:50.480857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:50.495482 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 HTTP/1.1 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e27f133c-76f8-4919-8d4c-e3db56167bf6'} Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:27:50.497158 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b3ca7724-2c1e-45c5-9a10-a6455f5cb8d7 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 404 len: 111 microversion: 2.1 time: 0.033246 Oct 19 01:27:50.502699 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3094/6075] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:50 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:27:50.508718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9aa34998-455f-4140-8119-3a5a3070961f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '.version_select at 0x7f2af415ac10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:50.532881 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9aa34998-455f-4140-8119-3a5a3070961f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344292322" status: 202 len: 0 microversion: 2.1 time: 0.029145 Oct 19 01:27:50.533488 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2982/6076] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344292322 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:27:51.166702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e038e357-f0e3-4231-ab56-2932853eb805 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: .version_select at 0x7f2af458a280>, body: {"keypair": {"name": "tempest-keypair-1055658083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRVIWw2S8CrOrtuIRdKCshvxLLXzQm3QBXbsKoZIgKCkVLtkX5y8vL9e9EnlzG++HDOgjm1amn5JybiNgd6naq/84OR9Cd2+l0/UYCDNHuwoH5KKvY6RfLzCQSuR0rEGA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:51.183098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e038e357-f0e3-4231-ab56-2932853eb805 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:27:51.188421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-e038e357-f0e3-4231-ab56-2932853eb805 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:27:51.212083 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e038e357-f0e3-4231-ab56-2932853eb805 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049929 Oct 19 01:27:51.212709 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3095/6077] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:27:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:27:52.501995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-532485288", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e1f6504-8740-456f-8181-f37ae2fef3b3"}], "security_groups": [{"name": "tempest-securitygroup--625492368"}], "key_name": "tempest-keypair-1055658083", "user_data": "}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:52.604474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] validate_networks() for [('2e1f6504-8740-456f-8181-f37ae2fef3b3', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:27:53.076888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:27:53.077327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:27:53.077847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:27:53.078271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:27:53.078722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:27:53.088634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:53.089311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:53.089774 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:53.090522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:53.091128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:53.091582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:53.110036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:27:53.115397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:27:53.127800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:27:53.130215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:27:53.178454 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51c185f9-dc63-496c-b45f-71f8ebd22d91 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681587 Oct 19 01:27:53.179110 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2983/6078] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:27:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:27:53.191348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68396749-c149-43ea-8a75-dffa3e3cfc40 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:53.191967 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68396749-c149-43ea-8a75-dffa3e3cfc40 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:53.251562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68396749-c149-43ea-8a75-dffa3e3cfc40 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:53.259391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68396749-c149-43ea-8a75-dffa3e3cfc40 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1241 microversion: 2.1 time: 0.072782 Oct 19 01:27:53.259965 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3096/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:53 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:54.283952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:54.284511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:54.291882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:54.292372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:54.292840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:54.293537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:54.293997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:54.294431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:54.358938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:54.367670 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73828c95-1a26-496a-9010-f1c834f64ea3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1293 microversion: 2.1 time: 0.088646 Oct 19 01:27:54.368298 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2984/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:54 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:55.391219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:55.391994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:55.399736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:55.400202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:55.400657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:55.401370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:55.401820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:55.402243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:55.617660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:55.625800 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0e71eab-97e2-4d37-9302-ee0730cada44 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.238230 Oct 19 01:27:55.626384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3097/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:55 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:55.968748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1babf8b-6c5f-4eb5-92b7-43773b747c6f", "tag": "189e674a-1a05-49a5-b60f-e8c5391a7619"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:27:55.980246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:55.981153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:55.981665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:55.994655 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] Creating event network-changed:189e674a-1a05-49a5-b60f-e8c5391a7619 for instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f on n-h1-master-1 Oct 19 01:27:55.999549 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7fb01a79-f94b-4050-9945-cc7a733c1566 req-0902f17b-3dac-405a-b6ae-9ca310c1ce63 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034588 Oct 19 01:27:56.000198 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2985/6082] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:27:56.650514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:56.651170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:56.658002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:56.658491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:56.658934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:56.659635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:56.660093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:56.660523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:56.799410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:56.807763 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-253a8544-4e6b-4bc2-a5d0-97948f1548f5 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.161698 Oct 19 01:27:56.808352 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3098/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:56 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:57.832822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:57.833506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:57.839871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:57.840369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:57.840854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:57.841559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:57.842023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:57.842461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:58.019629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:58.029669 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7616a82e-4d1f-46c9-9cd7-7cdcc2d30cb6 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.202127 Oct 19 01:27:58.030259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2986/6084] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:57 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:27:59.054849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:27:59.055465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:27:59.062862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:59.063352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:59.063802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:59.064504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:27:59.065000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:27:59.065430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:27:59.197047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:27:59.204809 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-631eecc6-542d-4c0f-80b3-3186e74588a2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.154536 Oct 19 01:27:59.205414 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3099/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:27:59 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:28:00.227691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:00.228402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:00.235468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:00.235960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:00.236419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:00.237150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:00.237619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:00.238056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:00.371424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:28:00.379126 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c978c7c-77b3-455e-b642-b6d99739d83b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.155506 Oct 19 01:28:00.379705 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2987/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:28:00 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:28:01.403385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:01.404005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:01.410925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:01.411405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:01.411843 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:01.412534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:01.413015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:01.413443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:01.540698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:28:01.548394 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44eb6a1a-32d6-493c-9e63-ccb978051b00 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.149699 Oct 19 01:28:01.548999 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3100/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:28:01 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:28:02.148106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1babf8b-6c5f-4eb5-92b7-43773b747c6f", "name": "network-vif-plugged", "status": "completed", "tag": "189e674a-1a05-49a5-b60f-e8c5391a7619"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:28:02.159049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:02.159598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:02.160059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:02.175175 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] Creating event network-vif-plugged:189e674a-1a05-49a5-b60f-e8c5391a7619 for instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f on n-h1-master-1 Oct 19 01:28:02.180389 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-be6bb504-66fc-4185-9645-d4633132fd3c req-4a48451f-3bfd-4bf2-bc75-5d888dbb4070 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036044 Oct 19 01:28:02.181047 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2988/6088] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:02.571565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:02.572207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:02.579041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:02.579517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:02.579949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:02.580649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:02.581113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:02.581536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:02.599944 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:02.715547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:28:02.723333 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8a39fe9-9726-4fc0-b0f1-7d40a89c6421 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1366 microversion: 2.1 time: 0.155656 Oct 19 01:28:02.723944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3101/6089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:28:02 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:28:03.745095 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:03.745920 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:03.751420 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:03.752140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:03.759152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:03.759645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:03.760524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:03.761279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:03.761785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:03.762224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:03.899627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:28:03.908390 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d581f86e-c703-4cfa-9700-105ce9f73171 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1556 microversion: 2.1 time: 0.165286 Oct 19 01:28:03.909039 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2989/6090] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:28:03 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:28:03.934516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:03.935329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:03.937151 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:03.943860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:03.944464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:03.944942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:03.945648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:03.946378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:03.946923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:04.031437 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2f5e74a-1cb8-4716-a9c2-d5c3631a923c tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100992 Oct 19 01:28:04.032045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3102/6091] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:28:03 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:05.351810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1babf8b-6c5f-4eb5-92b7-43773b747c6f", "tag": "189e674a-1a05-49a5-b60f-e8c5391a7619"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:28:05.362480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:05.363044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:05.363587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:05.367359 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:05.375879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] Creating event network-changed:189e674a-1a05-49a5-b60f-e8c5391a7619 for instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f on n-h1-master-1 Oct 19 01:28:05.381073 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a8624983-a386-4a0d-a0b7-6d6857db1d19 req-fbfa8ecd-3cb3-45dd-8bb1-ee6b2056db7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032984 Oct 19 01:28:05.381696 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2990/6092] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:41.147559 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:41.148390 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:41.152713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:41.153142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:41.161769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:41.162248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:41.162686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:41.163386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:41.163842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:41.164272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:41.190082 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e4984dc-51da-4424-8cd7-4d3e3f9cd049 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/ips" status: 200 len: 150 microversion: 2.1 time: 0.044477 Oct 19 01:28:41.190656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3103/6093] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:28:41 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:42.519024 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:42.523556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150f5b34-17e5-4ddd-96ed-c07a31316548"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:28:42.526058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:42.533718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:42.534246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:42.534697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:42.535399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:42.535860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:42.536294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:42.812583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7495772-73f8-4059-b8c1-18901c2c9c2e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295804 Oct 19 01:28:42.813262 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2991/6094] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:28:42 2022] POST /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:53.543636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150f5b34-17e5-4ddd-96ed-c07a31316548"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:28:53.546126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:53.548195 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:53.548868 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:53.554785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.555276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.555715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.556416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.556893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.557324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.637821 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments HTTP/1.1 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 74 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: {"volumeAttachment": {"volumeId": "150f5b34-17e5-4ddd-96ed-c07a31316548"}} Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': 'a1babf8b-6c5f-4eb5-92b7-43773b747c6f', 'body': {'volumeAttachment': {'volumeId': '150f5b34-17e5-4ddd-96ed-c07a31316548'}}} Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:28:53.639471 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 400 to user: Invalid volume: volume 150f5b34-17e5-4ddd-96ed-c07a31316548 is already attached to instances: a1babf8b-6c5f-4eb5-92b7-43773b747c6f {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f4659c6-6c31-4060-9382-b45f5c61373a tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101665 Oct 19 01:28:53.645466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3104/6095] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:28:53 2022] POST /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:28:53.708987 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:53.709773 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:28:53.713982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:53.714559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:53.722337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.722818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.723258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.723949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.724403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.724864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.805787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lazy-loading 'services' on Instance uuid a1babf8b-6c5f-4eb5-92b7-43773b747c6f {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:28:53.876790 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2193ec4d-48fc-42eb-9a12-b7b1ea876828 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments/150f5b34-17e5-4ddd-96ed-c07a31316548" status: 202 len: 0 microversion: 2.1 time: 0.169322 Oct 19 01:28:53.877391 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2992/6096] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:28:53 2022] DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments/150f5b34-17e5-4ddd-96ed-c07a31316548 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:28:53.885935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:53.888210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:53.895455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.896019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.896495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.897357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:53.897910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:53.898675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:53.932817 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b52c7a20-61bf-4212-bfd9-9ac78a1d9675 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050864 Oct 19 01:28:53.933298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3105/6097] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:53 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:54.948193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:54.950597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:54.957180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:54.957679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:54.958134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:54.958851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:54.959316 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:54.959760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:54.992111 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c11cc1fc-66bf-44bb-91ee-2b0962fdac5f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049177 Oct 19 01:28:54.992708 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2993/6098] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:54 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:56.004111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:56.006494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:56.013998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:56.014504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:56.014959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:56.015690 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:56.016155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:56.016588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:56.051148 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dbd750e8-3cd7-456e-9159-10ae090e9798 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050898 Oct 19 01:28:56.051470 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3106/6099] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:55 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:57.063896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:57.067105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:57.073934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:57.074427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:57.074875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:57.075606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:57.076070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:57.076501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:57.111672 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32497e4f-f0a0-4193-9895-4f9af147de2b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051593 Oct 19 01:28:57.112199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2994/6100] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:57 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:58.123615 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:58.125832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:58.133270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:58.133761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:58.134202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:58.134907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:58.135363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:58.135791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:58.168568 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b762b2d3-9fa5-4bbc-a14e-a283cf09f4ba tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048970 Oct 19 01:28:58.169199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3107/6101] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:58 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:28:59.181153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:59.183410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:59.190875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.191356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.191795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.192492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.192980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.193408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.222675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fb220be-d6bb-4ce6-9b58-3178346358f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045548 Oct 19 01:28:59.223222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2995/6102] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:28:59 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:28:59.285936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:59.286432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:59.293232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.293720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.294167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.294866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.295333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.295765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.322487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:28:59.398212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fb3d34b2-52ca-498c-acae-204fc29564cc tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 204 len: 0 microversion: 2.1 time: 0.116651 Oct 19 01:28:59.398808 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3108/6103] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:28:59 2022] DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:28:59.406948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:28:59.407569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:28:59.414385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.414877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.415318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.416013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:28:59.416468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:28:59.416926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:28:59.547075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:28:59.554917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-514d3bc6-749f-434e-8734-fbdf1c585d45 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1681 microversion: 2.1 time: 0.151879 Oct 19 01:28:59.555502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2996/6104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:28:59 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:29:00.579152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:00.580243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:00.587049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:00.587537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:00.587983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:00.588708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:00.589168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:00.589598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:00.724049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:00.731983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae567cd5-2bdf-4287-a627-8e26e0a5c650 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1681 microversion: 2.1 time: 0.157086 Oct 19 01:29:00.732574 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3109/6105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:00 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:01.757233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:01.757928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:01.764773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:01.765264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:01.765704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:01.766402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:01.766858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:01.767352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:01.991034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:01.998820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22878f92-7186-4122-8f59-92939e201f49 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 200 len: 1681 microversion: 2.1 time: 0.245518 Oct 19 01:29:01.999405 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2997/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:01 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:02.210942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1babf8b-6c5f-4eb5-92b7-43773b747c6f", "name": "network-vif-deleted", "tag": "189e674a-1a05-49a5-b60f-e8c5391a7619"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:02.222674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:02.222896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:02.223644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:02.241405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] Creating event network-vif-deleted:189e674a-1a05-49a5-b60f-e8c5391a7619 for instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f on n-h1-master-1 Oct 19 01:29:02.247203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-da54090c-be18-410a-ac5a-820e3a6ad493 req-e9e22e18-bd8d-45ef-bb68-f1934777aa90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039842 Oct 19 01:29:02.248237 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3110/6107] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:03.023921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:03.024940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:03.031861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:03.032349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:03.032829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:03.033784 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:03.034255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:03.034688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:03.050469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f HTTP/1.1 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: exception: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'a1babf8b-6c5f-4eb5-92b7-43773b747c6f'} Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:29:03.052305 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e4e1d04d-6743-429f-b6c6-1d93d29306ed tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 404 len: 111 microversion: 2.1 time: 0.034241 Oct 19 01:29:03.057387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2998/6108] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:03 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:29:03.065112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-659f6301-e764-4e43-96b7-b137683a30cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '.version_select at 0x7f2aefb621f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:03.086425 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-659f6301-e764-4e43-96b7-b137683a30cb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055658083" status: 202 len: 0 microversion: 2.1 time: 0.026802 Oct 19 01:29:03.087029 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3111/6109] 10.222.0.27 () {58 vars in 1221 bytes} [Wed Oct 19 01:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055658083 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:29:03.699462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c65505f5-af42-4b9c-95ea-c627fda5b944 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: .version_select at 0x7f2af4b293a0>, body: {"keypair": {"name": "tempest-keypair-453123787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5ZNzxADovt9nfk6a4ELwiiVO1sW89lXXZ8gOaxEjMX+caHTjLe+KtMzOMUo+KtEWOSUNUQPcx+cJw+mw9s7TkQl+QU7eB2CObO7GSnAoN/IicGqWa4XIPME9Wgf26Mvw=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:03.715876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c65505f5-af42-4b9c-95ea-c627fda5b944 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:29:03.721846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-c65505f5-af42-4b9c-95ea-c627fda5b944 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:29:03.745831 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c65505f5-af42-4b9c-95ea-c627fda5b944 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050316 Oct 19 01:29:03.746429 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 2999/6110] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:29:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:04.969973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-227837872", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e1f6504-8740-456f-8181-f37ae2fef3b3"}], "security_groups": [{"name": "tempest-securitygroup--1927645515"}], "key_name": "tempest-keypair-453123787", "user_data": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:05.077283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] validate_networks() for [('2e1f6504-8740-456f-8181-f37ae2fef3b3', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:29:05.451382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:29:05.451803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:29:05.452275 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:29:05.452723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:29:05.453136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:29:05.462671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:05.463152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:05.463586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:05.464316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:05.464802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:05.465229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:05.481812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:29:05.487482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Getting quotas for user 965ccead68054318a2f18507da6ca13c and project 59d06462e3cd4d998f91e84aff8ebda9. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:29:05.499477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:29:05.502438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:29:05.545253 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 01:29:06.556054 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 33230. Oct 19 01:29:06.560458 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d34a441-1ae1-4cb4-af58-61b3a7939454 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.596288 Oct 19 01:29:06.561725 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3112/6111] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:29:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:29:06.573896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c921940-de61-4b8e-9cd3-bfe2fd52bd42 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:06.574528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c921940-de61-4b8e-9cd3-bfe2fd52bd42 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:06.660394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c921940-de61-4b8e-9cd3-bfe2fd52bd42 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:06.669017 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c921940-de61-4b8e-9cd3-bfe2fd52bd42 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1240 microversion: 2.1 time: 0.100035 Oct 19 01:29:06.680648 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3000/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:06 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:07.701077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:07.701697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:07.713060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:07.713554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:07.713996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:07.714705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:07.715161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:07.715589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:07.785544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:07.793501 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a7164273-e9f6-42b4-8447-2770f51f0cd0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1292 microversion: 2.1 time: 0.096372 Oct 19 01:29:07.794111 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3113/6113] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:07 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:08.818124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:08.818753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:08.827229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:08.827731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:08.828181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:08.829105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:08.830349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:08.831026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:09.073928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:09.082467 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7988ac8a-223a-405a-aa5d-f956629578e3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.268651 Oct 19 01:29:09.083100 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3001/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:08 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:29:09.403283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714f02bd-45e5-4b3a-827a-1a06b90ee9d8", "tag": "bc006ca0-416f-42b7-9238-dbfbbba9e712"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:09.415071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:09.415574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:09.416188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:09.428810 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] Creating event network-changed:bc006ca0-416f-42b7-9238-dbfbbba9e712 for instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 on n-h1-master-1 Oct 19 01:29:09.433694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8a1a4bae-1241-4fef-95d6-c57308d316b4 req-8f4a1d39-1fb2-4e60-95d8-350c1662465b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Oct 19 01:29:09.434312 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3114/6115] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:10.105830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:10.106462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:10.113466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:10.113961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:10.114413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:10.115113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:10.115579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:10.116015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:10.363722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:10.371360 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98071578-1c20-4fdb-bb85-3720f7998c6f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.269477 Oct 19 01:29:10.371930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3002/6116] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:10 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:29:11.396327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:11.397080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:11.403254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:11.403744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:11.404187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:11.404919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:11.405379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:11.405812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:11.598722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:11.606337 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce9877d0-66fe-433e-a527-3af2e4abf589 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.215167 Oct 19 01:29:11.606916 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3115/6117] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:11 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:12.630819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:12.631446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:12.638402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:12.638895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:12.639342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:12.640051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:12.640516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:12.641007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:12.774564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:12.782327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8514b8af-62e8-43d2-89de-d39525968374 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.156166 Oct 19 01:29:12.783818 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3003/6118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:12 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:13.809661 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:13.810996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:13.819799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:13.820454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:13.820984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:13.821740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:13.822370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:13.823032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:13.954241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:13.962123 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db5bc213-dbb1-4806-b6ce-be75253bbb75 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.159645 Oct 19 01:29:13.962703 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3116/6119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:13 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:29:14.583717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714f02bd-45e5-4b3a-827a-1a06b90ee9d8", "name": "network-vif-plugged", "status": "completed", "tag": "bc006ca0-416f-42b7-9238-dbfbbba9e712"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:14.595048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:14.595756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:14.596277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:14.608257 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] Creating event network-vif-plugged:bc006ca0-416f-42b7-9238-dbfbbba9e712 for instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 on n-h1-master-1 Oct 19 01:29:14.614096 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-05864393-1382-46cd-b03d-5fcc40ad8b37 req-70df0247-6080-4e1f-913e-daa13f40e46c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034654 Oct 19 01:29:14.614707 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3004/6120] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:14.985133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:14.985747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:14.993051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:14.993538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:14.993982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:14.994680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:14.995130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:14.995557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:15.127430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:15.136493 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f422afde-9145-4525-8145-7a55ae89bf80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1366 microversion: 2.1 time: 0.155267 Oct 19 01:29:15.137333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3117/6121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:14 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:29:16.161404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:16.162032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:16.168444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:16.168977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:16.169431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:16.170132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:16.170614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:16.171036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:16.306970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:29:16.315869 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb3dcc6f-85c2-4068-99c8-920ad47d9c1e tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1557 microversion: 2.1 time: 0.160000 Oct 19 01:29:16.316449 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3005/6122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:29:16 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:29:16.338738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:16.339305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:16.341724 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:16.342384 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:16.349562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:16.350045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:16.350480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:16.351175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:16.351627 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:16.352053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:16.429470 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a43dd8ca-3fea-483c-96ac-565fb6f4a7a3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094722 Oct 19 01:29:16.430085 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3118/6123] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:29:16 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:17.364769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714f02bd-45e5-4b3a-827a-1a06b90ee9d8", "tag": "bc006ca0-416f-42b7-9238-dbfbbba9e712"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:17.369658 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:17.376374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:17.377611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:17.378061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:17.389295 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] Creating event network-changed:bc006ca0-416f-42b7-9238-dbfbbba9e712 for instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 on n-h1-master-1 Oct 19 01:29:17.395851 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-6732a17d-b172-4078-af40-70ff0139cda0 req-f0b5fc18-c291-4ad5-b9b3-bb960b9dd604 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035102 Oct 19 01:29:17.396468 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3006/6124] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:53.421976 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:53.422906 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:53.427133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:29:53.427652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:53.435294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:53.435785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:53.436229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:53.436957 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:53.437678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:53.438111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:53.465078 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f15c2b6c-c8a0-4fb4-b47d-5213f5287b80 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/ips" status: 200 len: 150 microversion: 2.1 time: 0.044846 Oct 19 01:29:53.465667 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3119/6125] 10.222.0.27 () {58 vars in 1248 bytes} [Wed Oct 19 01:29:53 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:29:54.798962 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:54.800305 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:29:54.805020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51eed6ee-f267-4010-b472-25433c8291cb"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:29:54.807444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:29:54.817262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:54.817749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:54.818194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:54.818896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:29:54.819357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:29:54.819793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:29:55.141598 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93180cad-b83a-4401-9652-08539a76fa24 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "POST /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344805 Oct 19 01:29:55.142218 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3007/6126] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:29:54 2022] POST /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 194 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:05.955401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:05.955950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:05.958980 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:05.959751 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:05.965334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:05.965882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:05.966330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:05.967036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:05.967495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:05.967931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:06.053117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lazy-loading 'services' on Instance uuid 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:30:06.122738 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-254bd00c-501d-44e8-970d-f252fd969e7b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments/51eed6ee-f267-4010-b472-25433c8291cb" status: 202 len: 0 microversion: 2.1 time: 0.171095 Oct 19 01:30:06.123355 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3120/6127] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:30:05 2022] DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments/51eed6ee-f267-4010-b472-25433c8291cb => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:30:06.130068 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:06.132222 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:30:06.136781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:06.139205 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:06.147695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:06.148195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:06.148679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:06.149395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:06.149861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:06.150302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:06.187048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4c7ef659-5210-4296-a649-c5f1afe1d386 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058893 Oct 19 01:30:06.187898 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3008/6128] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:06 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:07.201679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:07.204065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:07.210879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:07.211365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:07.211801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:07.212503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:07.212993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:07.213422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:07.243918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e89ccc5c-d003-4c7b-ad92-01f4e2c0e357 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 Oct 19 01:30:07.244608 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3121/6129] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:07 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:08.255598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:08.257883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:08.266535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:08.267031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:08.267474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:08.268224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:08.268711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:08.269145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:08.303171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-132bc0c1-3a49-4645-914c-1ebbee6b6b32 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050877 Oct 19 01:30:08.304199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3009/6130] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:08 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:09.315869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:09.319177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:09.326670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:09.327156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:09.327674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:09.328405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:09.328884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:09.329681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:09.360235 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d94fac73-9cf5-4b77-965c-ccbdf01dc0f1 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048723 Oct 19 01:30:09.360846 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3122/6131] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:09 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:10.373563 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:10.375817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:10.383290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:10.383842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:10.384297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:10.385045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:10.385515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:10.385990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:10.416710 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8503e2d-0745-4c20-84f8-caf0048a8616 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047165 Oct 19 01:30:10.417285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3010/6132] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:10 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:11.429711 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:11.431892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:11.439001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.439493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.439938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.440652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.441118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.441550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.471218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c90213ae-a92c-4774-ab37-14e16139450b tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046032 Oct 19 01:30:11.471784 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3123/6133] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:30:11 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:30:11.534727 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:11.535239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:11.542713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.543211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.543660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.544372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.544871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.545315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.571817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:30:11.645935 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87190669-a8dd-4195-ac51-cfa29450aea8 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 204 len: 0 microversion: 2.1 time: 0.114786 Oct 19 01:30:11.646734 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3011/6134] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:11 2022] DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:30:11.655443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:11.656066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:11.662419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.662733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.663182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.663885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:11.664346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:11.664810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:11.793703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:11.801453 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04dc7d62-565b-4f49-9c2c-5dee440a8a64 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1681 microversion: 2.1 time: 0.149941 Oct 19 01:30:11.802077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3124/6135] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:11 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:30:12.803390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:12.803989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:12.811302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.811796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.812239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.813229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.813691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.814143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.826798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:12.827421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:12.834214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.834933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.835135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.836537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.837107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.837545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.842980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:30:12.933413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b510d319-73ca-432c-8c6a-01d19aa87ae4 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "DELETE /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 204 len: 0 microversion: 2.1 time: 0.134170 Oct 19 01:30:12.934125 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3012/6136] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:12 2022] DELETE /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:30:12.943023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:12.943733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:12.950211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.950704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.951149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.951852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:12.952314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:12.952778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:12.978446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:12.986608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8030b087-eb24-4ebb-a485-1f2ba610aedb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1681 microversion: 2.1 time: 0.163575 Oct 19 01:30:12.987507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3125/6137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:12 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:30:13.092561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:13.100646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8758709a-12b1-4386-a90d-88df3de56e87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1733 microversion: 2.1 time: 0.161741 Oct 19 01:30:13.101313 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3013/6138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:12 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:30:14.011618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:14.012243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:14.018981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:14.019468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:14.019909 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:14.020608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:14.021085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:14.021507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:14.118753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:14.126981 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-349a726e-34b0-4503-99f1-27060f8ecab2 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1613 microversion: 2.1 time: 0.119769 Oct 19 01:30:14.128421 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3126/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:14 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1613 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:30:14.142061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:14.142061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:14.142061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:14.142061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:14.142061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:14.142834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:14.143534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:14.144173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:14.414656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:14.422632 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad19b447-c37b-4d93-b91e-ad9269441c27 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1733 microversion: 2.1 time: 0.302777 Oct 19 01:30:14.423321 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3014/6140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:14 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1733 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:30:14.597582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714f02bd-45e5-4b3a-827a-1a06b90ee9d8", "name": "network-vif-deleted", "tag": "bc006ca0-416f-42b7-9238-dbfbbba9e712"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:30:14.614876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:14.616066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:14.618441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:14.655343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] Creating event network-vif-deleted:bc006ca0-416f-42b7-9238-dbfbbba9e712 for instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 on n-h1-master-1 Oct 19 01:30:14.664302 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b01a65d7-76b2-4558-aafe-37e1af69d416 req-53d19277-243f-4e72-979a-638e927caa9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070168 Oct 19 01:30:14.665056 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3127/6141] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:15.155598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:15.156228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:15.164061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:15.165107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:15.165761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:15.166650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:15.167279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:15.167878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:15.203217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:15.203899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:15.204512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:15.205184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lazy-loading 'fault' on Instance uuid 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:30:15.256837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ccead68054318a2f18507da6ca13c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d06462e3cd4d998f91e84aff8ebda9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:15.267122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1db3b077-e881-4246-bc40-1bcf8e838a20 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 200 len: 1330 microversion: 2.1 time: 0.115539 Oct 19 01:30:15.267740 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3015/6142] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:15 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:30:15.448196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:15.448949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:15.470733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:15.475651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:15.478074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:15.479145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:15.480131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:15.480723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:15.574979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20779cd4f9734fb89d2144414b4630e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50c481b6746440f99c673ba61a1ed915', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:30:15.591411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d416dcda-6261-4e46-850c-fbc7020c13ab tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 200 len: 1383 microversion: 2.1 time: 0.148754 Oct 19 01:30:15.608378 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3128/6143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:15 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 1383 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:30:16.292770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:16.293498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:16.301104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:16.301602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:16.302117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:16.302841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:16.303311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:16.303871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:16.319305 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 HTTP/1.1 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '714f02bd-45e5-4b3a-827a-1a06b90ee9d8'} Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:16.321358 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afb84b1b-2044-4300-a675-1ae9f08484da tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.035338 Oct 19 01:30:16.326618 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3016/6144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:16 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:16.332057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63aac84d-2ea5-4e4e-abf0-65af5fb3ba11 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '.version_select at 0x7f2af45ab310>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:16.355352 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63aac84d-2ea5-4e4e-abf0-65af5fb3ba11 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-453123787" status: 202 len: 0 microversion: 2.1 time: 0.027357 Oct 19 01:30:16.355945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3129/6145] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:30:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-453123787 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:30:16.616526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:16.617642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:16.624193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:16.624845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:16.625389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:16.626302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:16.626861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:16.627394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:16.643399 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] HTTP exception thrown: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Request method failure captured: Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f HTTP/1.1 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1H39z2G48WjLIDO-gDb6ZY7RnQdHS_muoPEsouOcs3j-x_ih0Zd8r3bdHZVx33XFqaUfdt-pYdqqgh6dr9wd5xB3-oafz_xHYaWUptfIUHPw7XG-dPrbTLbF9DfnilfCzomS3lyf52_c5L6l911kClpoN0jz1TQvzRzKyiJVXwNskg Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c481b6746440f99c673ba61a1ed915", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}] Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestServerBasicOps-782523438 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 20779cd4f9734fb89d2144414b4630e8 Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '700eb9ef-68ff-488d-9182-0eb5cf340c5f'} Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:16.645123 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Returning 404 to user: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:16.651731 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3df4b961-7f48-479a-9c72-80914927a967 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 404 len: 111 microversion: 2.1 time: 0.037268 Oct 19 01:30:16.654001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3017/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:16 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:16.709792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "700eb9ef-68ff-488d-9182-0eb5cf340c5f", "name": "network-vif-deleted", "tag": "9447a5e0-f6db-4305-abb4-5dc7e0d71254"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:30:16.721623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:16.722430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:16.722943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:16.734372 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] Creating event network-vif-deleted:9447a5e0-f6db-4305-abb4-5dc7e0d71254 for instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f on n-h2-master-1 Oct 19 01:30:16.740007 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d14b4341-bb2a-484d-aaa3-7a371f854083 req-9473f11a-abb2-4d9e-a92b-eb4e4c087120 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034212 Oct 19 01:30:16.740977 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3130/6147] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:30:17.142770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:17.143272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:17.150351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:17.150930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:17.151437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:17.152209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:17.152771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:17.153206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:17.167622 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] HTTP exception thrown: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Request method failure captured: Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f HTTP/1.1 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1H39z2G48WjLIDO-gDb6ZY7RnQdHS_muoPEsouOcs3j-x_ih0Zd8r3bdHZVx33XFqaUfdt-pYdqqgh6dr9wd5xB3-oafz_xHYaWUptfIUHPw7XG-dPrbTLbF9DfnilfCzomS3lyf52_c5L6l911kClpoN0jz1TQvzRzKyiJVXwNskg Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c481b6746440f99c673ba61a1ed915", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}] Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 20779cd4f9734fb89d2144414b4630e8 Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '700eb9ef-68ff-488d-9182-0eb5cf340c5f'} Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:17.169324 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Returning 404 to user: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c0f02f65-ca85-4a69-af6a-f10849291b87 tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "DELETE /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 404 len: 111 microversion: 2.1 time: 0.031895 Oct 19 01:30:17.174577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3018/6148] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:17 2022] DELETE /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:17.179986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:17.180746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] [instance: 700eb9ef-68ff-488d-9182-0eb5cf340c5f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:17.187014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:17.187505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:17.188206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:17.188933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:17.189394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:17.189827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:17.204161 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] HTTP exception thrown: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Request method failure captured: Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f HTTP/1.1 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1H39z2G48WjLIDO-gDb6ZY7RnQdHS_muoPEsouOcs3j-x_ih0Zd8r3bdHZVx33XFqaUfdt-pYdqqgh6dr9wd5xB3-oafz_xHYaWUptfIUHPw7XG-dPrbTLbF9DfnilfCzomS3lyf52_c5L6l911kClpoN0jz1TQvzRzKyiJVXwNskg Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_50c481b6746440f99c673ba61a1ed915", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/50c481b6746440f99c673ba61a1ed915"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/50c481b6746440f99c673ba61a1ed915"}]}] Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 50c481b6746440f99c673ba61a1ed915 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestServerBasicOps-782523438 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 20779cd4f9734fb89d2144414b4630e8 Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestServerBasicOps-782523438-project Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '700eb9ef-68ff-488d-9182-0eb5cf340c5f'} Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:17.205837 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Returning 404 to user: Instance 700eb9ef-68ff-488d-9182-0eb5cf340c5f could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c51e5d93-97d9-450b-89de-454979b40d3f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f" status: 404 len: 111 microversion: 2.1 time: 0.031569 Oct 19 01:30:17.211995 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3131/6149] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:17 2022] GET /compute/v2.1/servers/700eb9ef-68ff-488d-9182-0eb5cf340c5f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:17.384698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31614baf-b8ea-4518-8fc3-024140998a9f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] Calling method '.version_select at 0x7f2aefe59f70>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:17.413188 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31614baf-b8ea-4518-8fc3-024140998a9f tempest-TestServerBasicOps-782523438 tempest-TestServerBasicOps-782523438-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-929268275" status: 202 len: 0 microversion: 2.1 time: 0.034106 Oct 19 01:30:17.417442 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3019/6150] 10.222.0.27 () {58 vars in 1251 bytes} [Wed Oct 19 01:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-929268275 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:30:20.328596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:20.329141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:20.340027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:20.340515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:20.340985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:20.341692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:20.342141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:20.342562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:20.357543 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 HTTP/1.1 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '714f02bd-45e5-4b3a-827a-1a06b90ee9d8'} Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:20.359117 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:20.363506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5a45ca3b-eb47-4ecc-9953-ab38fc58d6fb tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.035750 Oct 19 01:30:20.366056 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3132/6151] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:20 2022] DELETE /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:20.375073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:20.376990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 714f02bd-45e5-4b3a-827a-1a06b90ee9d8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:20.386440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:20.387224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:20.387878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:20.388840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:20.389667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:20.390677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:20.411790 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 HTTP/1.1 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '714f02bd-45e5-4b3a-827a-1a06b90ee9d8'} Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:20.413373 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 714f02bd-45e5-4b3a-827a-1a06b90ee9d8 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ac425e39-d446-4d55-a493-b2c4effcb68f tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.045591 Oct 19 01:30:20.422964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3020/6152] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:20 2022] GET /compute/v2.1/servers/714f02bd-45e5-4b3a-827a-1a06b90ee9d8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:23.743337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:23.744007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:23.753042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.764968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.766642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.767644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.768571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.769043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.795613 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f HTTP/1.1 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: exception: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'a1babf8b-6c5f-4eb5-92b7-43773b747c6f'} Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:23.797519 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:23.802195 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60e3e607-9b8e-4e3b-8d98-c63d3aa73b85 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 404 len: 111 microversion: 2.1 time: 0.062393 Oct 19 01:30:23.804267 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3133/6153] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:23 2022] DELETE /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:23.810808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:23.812101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: a1babf8b-6c5f-4eb5-92b7-43773b747c6f] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:23.822430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.823294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.824131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.826395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.827148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.827997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.843942 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f HTTP/1.1 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: exception: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'a1babf8b-6c5f-4eb5-92b7-43773b747c6f'} Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.845928 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. Oct 19 01:30:23.850395 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.853204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance a1babf8b-6c5f-4eb5-92b7-43773b747c6f could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:23.854347 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-398d2cdb-ec47-4b83-8a3f-a88e13251aa0 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f" status: 404 len: 111 microversion: 2.1 time: 0.047669 Oct 19 01:30:23.855174 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3021/6154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:23 2022] GET /compute/v2.1/servers/a1babf8b-6c5f-4eb5-92b7-43773b747c6f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:23.863720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:23.864787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:23.874000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.874491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.875173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.875894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.876344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.876800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.891188 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 HTTP/1.1 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '9dab01b1-78a0-469b-9031-c19500d24b41'} Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:23.892957 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:23.900765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b956860d-74f9-4cd3-aede-63afb6859870 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 404 len: 111 microversion: 2.1 time: 0.035035 Oct 19 01:30:23.902298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3134/6155] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:23 2022] DELETE /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:23.905107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:23.905754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: 9dab01b1-78a0-469b-9031-c19500d24b41] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:23.912015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.912505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.912984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.914530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:23.915143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:23.915582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:23.931187 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 HTTP/1.1 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '9dab01b1-78a0-469b-9031-c19500d24b41'} Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:23.932796 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. Oct 19 01:30:23.938536 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:23.939837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance 9dab01b1-78a0-469b-9031-c19500d24b41 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:23.940716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33e7b831-93d0-48d4-938f-b3120507168d tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41" status: 404 len: 111 microversion: 2.1 time: 0.040254 Oct 19 01:30:23.941283 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3022/6156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:23 2022] GET /compute/v2.1/servers/9dab01b1-78a0-469b-9031-c19500d24b41 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:27.244884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:27.245383 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:27.252455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:27.252988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:27.253432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:27.254139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:27.254594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:27.255024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:27.268557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 HTTP/1.1 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: exception: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'e27f133c-76f8-4919-8d4c-e3db56167bf6'} Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:27.270165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7007cc41-0a40-4777-b31e-c3f190afc464 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 404 len: 111 microversion: 2.1 time: 0.030855 Oct 19 01:30:27.276169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3135/6157] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:30:27 2022] DELETE /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:30:27.281518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:30:27.282181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] [instance: e27f133c-76f8-4919-8d4c-e3db56167bf6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:30:27.290610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:27.291099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:27.291552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:27.292259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:30:27.292756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:30:27.293198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:30:27.307592 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] HTTP exception thrown: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Request method failure captured: Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 HTTP/1.1 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1ISDAqI_J2iHr6I3Rs3HkP1E1RRNykazZy_ocN5Iuq2TXy73chHoXoAmgamYhRdm8Ags-2dOYJ-dM0S7zqufJWRpu5U_fhA3XgPb0HfIqMiS-4X1e9dd8j0yaiqO7HIyGa0eu5zoIWJLOsFv5hdSwVjs191KaLhe1b-08s-FdeLFwA Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_59d06462e3cd4d998f91e84aff8ebda9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/59d06462e3cd4d998f91e84aff8ebda9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/59d06462e3cd4d998f91e84aff8ebda9"}]}] Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 59d06462e3cd4d998f91e84aff8ebda9 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-560529407 Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 965ccead68054318a2f18507da6ca13c Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-AttachVolumeNegativeTest-560529407-project Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: exception: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'e27f133c-76f8-4919-8d4c-e3db56167bf6'} Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:30:27.309267 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] Returning 404 to user: Instance e27f133c-76f8-4919-8d4c-e3db56167bf6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ca78fbf-2e50-4085-b1f4-6b2dc98870c3 tempest-AttachVolumeNegativeTest-560529407 tempest-AttachVolumeNegativeTest-560529407-project] 10.222.0.27 "GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6" status: 404 len: 111 microversion: 2.1 time: 0.033617 Oct 19 01:30:27.314633 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3023/6158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:30:27 2022] GET /compute/v2.1/servers/e27f133c-76f8-4919-8d4c-e3db56167bf6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:31:00.629827 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:00.630704 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:31:00.763548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Calling method '.version_select at 0x7f2aefb1ed30>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:31:00.765355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:31:00.765832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:31:00.766266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:31:00.780343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:31:00.780862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:31:00.781300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:31:00.791002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:31:00.791475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:31:00.792419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:31:00.798116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4549d493-76f9-4bf9-8256-7667c4412874 tempest-PortsAdminExtendedAttrsTestJSON-1976978678 tempest-PortsAdminExtendedAttrsTestJSON-1976978678-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.173830 Oct 19 01:31:00.798677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3136/6159] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:31:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:32:31.878494 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 01:32:31.879508 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:31.880412 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:31.881097 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:32:31.881822 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:32:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.27) !!! Oct 19 01:32:31.884333 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:32:31.884477 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:32:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-aggregates (ip 10.222.0.27) !!! Oct 19 01:32:32.040008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8c2fee4-faec-4df4-8d77-eaaf650b6dc0 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-155767517", "availability_zone": "foo_zone"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:32.044946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.aggregate [None req-f8c2fee4-faec-4df4-8d77-eaaf650b6dc0 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Generated uuid 24c7ac53-fabe-44e8-80b0-23986d941e10 for aggregate {{(pid=131450) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 19 01:32:32.081736 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8c2fee4-faec-4df4-8d77-eaaf650b6dc0 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.205223 Oct 19 01:32:32.089537 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3024/6160] 10.222.0.27 () {60 vars in 1164 bytes} [Wed Oct 19 01:32:31 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:32.093699 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 01:32:32.094676 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:32.095428 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:32.103506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b82bc12-eec8-4744-a06e-9c0a1e5a9c13 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:32.116795 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7b82bc12-eec8-4744-a06e-9c0a1e5a9c13 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] [d46e49a9-e9ee-4a8b-a436-6d7de5ac9e93] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 01:32:33.101783 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35178. Oct 19 01:32:33.123075 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [None req-7b82bc12-eec8-4744-a06e-9c0a1e5a9c13 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] [d46e49a9-e9ee-4a8b-a436-6d7de5ac9e93] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35180. Oct 19 01:32:33.141037 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b82bc12-eec8-4744-a06e-9c0a1e5a9c13 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 1.049413 Oct 19 01:32:33.141831 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3137/6161] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 01:32:32 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.154943 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:33.158552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:33.159045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:33.159486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:33.160210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:33.160694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:33.161125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:33.179517 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35184. Oct 19 01:32:33.190439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b0ebfdb0-cc97-450a-86b1-aa573ab0ca88 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.040771 Oct 19 01:32:33.191062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3025/6162] 10.222.0.27 () {58 vars in 1176 bytes} [Wed Oct 19 01:32:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.203090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5eb35ecf-d524-45f2-8591-398e49e69a19 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:33.212880 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5eb35ecf-d524-45f2-8591-398e49e69a19 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013868 Oct 19 01:32:33.213444 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3138/6163] 10.222.0.27 () {58 vars in 1143 bytes} [Wed Oct 19 01:32:33 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.225035 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3623e442-e909-44bf-8a6e-ca3e3ad319ff tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-master-1"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:33.236490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3623e442-e909-44bf-8a6e-ca3e3ad319ff tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:33.237021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3623e442-e909-44bf-8a6e-ca3e3ad319ff tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:33.237469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3623e442-e909-44bf-8a6e-ca3e3ad319ff tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:33.427077 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3623e442-e909-44bf-8a6e-ca3e3ad319ff tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.205828 Oct 19 01:32:33.427810 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3026/6164] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 01:32:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.439085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2cace594-4aef-4cd5-9afe-fd5e27cde10e tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:33.447805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2cace594-4aef-4cd5-9afe-fd5e27cde10e tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.011991 Oct 19 01:32:33.448380 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3139/6165] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:32:33 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.459770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68ce37ab-6bee-42c8-ad56-e444eda79891 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1362020059", "availability_zone": "foo_zone"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:33.506481 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68ce37ab-6bee-42c8-ad56-e444eda79891 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.050406 Oct 19 01:32:33.507206 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3027/6166] 10.222.0.27 () {60 vars in 1173 bytes} [Wed Oct 19 01:32:33 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.520319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a027303d-92fc-4219-bd4e-faf2a91e2022 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:33.550531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a027303d-92fc-4219-bd4e-faf2a91e2022 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.035155 Oct 19 01:32:33.551309 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3140/6167] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 01:32:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.563473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ee5bd47-344c-4c66-9116-49beb4baa967 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:33.576859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ee5bd47-344c-4c66-9116-49beb4baa967 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017470 Oct 19 01:32:33.577586 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3028/6168] 10.222.0.27 () {58 vars in 1152 bytes} [Wed Oct 19 01:32:33 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.589484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c275d0a2-2550-4a91-a89a-8587c4e6ae94 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-master-1"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:33.601233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c275d0a2-2550-4a91-a89a-8587c4e6ae94 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:33.601727 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c275d0a2-2550-4a91-a89a-8587c4e6ae94 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:33.602173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c275d0a2-2550-4a91-a89a-8587c4e6ae94 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:33.813955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c275d0a2-2550-4a91-a89a-8587c4e6ae94 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.228658 Oct 19 01:32:33.821019 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3141/6169] 10.222.0.27 () {60 vars in 1194 bytes} [Wed Oct 19 01:32:33 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:33.827225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a188a827-eb01-4124-8dc1-d19f544c2254 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:33.868275 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a188a827-eb01-4124-8dc1-d19f544c2254 tempest-TestAggregatesBasicOps-521806638 tempest-TestAggregatesBasicOps-521806638-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.045212 Oct 19 01:32:33.869461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3029/6170] 10.222.0.27 () {58 vars in 1155 bytes} [Wed Oct 19 01:32:33 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 19 01:32:43.608684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b74751c7-a895-4812-bd64-8e2628c2c77f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Action: 'create', calling method: .version_select at 0x7f2aefd8e790>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1740962405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8ZeiGdhhaKkO2MaFeKFHo+88yVzlnpXamSiv/7PHmbrM9VqRqyb7e76AyDcympDYtEPs6xn0hmnqya5bt6MsKbyfEYwIGJNzsMk5V2lMf1S+us257cv5c2HdtbegCPwg=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:43.618700 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:43.627083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b74751c7-a895-4812-bd64-8e2628c2c77f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for project a7ac6d3676344922ab545146917e088b. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:32:43.632981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b74751c7-a895-4812-bd64-8e2628c2c77f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for user 2fe59c63cec74d209627ad37039aa4b8 and project a7ac6d3676344922ab545146917e088b. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:32:43.657268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b74751c7-a895-4812-bd64-8e2628c2c77f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.215304 Oct 19 01:32:43.657882 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3142/6171] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:32:43 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:49.266693 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:49.267589 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:49.268779 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:32:49.273195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-668646824-access_point-468122149", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "6995b356-d143-4758-8fa5-e87ac7ac7d6a"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1740962405", "security_groups": [{"name": "tempest-secgroup_access--1683786297"}, {"name": "tempest-secgroup_general--1111708549"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:49.477214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] validate_networks() for [('6995b356-d143-4758-8fa5-e87ac7ac7d6a', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:32:50.005876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:32:50.006411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:32:50.007211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:32:50.007753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:32:50.008413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:32:50.020978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:50.021797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:50.022522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:50.023598 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:50.024067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:50.024831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:50.051390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for project a7ac6d3676344922ab545146917e088b. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:32:50.058408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for user 2fe59c63cec74d209627ad37039aa4b8 and project a7ac6d3676344922ab545146917e088b. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:32:50.076451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:32:50.078635 n-d-master-1 devstack@n-api.service[131450]: WARNING nova.utils [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-668646824-access_point-468122149 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-668646824-acc Oct 19 01:32:50.079408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:32:50.132696 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bfbd3c07-0efc-421e-b42d-b5170e1bbe64 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.867596 Oct 19 01:32:50.140265 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3030/6172] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:32:49 2022] POST /compute/v2.1/servers => generated 458 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:32:50.146294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-267d08fa-813c-49aa-b108-6239f2f26bf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:50.146925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-267d08fa-813c-49aa-b108-6239f2f26bf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:50.209682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-267d08fa-813c-49aa-b108-6239f2f26bf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:50.216443 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-267d08fa-813c-49aa-b108-6239f2f26bf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1293 microversion: 2.1 time: 0.075001 Oct 19 01:32:50.217384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3143/6173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:50 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1293 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:51.240213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:51.240960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:51.249280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:51.249795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:51.250286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:51.251016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:51.251515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:51.251959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:51.326040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:51.334258 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43f4b8e6-0e38-455e-9acf-418030a8b4af tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1345 microversion: 2.1 time: 0.098166 Oct 19 01:32:51.334852 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3031/6174] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:51 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:52.360715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:52.361334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:52.368607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:52.369112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:52.369545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:52.370233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:52.370684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:52.371193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:52.440737 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:52.448481 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e921b597-d558-49cf-a48f-008afc86dc5f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1351 microversion: 2.1 time: 0.091733 Oct 19 01:32:52.449178 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3144/6175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:52 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:53.417241 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e4d6f-65d1-4655-aaaa-653b1832860d", "tag": "313bce9a-c3c3-4beb-bec7-7e33db474207"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:53.427749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:53.428246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:53.428719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:53.441327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] Creating event network-changed:313bce9a-c3c3-4beb-bec7-7e33db474207 for instance b21e4d6f-65d1-4655-aaaa-653b1832860d on n-h1-master-1 Oct 19 01:32:53.447289 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-bdf24ac9-56d5-4441-bfd5-9d986e0471b5 req-2ff3cc35-62e7-4fcf-81e4-4e1f8564fbe9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115930 Oct 19 01:32:53.447906 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3032/6176] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:53.472202 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:53.474687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:53.482912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:53.483409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:53.483851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:53.484559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:53.485056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:53.485698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:53.699554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:53.707598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2cb94c69-bf0d-4018-8828-5d277d55a966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1471 microversion: 2.1 time: 0.239355 Oct 19 01:32:53.708191 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3145/6177] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:53 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1471 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:54.732360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:54.733108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:54.739390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:54.739885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:54.740334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:54.741064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:54.741533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:54.741975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:54.883234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:54.891619 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f09aea48-6514-4fb8-912c-e7d1f97387c2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1471 microversion: 2.1 time: 0.164633 Oct 19 01:32:54.892203 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3033/6178] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:54 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:55.914339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:55.914884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:55.923389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:55.923875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:55.924330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:55.925064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:55.925529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:55.925963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:56.064961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:56.072998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9ede4db7-f972-4a5d-8c34-0090cd017638 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1471 microversion: 2.1 time: 0.162660 Oct 19 01:32:56.073604 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3146/6179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:55 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:57.095692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:57.096320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:57.103263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:57.103755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:57.104204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:57.104937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:57.105412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:57.105881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:57.246051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:57.255502 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-197d18c4-047b-4742-b6a8-cd06558c435e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1471 microversion: 2.1 time: 0.163663 Oct 19 01:32:57.256093 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3034/6180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:57 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:57.701171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e4d6f-65d1-4655-aaaa-653b1832860d", "name": "network-vif-plugged", "status": "completed", "tag": "313bce9a-c3c3-4beb-bec7-7e33db474207"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:32:57.710859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:57.711345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:57.711783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:57.722813 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] Creating event network-vif-plugged:313bce9a-c3c3-4beb-bec7-7e33db474207 for instance b21e4d6f-65d1-4655-aaaa-653b1832860d on n-h1-master-1 Oct 19 01:32:57.727851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5be1d98e-3c47-499c-b873-f5c115ede414 req-35de2275-dfba-446b-bb3c-fc56985174b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100405 Oct 19 01:32:57.728441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3147/6181] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:32:58.278819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:58.279757 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:58.286543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:58.287031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:58.287476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:58.288167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:58.288654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:58.289082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:58.431270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:58.439116 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91020ecb-f993-42fb-80a6-32465d5a26bd tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1471 microversion: 2.1 time: 0.164813 Oct 19 01:32:58.439693 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3035/6182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:58 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:59.464408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:59.465145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:59.471706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.472190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.472650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:59.473345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.473803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.474229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:59.618188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:59.626347 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-551ca7d2-edc9-4a32-bd02-cbfcaedcf551 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1643 microversion: 2.1 time: 0.167074 Oct 19 01:32:59.626939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3148/6183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:59 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1643 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:59.648844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:59.649470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:59.656873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.657361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.657804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:59.658499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.658957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.659387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:59.795686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:32:59.803447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb953c6d-a0e0-40d6-b8ab-83eb2d3757a8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1643 microversion: 2.1 time: 0.158478 Oct 19 01:32:59.804021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3036/6184] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:59 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1643 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:32:59.825736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:32:59.826459 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:32:59.833040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.833535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.833988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:32:59.834703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:32:59.835165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:32:59.835600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:00.075125 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32c224b6-7dd4-4084-bf58-3d9cb1d44a34 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1794 microversion: 2.1 time: 0.253339 Oct 19 01:33:00.075711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3149/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:32:59 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1794 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:01.959108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e4d6f-65d1-4655-aaaa-653b1832860d", "tag": "313bce9a-c3c3-4beb-bec7-7e33db474207"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:33:01.964120 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:01.964830 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:01.973205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:01.973694 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:01.974139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:01.986333 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] Creating event network-changed:313bce9a-c3c3-4beb-bec7-7e33db474207 for instance b21e4d6f-65d1-4655-aaaa-653b1832860d on n-h1-master-1 Oct 19 01:33:01.991671 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ab8e7989-10f9-4612-b8d4-43d4d88586e7 req-07dc5a7d-9c17-4058-bb84-4264c51ced2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036410 Oct 19 01:33:01.992742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3037/6186] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:33:43.619700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-688260420", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "fd423343-6fc3-4e72-9ae6-36baefd6620b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1740962405", "security_groups": []}, "os:scheduler_hints": {"different_host": ["b21e4d6f-65d1-4655-aaaa-653b1832860d"]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:33:43.645858 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:43.647991 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:43.648775 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=32 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:43.689936 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] validate_networks() for [('fd423343-6fc3-4e72-9ae6-36baefd6620b', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:33:44.176058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:33:44.176495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:33:44.176999 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:33:44.177418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:33:44.177838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:33:44.189022 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:44.189658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:44.190229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:44.191379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:44.191951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:44.192470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:44.212506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for project a7ac6d3676344922ab545146917e088b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:33:44.219216 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Getting quotas for user 2fe59c63cec74d209627ad37039aa4b8 and project a7ac6d3676344922ab545146917e088b. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:33:44.242181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:33:44.245129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:33:44.305755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f513059-dc52-4a71-9ca2-8c13a214ce29 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.690133 Oct 19 01:33:44.306807 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3150/6187] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:33:43 2022] POST /compute/v2.1/servers => generated 361 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:33:44.317321 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:44.318605 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=36 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:44.329669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea3168dc-32bc-4374-8c48-2eaa0860bb68 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:44.333310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea3168dc-32bc-4374-8c48-2eaa0860bb68 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:44.443168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ea3168dc-32bc-4374-8c48-2eaa0860bb68 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:44.454320 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea3168dc-32bc-4374-8c48-2eaa0860bb68 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1241 microversion: 2.1 time: 0.139309 Oct 19 01:33:44.454928 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3038/6188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:44 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:33:45.479043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:45.479895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:45.486615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:45.487266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:45.487795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:45.488598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:45.489150 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:45.489645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:45.559489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:45.569118 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b6ebac75-c5db-4f74-a86c-bf781e0809d0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1293 microversion: 2.1 time: 0.095160 Oct 19 01:33:45.570277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3151/6189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:45 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:46.596291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:46.597493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:46.605683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:46.607415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:46.607873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:46.608603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:46.609095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:46.609532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:46.770348 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:46.779340 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b88df69a-a7a7-4c7c-abaa-1529f162b798 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.186812 Oct 19 01:33:46.780219 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3039/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:46 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:47.509075 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdb552a-3764-4ef1-b255-f6ed1bcbfe11", "tag": "1a76c430-f820-4c6e-a488-15e76a4c3ae2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:33:47.525369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:47.526155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:47.526595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:47.540306 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] Creating event network-changed:1a76c430-f820-4c6e-a488-15e76a4c3ae2 for instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 on n-h2-master-1 Oct 19 01:33:47.546342 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dc7db17d-ba74-472f-9e9d-08e87fe93fd8 req-4a9b3d00-cdd6-4daf-8bf1-b9872ab04366 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043665 Oct 19 01:33:47.547545 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3152/6191] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:33:47.805862 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:47.806527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:47.814910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:47.815417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:47.816135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:47.816886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:47.817356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:47.817796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:47.921768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:47.929807 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5adcbdb-1d7b-41f0-9f46-c9eed589731d tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.128232 Oct 19 01:33:47.930606 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3040/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:47 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:48.964932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:48.965908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:48.973307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:48.973876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:48.974328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:48.975162 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:48.975666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:48.976099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:49.108648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:49.119409 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1e8c796-36b9-4784-b6d2-9ca7fce60b53 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.159962 Oct 19 01:33:49.120000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3153/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:48 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:50.148730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:50.149361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:50.157170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:50.157722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:50.158094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:50.158799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:50.159263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:50.159702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:50.252093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:50.259977 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-461d5103-1312-49af-9428-f7957e29cfc3 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.115280 Oct 19 01:33:50.260552 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3041/6194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:50 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:51.286630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:51.287246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:51.294853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:51.295342 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:51.295782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:51.296492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:51.296978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:51.297411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:51.390676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:51.398950 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27b183d2-406e-43e1-b16f-9a382f02d0ee tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.119776 Oct 19 01:33:51.399877 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3154/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:51 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:51.438797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdb552a-3764-4ef1-b255-f6ed1bcbfe11", "name": "network-vif-plugged", "status": "completed", "tag": "1a76c430-f820-4c6e-a488-15e76a4c3ae2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:33:51.452398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:51.453779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:51.454224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:51.468898 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] Creating event network-vif-plugged:1a76c430-f820-4c6e-a488-15e76a4c3ae2 for instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 on n-h2-master-1 Oct 19 01:33:51.474216 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4c755dc2-c203-43a7-9462-d38afe618c41 req-556035f2-c627-406a-acd8-62dbcd89f52e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040206 Oct 19 01:33:51.475179 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3042/6196] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:33:52.422861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:52.423512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:52.430335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:52.430814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:52.431246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:52.431932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:52.432384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:52.432833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:52.518719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:52.526598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06751d8b-ac8a-4963-9005-d3f1f24a63b2 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1299 microversion: 2.1 time: 0.107693 Oct 19 01:33:52.527183 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3155/6197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:52 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:53.551039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:53.551756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:53.560113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.560798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.561254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.561971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.562439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.562439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.656176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:53.664410 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc4f5665-3976-4616-88b4-3d6a77aac370 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1472 microversion: 2.1 time: 0.117709 Oct 19 01:33:53.665030 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3043/6198] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:53 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:53.688435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:53.689089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:53.695793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.696269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.696730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.697418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.697868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.698341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.789769 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:53.797711 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b13bdbbd-0989-4107-81bc-8a5f3f9fbdf8 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1472 microversion: 2.1 time: 0.114806 Oct 19 01:33:53.798304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3156/6199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:53 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:53.823359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:53.823982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:53.830455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.830939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.831377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.832071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.832520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.832976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.920219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-598b166a-0160-4843-9b45-e0f14079cf56 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1623 microversion: 2.1 time: 0.102288 Oct 19 01:33:53.920836 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3044/6200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:53 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:53.943282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:53.943869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:53.950269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.950755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.951195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:53.951890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:53.952349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:53.952813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:54.093486 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63e3a7ee-179a-47b4-89fa-30394086a111 tempest-TestSecurityGroupsBasicOps-1905818060 tempest-TestSecurityGroupsBasicOps-1905818060-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1912 microversion: 2.1 time: 0.154207 Oct 19 01:33:54.094078 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3157/6201] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:53 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1912 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:54.160992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:54.161508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:54.167533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:54.168049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:54.169050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:54.169759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:54.170227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:54.170667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:54.199517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:33:54.284929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5297f2b8-9416-44b2-aa2f-71d9c4197d2a tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 204 len: 0 microversion: 2.1 time: 0.129125 Oct 19 01:33:54.285524 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3045/6202] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:33:54 2022] DELETE /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:33:54.297599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:54.298224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:54.300262 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:54.300947 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:54.307167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:54.307660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:54.308103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:54.308883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:54.309461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:54.309848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:54.396994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:54.407617 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8939e66f-479a-49e3-acdd-d49011e409b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1478 microversion: 2.1 time: 0.117840 Oct 19 01:33:54.408206 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3158/6203] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:54 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1478 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:33:55.431315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:55.432023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:55.434688 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:33:55.441107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:55.441597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:55.442042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:55.442744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:55.443229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:55.443689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:55.524703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:55.533079 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4de90f5-6a4d-48dd-84d6-4547e58ff966 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1478 microversion: 2.1 time: 0.106007 Oct 19 01:33:55.533658 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3046/6204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:55 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1478 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:56.146750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdb552a-3764-4ef1-b255-f6ed1bcbfe11", "name": "network-vif-deleted", "tag": "1a76c430-f820-4c6e-a488-15e76a4c3ae2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:33:56.162930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:56.163448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:56.163851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:56.176958 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] Creating event network-vif-deleted:1a76c430-f820-4c6e-a488-15e76a4c3ae2 for instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 on n-h2-master-1 Oct 19 01:33:56.183070 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ac3b262d-dd80-4170-b81f-834a704c4cf6 req-0d32ee1a-133e-4efa-9bd1-730c8db8abd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040886 Oct 19 01:33:56.183763 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3159/6205] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:33:56.556772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:56.557344 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:56.564957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:56.565460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:56.566169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:56.566914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:56.567383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:56.567824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:56.600691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:56.601193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:56.601640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:56.602098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lazy-loading 'fault' on Instance uuid 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:33:56.650874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:33:56.661028 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee524242-3c49-4ff5-8c12-a8e1d61e65b9 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 200 len: 1331 microversion: 2.1 time: 0.108293 Oct 19 01:33:56.661663 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3047/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:56 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:33:57.685569 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:33:57.686281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:33:57.693711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:57.694143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:57.694585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:57.695290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:33:57.695750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:33:57.696183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:33:57.710287 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] HTTP exception thrown: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Request method failure captured: Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 HTTP/1.1 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1O6H4IdAtesh5VTd5s7fVKZfhkWNXTsLnnc-cVPLNsP_HNkTiCFsZZU_li_5LE6ZzVFGA539oXS69ktwEY_TBm486st4jCzGRg45hCAxy1hehLHLk1aaEV-QeTQZtrfsjgBgZVN31Hkv-wiM7s8wJkcPOxWo6OET88BPTwi48NOZI8 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a7ac6d3676344922ab545146917e088b Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7ac6d3676344922ab545146917e088b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7ac6d3676344922ab545146917e088b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7ac6d3676344922ab545146917e088b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7ac6d3676344922ab545146917e088b"}]}] Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a7ac6d3676344922ab545146917e088b Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestSecurityGroupsBasicOps-668646824-project Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2fe59c63cec74d209627ad37039aa4b8 Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestSecurityGroupsBasicOps-668646824-project Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '6bdb552a-3764-4ef1-b255-f6ed1bcbfe11'} Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:33:57.711918 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Returning 404 to user: Instance 6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c532acbd-0478-4545-a384-bf341fd68f8e tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11" status: 404 len: 111 microversion: 2.1 time: 0.032402 Oct 19 01:33:57.718435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3160/6207] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:33:57 2022] GET /compute/v2.1/servers/6bdb552a-3764-4ef1-b255-f6ed1bcbfe11 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:34:01.747544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:01.748647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:34:01.749462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e4d6f-65d1-4655-aaaa-653b1832860d", "tag": "313bce9a-c3c3-4beb-bec7-7e33db474207"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:34:01.757260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:01.757931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:01.758558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:01.759460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:01.759919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:01.760280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:01.760416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:01.761015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:01.761499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:01.781595 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] Creating event network-changed:313bce9a-c3c3-4beb-bec7-7e33db474207 for instance b21e4d6f-65d1-4655-aaaa-653b1832860d on n-h1-master-1 Oct 19 01:34:01.786851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-899bf438-4abf-40c8-905f-86201678f482 req-4286d269-cd2b-4a23-a60f-5c1ef0ca6cfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041520 Oct 19 01:34:01.787640 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3161/6208] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:34:01.796399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:34:01.895529 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4dde1681-c959-4fee-9c3c-572ca01ed99f tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 204 len: 0 microversion: 2.1 time: 0.152566 Oct 19 01:34:01.896991 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3048/6209] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:34:01 2022] DELETE /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:34:01.910620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:01.912982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:34:01.920986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:01.921491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:01.921966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:01.922867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:01.923335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:01.923773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:02.069754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:34:02.078192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a621c0e5-2d26-4e0d-a2de-5693a05b55cc tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1767 microversion: 2.1 time: 0.172252 Oct 19 01:34:02.078787 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3162/6210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:34:01 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1767 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:34:03.104193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:03.104935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:34:03.112015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:03.112505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:03.112989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:03.113687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:03.114148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:03.114581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:03.331869 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:34:03.339723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a7e933a-ef29-49dc-9b9e-69ba5626aa71 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1767 microversion: 2.1 time: 0.239869 Oct 19 01:34:03.340296 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3049/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:34:03 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1767 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:34:04.242306 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e4d6f-65d1-4655-aaaa-653b1832860d", "name": "network-vif-deleted", "tag": "313bce9a-c3c3-4beb-bec7-7e33db474207"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:34:04.254136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:04.254616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:04.255047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:04.268374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] Creating event network-vif-deleted:313bce9a-c3c3-4beb-bec7-7e33db474207 for instance b21e4d6f-65d1-4655-aaaa-653b1832860d on n-h1-master-1 Oct 19 01:34:04.274326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-99a1adc4-dc4d-4e15-b72d-8fb4a09812b9 req-64da915c-232c-44aa-99d9-d0434dba6f23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035430 Oct 19 01:34:04.275465 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3163/6212] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:34:04.362481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:04.363124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:34:04.370256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:04.370749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:04.371211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:04.371883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:04.372341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:04.372808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:04.404768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:04.405261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:04.405707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:04.406166 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lazy-loading 'fault' on Instance uuid b21e4d6f-65d1-4655-aaaa-653b1832860d {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:34:04.449882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe59c63cec74d209627ad37039aa4b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7ac6d3676344922ab545146917e088b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:34:04.457491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3beb0ae-eeb7-40e7-a0b7-9b5187890661 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 200 len: 1383 microversion: 2.1 time: 0.098891 Oct 19 01:34:04.458060 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3050/6213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:34:04 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 1383 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:34:05.482599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:05.484046 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] [instance: b21e4d6f-65d1-4655-aaaa-653b1832860d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:34:05.491313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:05.491796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:05.492230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:05.492954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:34:05.493407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:34:05.493834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:34:05.507318 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] HTTP exception thrown: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Request method failure captured: Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d HTTP/1.1 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1O6H4IdAtesh5VTd5s7fVKZfhkWNXTsLnnc-cVPLNsP_HNkTiCFsZZU_li_5LE6ZzVFGA539oXS69ktwEY_TBm486st4jCzGRg45hCAxy1hehLHLk1aaEV-QeTQZtrfsjgBgZVN31Hkv-wiM7s8wJkcPOxWo6OET88BPTwi48NOZI8 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: a7ac6d3676344922ab545146917e088b Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7ac6d3676344922ab545146917e088b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7ac6d3676344922ab545146917e088b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7ac6d3676344922ab545146917e088b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7ac6d3676344922ab545146917e088b"}]}] Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: a7ac6d3676344922ab545146917e088b Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-668646824 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestSecurityGroupsBasicOps-668646824-project Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 2fe59c63cec74d209627ad37039aa4b8 Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestSecurityGroupsBasicOps-668646824-project Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b21e4d6f-65d1-4655-aaaa-653b1832860d'} Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:34:05.508953 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Returning 404 to user: Instance b21e4d6f-65d1-4655-aaaa-653b1832860d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9081e2c8-72df-49d6-af89-71d4b1313528 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d" status: 404 len: 111 microversion: 2.1 time: 0.032402 Oct 19 01:34:05.514808 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3164/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:34:05 2022] GET /compute/v2.1/servers/b21e4d6f-65d1-4655-aaaa-653b1832860d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:34:08.941835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bccbaa56-9f8d-4b09-9549-a8fbab13f0b0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] Calling method '.version_select at 0x7f2af433ab80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:34:08.969525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bccbaa56-9f8d-4b09-9549-a8fbab13f0b0 tempest-TestSecurityGroupsBasicOps-668646824 tempest-TestSecurityGroupsBasicOps-668646824-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1740962405" status: 202 len: 0 microversion: 2.1 time: 0.031896 Oct 19 01:34:08.970050 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3051/6215] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 01:34:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1740962405 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:36:19.624035 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 01:36:19.624843 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:19.625715 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=62 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:19.626917 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 01:36:19.627074 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Oct 19 01:36:19.628298 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 01:36:19.628417 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:36:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.27) !!! Oct 19 01:36:19.633112 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63439271-d923-4fca-84e9-e2d5dcc1a57b tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Action: 'create', calling method: .version_select at 0x7f2aefb29c10>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1103687383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMW9Kl5h/cPnygMBP7SQCBjhHC/7amxuacloQM88ZhufJhgquZWv864w8u8kZiIwVDD58nZr70nNKGnIp5oVrnP+DpiO5Lx+DZZg/jU12daTesAAnAFqimHAnodycTJCA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:19.655448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-63439271-d923-4fca-84e9-e2d5dcc1a57b tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Getting quotas for project 9c8a6e501b284d1bafc463395f521af2. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:36:19.660605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-63439271-d923-4fca-84e9-e2d5dcc1a57b tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Getting quotas for user c05a2a0da15d4138ac68c45a9ef46d01 and project 9c8a6e501b284d1bafc463395f521af2. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:36:19.688138 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63439271-d923-4fca-84e9-e2d5dcc1a57b tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066272 Oct 19 01:36:19.688762 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3165/6216] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:36:19 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:36:20.635468 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 01:36:20.636102 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:36:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 19 01:36:20.638642 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:20.639550 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:20.643866 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1345479661", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "98f44169-842f-49a1-8d62-a09b50cfe1cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1103687383", "security_groups": [{"name": "tempest-secgroup-smoke-832822716"}], "networks": [{"uuid": "4b0317a7-c279-4032-9e91-7a1395cabec8"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:20.987215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] validate_networks() for [('4b0317a7-c279-4032-9e91-7a1395cabec8', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:36:21.458548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:36:21.458971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:36:21.459448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:36:21.459860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:36:21.460275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:36:21.470144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:21.470628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:21.471110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:21.471833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:21.472287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:21.472759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:21.490171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Getting quotas for project 9c8a6e501b284d1bafc463395f521af2. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:36:21.495546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Getting quotas for user c05a2a0da15d4138ac68c45a9ef46d01 and project 9c8a6e501b284d1bafc463395f521af2. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:36:21.553708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:36:21.555860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98f44169-842f-49a1-8d62-a09b50cfe1cc',volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:36:21.685840 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d340a60-d77c-4fcd-87bb-79b74f1394d4 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.053129 Oct 19 01:36:21.686785 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3052/6217] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:36:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:36:21.699785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68349e6a-69a8-4a8c-b954-97e05af9d878 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:21.700515 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68349e6a-69a8-4a8c-b954-97e05af9d878 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:21.711695 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36806. Oct 19 01:36:21.816027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-68349e6a-69a8-4a8c-b954-97e05af9d878 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:21.824961 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68349e6a-69a8-4a8c-b954-97e05af9d878 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1099 microversion: 2.1 time: 0.129865 Oct 19 01:36:21.825576 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3166/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:21 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1099 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:22.848306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:22.848979 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:22.855409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:22.855911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:22.856362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:22.857111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:22.857573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:22.858006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:22.923006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:22.930801 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f6bdb1f-36dc-4c9f-868e-a4b11be99d54 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1197 microversion: 2.1 time: 0.087257 Oct 19 01:36:22.931388 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3053/6219] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:22 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:23.957349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:23.959460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:23.969198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:23.969905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:23.970529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:23.971255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:23.971721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:23.972157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:24.166292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:24.174404 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e39f405c-699b-450d-a0b2-d9d6ac621a3e tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1282 microversion: 2.1 time: 0.223270 Oct 19 01:36:24.189040 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3167/6220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:23 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:24.514794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:24.528469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:24.529009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:24.529458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:24.542138 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] Creating event network-changed:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:36:24.547600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d83ba5fb-0f31-477f-8e5f-8446097f4060 req-82f6a6c2-ab34-4651-9808-2243c6794830 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037525 Oct 19 01:36:24.548701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3054/6221] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:36:25.197697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:25.199311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:25.206401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:25.206972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:25.207482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:25.208320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:25.208876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:25.209520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:25.434376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:25.442447 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f70b2272-e1dc-406f-8ca5-1ad30ccc2a1a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1282 microversion: 2.1 time: 0.248370 Oct 19 01:36:25.443031 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3168/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:25 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1282 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:26.466675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:26.467299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:26.473782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:26.474267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:26.474707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:26.475571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:26.476031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:26.476458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:26.612442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:26.620858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e370662-18c7-4a7f-913f-81a2f142ffdc tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1282 microversion: 2.1 time: 0.159127 Oct 19 01:36:26.621622 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3055/6223] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:26 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:27.643499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:27.644121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:27.651369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:27.652559 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:27.653057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:27.653878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:27.654421 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:27.654948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:27.798250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:27.806131 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06b1f7c5-72dc-47af-9a84-29f70b027550 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1282 microversion: 2.1 time: 0.166643 Oct 19 01:36:27.806811 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3169/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:27 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:28.830123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:28.830750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:28.837670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:28.838161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:28.838612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:28.839999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:28.840461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:28.840930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:28.974486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:28.982857 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-228d0b8f-8f15-46f3-b8b5-9da583897894 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.156652 Oct 19 01:36:28.983479 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3056/6225] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:28 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:30.006250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:30.006880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:30.014457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:30.014945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:30.015391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:30.016093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:30.016561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:30.017021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:30.150700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:30.158571 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-95074e56-7b23-4795-86a7-ac7439c556d7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.156267 Oct 19 01:36:30.159141 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3170/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:30 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:31.181490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:31.182112 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:31.188990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:31.189476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:31.189924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:31.190627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:31.191087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:31.191522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:31.320467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:31.329267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0ca5c00-d3dd-43ff-869a-828d0f1d71f0 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.151668 Oct 19 01:36:31.329847 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3057/6227] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:31 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:32.352525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:32.353186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:32.356047 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:32.361812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:32.362306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:32.362750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:32.363449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:32.363911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:32.364346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:32.493578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:32.502194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41bd2621-a31d-45f5-ac66-d53b25e2265c tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.153608 Oct 19 01:36:32.502770 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3171/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:32 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:33.525308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:33.526295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:33.529143 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:33.529941 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:36:33.535990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:33.536491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:33.536966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:33.537676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:33.538140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:33.538571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:33.673320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:33.681100 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19cb06a3-591a-4a09-8ff9-0859163f1c65 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.159736 Oct 19 01:36:33.681691 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3058/6229] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:33 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:34.705019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:34.705640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:34.712313 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:34.712852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:34.713292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:34.713986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:34.714442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:34.714870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:34.844585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:34.852342 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f166f0a-123d-4a6f-ad7f-93805732b6cb tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.151364 Oct 19 01:36:34.852962 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3172/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:34 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:35.875579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:35.876190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:35.882994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:35.883476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:35.883917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:35.884603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:35.885079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:35.885504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:36.021449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:36.029285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1489db79-9950-4178-93aa-0cd5e34d31e1 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.157806 Oct 19 01:36:36.029870 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3059/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:35 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:37.054820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:37.055522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:37.063406 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:37.063902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:37.064343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:37.065078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:37.065542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:37.065977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:37.202156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:37.210429 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eea74be0-8a24-401e-966c-7d760e9a7762 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.161387 Oct 19 01:36:37.210946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3173/6232] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:37 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:38.235278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:38.235938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:38.242535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:38.243027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:38.243475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:38.244175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:38.244663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:38.245137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:38.374122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:38.381915 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77350471-5b8c-4976-84e3-2f77599b6818 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.151486 Oct 19 01:36:38.382647 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3060/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:38 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:38.598003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "name": "network-vif-plugged", "status": "completed", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:38.608584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:38.609107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:38.609540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:38.620581 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] Creating event network-vif-plugged:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:36:38.625872 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2b0bd96a-c3a1-469e-9887-b7931dd00126 req-66382c8f-a0f2-403b-a402-36116a120318 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031659 Oct 19 01:36:38.626656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3174/6234] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:36:39.405124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:39.405746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:39.412679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:39.413177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:39.413626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:39.414328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:39.414793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:39.415233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:39.549772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:39.557649 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cc7d2642-8b74-4d58-a511-041263086872 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1270 microversion: 2.1 time: 0.156700 Oct 19 01:36:39.558229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3061/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:39 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:40.583446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:40.584154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:40.590431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:40.590959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:40.591412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:40.592106 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:40.592565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:40.593030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:40.729660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:40.737821 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3865e18-7632-4be5-86c3-ca19d50fde53 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1459 microversion: 2.1 time: 0.159573 Oct 19 01:36:40.738405 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3175/6236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:40 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1459 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:40.760733 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:36:40.761339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:36:40.769244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:40.769738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:40.770177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:40.770872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:40.771325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:40.771753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:40.903539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:36:40.911361 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-06a4bf5f-c75d-4343-ae61-562e53f18b75 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1459 microversion: 2.1 time: 0.154559 Oct 19 01:36:40.911950 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3062/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:36:40 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:36:42.535330 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:42.546003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:42.546485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:42.546911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:42.558401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] Creating event network-changed:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:36:42.563641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1a9d4915-bc16-46ab-b965-d0b3550283ee req-02a3d0bc-ce67-4ba2-9ab2-d6b97b3610c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031976 Oct 19 01:36:42.567656 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3176/6238] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:36:44.579997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}, {"name": "network-changed", "server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:36:44.592119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:36:44.592607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:36:44.593224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:36:44.604392 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Creating event network-changed:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:36:44.604949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] Creating event network-changed:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:36:44.610582 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8c20fc91-0c1a-44bc-b522-2b926866eb5d req-837c3ae3-c3d6-4c3e-9050-6840427a4beb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035033 Oct 19 01:36:44.611430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3063/6239] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:37:18.118933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:18.119487 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:18.119911 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=60 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:18.120190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:18.123939 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:18.124183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:37:18.124860 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=52 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:18.130509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:18.131211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:18.131649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:18.132351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:18.132844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:18.133524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:18.135230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:18.135658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:18.136262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:18.149888 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] Creating event network-changed:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:37:18.155830 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c48d5c40-c90a-4520-85fd-ba313fed0d5e req-56db8b7a-723b-4c49-a8a9-00d6369dbf45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038650 Oct 19 01:37:18.156448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3064/6240] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:37:18.162414 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:37:18.247361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b520a32-ae98-49e0-8e70-f2454a1d325a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 204 len: 0 microversion: 2.1 time: 0.132342 Oct 19 01:37:18.248750 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3177/6241] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:37:18 2022] DELETE /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:37:18.258339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:18.259061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:18.265284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:18.265800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:18.266229 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:18.266930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:18.267396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:18.267840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:18.407382 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:18.415939 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8e078dc-b845-432b-8061-34b70c394e12 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1584 microversion: 2.1 time: 0.162923 Oct 19 01:37:18.416533 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3065/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:18 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1584 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:19.441245 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:19.441970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:19.449883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:19.450379 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:19.450830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:19.451536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:19.451999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:19.452435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:19.663338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:19.671133 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4a262d7b-c07c-4b61-86e2-c30621168b38 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1584 microversion: 2.1 time: 0.234383 Oct 19 01:37:19.671715 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3178/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:19 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1584 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:20.698119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:20.698937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:20.706332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:20.707084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:20.707541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:20.708264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:20.709471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:20.709909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:20.743550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae652b12-6603-4901-98da-34ba925ca6a6", "name": "network-vif-deleted", "tag": "1980d51c-372c-45f8-abaf-9f857209c162"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:37:20.756033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:20.756526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:20.757189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:20.769015 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] Creating event network-vif-deleted:1980d51c-372c-45f8-abaf-9f857209c162 for instance ae652b12-6603-4901-98da-34ba925ca6a6 on n-h1-master-1 Oct 19 01:37:20.774531 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-efd78ada-5f8b-4405-8cb3-8d3d871918f9 req-d1798dad-98c3-4cd9-8400-86063c8d401f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035384 Oct 19 01:37:20.775190 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3179/6244] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:37:20.779377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:20.788599 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38154d55-504b-4fbe-91d2-867cb7b6afcd tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1398 microversion: 2.1 time: 0.095794 Oct 19 01:37:20.789222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3066/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:20 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1398 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:21.814176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:21.814789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:21.821921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:21.822402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:21.822837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:21.823528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:21.823980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:21.824403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:21.886742 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:21.894562 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18c4d61b-acbb-4ea6-be7f-bcebd68a7d43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1230 microversion: 2.1 time: 0.085781 Oct 19 01:37:21.895135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3180/6246] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:21 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1230 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:22.918438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:22.919090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:22.926502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:22.926991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:22.928673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:22.929397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:22.929865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:22.930302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:23.004584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:23.013784 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-40c90962-c933-4d4d-b1bc-00a7289983a7 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1230 microversion: 2.1 time: 0.099221 Oct 19 01:37:23.014577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3067/6247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:22 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:24.038052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:24.038683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:24.045887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:24.046381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:24.046821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:24.047532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:24.047988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:24.048419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:24.122895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:24.131673 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-416eaf71-ea09-495e-9168-429e48457264 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1230 microversion: 2.1 time: 0.097809 Oct 19 01:37:24.132262 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3181/6248] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:24 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:25.154915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:25.155539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:25.162576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:25.163063 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:25.163511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:25.164211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:25.164704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:25.165142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:25.199156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:25.199642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:25.200090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:25.200544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lazy-loading 'fault' on Instance uuid ae652b12-6603-4901-98da-34ba925ca6a6 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:37:25.241488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05a2a0da15d4138ac68c45a9ef46d01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8a6e501b284d1bafc463395f521af2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:25.249182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57d8ae0e-62b8-4f51-a9cc-6408aeae348a tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 200 len: 1235 microversion: 2.1 time: 0.098181 Oct 19 01:37:25.249771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3068/6249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:25 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 1235 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:26.274489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:26.275109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [instance: ae652b12-6603-4901-98da-34ba925ca6a6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:26.281978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:26.282466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:26.282912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:26.283612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:26.284073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:26.284504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:26.298415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] HTTP exception thrown: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Request method failure captured: Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 HTTP/1.1 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1QhfSkZc6WeP5WBPKpUEJ85DejSLGr5gbE0Q91LjfKZ1gN1-4Oxq6EWilbllI0vSfXZaVgQidvPRyD-lZ7U-lf7ktL5e_n1bajmeSCNnzLR-1ZedZLAaZrP_h_rc_7cWtxDDACF9mVkYOltDgK57dY31PP74SIeQ5Gd6Nc5hJYNIhc Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 9c8a6e501b284d1bafc463395f521af2 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBackupRestore-1619675153 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c8a6e501b284d1bafc463395f521af2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c8a6e501b284d1bafc463395f521af2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c8a6e501b284d1bafc463395f521af2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c8a6e501b284d1bafc463395f521af2"}]}] Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBackupRestore-1619675153 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 9c8a6e501b284d1bafc463395f521af2 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1619675153 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBackupRestore-1619675153-project Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c05a2a0da15d4138ac68c45a9ef46d01 Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBackupRestore-1619675153-project Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: exception: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'ae652b12-6603-4901-98da-34ba925ca6a6'} Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:37:26.300045 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Returning 404 to user: Instance ae652b12-6603-4901-98da-34ba925ca6a6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0474ef41-c8a4-4197-88f5-71be13dd0c43 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6" status: 404 len: 111 microversion: 2.1 time: 0.031591 Oct 19 01:37:26.305602 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3182/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:26 2022] GET /compute/v2.1/servers/ae652b12-6603-4901-98da-34ba925ca6a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:37:26.464308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ce23736-0712-4e9f-b510-6bf0ea8a60f5 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] Calling method '.version_select at 0x7f2af4f7bd30>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:26.468764 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9ce23736-0712-4e9f-b510-6bf0ea8a60f5 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [5a505948-7c5d-4797-a5fe-d13aad3bbb9e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 01:37:27.479001 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [None req-9ce23736-0712-4e9f-b510-6bf0ea8a60f5 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] [5a505948-7c5d-4797-a5fe-d13aad3bbb9e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 36912. Oct 19 01:37:27.499483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ce23736-0712-4e9f-b510-6bf0ea8a60f5 tempest-TestVolumeBackupRestore-1619675153 tempest-TestVolumeBackupRestore-1619675153-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1103687383" status: 202 len: 0 microversion: 2.1 time: 1.039260 Oct 19 01:37:27.500079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3069/6251] 10.222.0.27 () {58 vars in 1269 bytes} [Wed Oct 19 01:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1103687383 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 01:37:51.144897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-263593372", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "83d18898-fb29-4d12-bfe7-47acb37ed068", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:37:51.157001 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:51.157680 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:51.214175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:37:51.621369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:37:51.621834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:37:51.622321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:37:51.622761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:37:51.623366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:37:51.633699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:51.634191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:51.634635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:51.635371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:51.635828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:51.636247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:51.653842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:37:51.659073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:37:51.720162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:37:51.722325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='83d18898-fb29-4d12-bfe7-47acb37ed068',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:37:51.887559 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2ed3e58-efec-485e-a6f4-7826889d2118 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746607 Oct 19 01:37:51.888655 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3183/6252] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:37:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:37:51.898323 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=28 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:51.900045 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:37:51.905754 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b0bb770-38f6-4ed6-a89c-3040751b2d3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:51.909095 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b0bb770-38f6-4ed6-a89c-3040751b2d3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:51.972957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b0bb770-38f6-4ed6-a89c-3040751b2d3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:51.980350 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b0bb770-38f6-4ed6-a89c-3040751b2d3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1056 microversion: 2.1 time: 0.084072 Oct 19 01:37:51.981050 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3070/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:51 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1056 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:53.004572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:53.005234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:53.013139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:53.013401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:53.013837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:53.014541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:53.015075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:53.015400 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:53.096948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:53.108108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d9449ee-7d6e-48ce-b0e2-8bc3476e5c99 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1162 microversion: 2.1 time: 0.108588 Oct 19 01:37:53.124881 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3184/6254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:52 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1162 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:54.141532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:54.142171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:54.157755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:54.163650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:54.164129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:54.165747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:54.166390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:54.166841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:54.685561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:54.694571 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-50d8fa39-9430-4261-9dcb-652028973ca6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1214 microversion: 2.1 time: 0.566791 Oct 19 01:37:54.695367 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3071/6255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:54 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1214 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:55.373609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d99d679-ea7b-418b-8039-a1388eb19cd9", "tag": "0fc58150-e83b-438b-be32-2e1975d0d106"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:37:55.384532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:55.385352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:55.385858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:55.399109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] Creating event network-changed:0fc58150-e83b-438b-be32-2e1975d0d106 for instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 on n-h1-master-1 Oct 19 01:37:55.404850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b899e678-0fc2-4b7e-bed9-687e3eb6d4cb req-24f2f655-41e9-4ac1-a82d-7aad3db2663d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182966 Oct 19 01:37:55.406076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3185/6256] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:37:55.724018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:55.725688 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:55.735385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:55.736421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:55.736903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:55.737649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:55.738188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:55.739237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:55.975857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:55.984100 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9ae4f63-ba6f-4ebd-85d4-e4d64f59ac77 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1214 microversion: 2.1 time: 0.268179 Oct 19 01:37:55.984968 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3072/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:55 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:57.009253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:57.009950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:57.016054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:57.016537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:57.016993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:57.017680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:57.018132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:57.018556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:57.152921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:57.161760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cb1a6d9f-0473-4a48-b52d-3df51193e004 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1214 microversion: 2.1 time: 0.158099 Oct 19 01:37:57.162356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3186/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:57 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1214 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:58.185690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:58.186516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:58.194334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:58.195370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:58.195828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:58.196578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:58.197071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:58.197512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:58.345224 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:58.354443 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-863c6932-9d21-448b-8a75-1665283ee00d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1214 microversion: 2.1 time: 0.172665 Oct 19 01:37:58.355032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3073/6259] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:58 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:37:59.378589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:37:59.380071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:37:59.387204 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:59.387677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:59.388111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:59.388831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:37:59.389285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:37:59.389709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:37:59.518607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:37:59.526651 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-170be4aa-b58c-49ba-9f02-140ed6a5c2d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.152327 Oct 19 01:37:59.527232 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3187/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:37:59 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:00.550672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:00.551449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:00.558919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:00.559405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:00.559841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:00.560539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:00.561066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:00.561491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:00.694807 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:00.702575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78242ca7-2535-4eed-9b0c-174c3536e699 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.155831 Oct 19 01:38:00.703153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3074/6261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:00 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:01.726321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:01.726950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:01.730330 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:01.731011 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:01.737874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:01.738364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:01.738836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:01.739535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:01.740058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:01.740581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:01.871482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:01.879381 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ac0fbab6-0415-488a-adbf-7840d47e8739 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.157154 Oct 19 01:38:01.880018 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3188/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:01 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:02.903118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:02.903676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:02.906470 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:02.912904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:02.913468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:02.913953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:02.914666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:02.915133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:02.915600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:03.048010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:03.056634 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-feb45c7d-eaa8-445b-b87b-988480b89d5a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.157479 Oct 19 01:38:03.057235 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3075/6263] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:02 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:04.079366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:04.079990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:04.087088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:04.087575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:04.088015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:04.088793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:04.089240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:04.089672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:04.218814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:04.227790 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-85c8758d-42a0-482e-b93f-651582941203 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.151564 Oct 19 01:38:04.228397 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3189/6264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:04 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:05.250251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:05.250875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:05.257624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:05.258765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:05.259225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:05.259935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:05.260403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:05.260880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:05.391129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:05.399251 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f96510f-2f98-4641-9620-1446f9975cdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.152830 Oct 19 01:38:05.400709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3076/6265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:05 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:06.422811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:06.423429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:06.430867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:06.431348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:06.431782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:06.432472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:06.432947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:06.433372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:06.565001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:06.573674 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ed83b76e-5a2a-4abc-b576-c499c2ad2590 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.154802 Oct 19 01:38:06.574259 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3190/6266] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:06 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:07.596352 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:07.597037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:07.603890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:07.604380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:07.604854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:07.605559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:07.606023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:07.606463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:07.735777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:07.743671 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3d1cd28-6be1-49ad-86c7-f08e50e8c7a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.151195 Oct 19 01:38:07.744259 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3077/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:07 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:08.767101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:08.767649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:08.774638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:08.775123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:08.775568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:08.776267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:08.776755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:08.777187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:08.915289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:08.923343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8cad2f2f-4f3e-40c9-8aed-6cc1c816b8ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.160301 Oct 19 01:38:08.923926 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3191/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:08 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:38:09.102059 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99d679-ea7b-418b-8039-a1388eb19cd9", "name": "network-vif-plugged", "status": "completed", "tag": "0fc58150-e83b-438b-be32-2e1975d0d106"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:09.111683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:09.112171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:09.112612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:09.124063 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] Creating event network-vif-plugged:0fc58150-e83b-438b-be32-2e1975d0d106 for instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 on n-h1-master-1 Oct 19 01:38:09.129090 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3025aae6-721f-4e64-a057-d384287d85ee req-e8004d84-9c26-4d72-bbb2-b0913410b3d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109396 Oct 19 01:38:09.129667 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3078/6269] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:38:09.947824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:09.948367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:09.955308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:09.955798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:09.956243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:09.956972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:09.957433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:09.957865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:10.085373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:10.093973 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3c8f982c-607b-40f5-ba82-2df3a86cfe41 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1202 microversion: 2.1 time: 0.150780 Oct 19 01:38:10.094560 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3192/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:09 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:11.118493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:11.119208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:11.125469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.125967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.126425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.127120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.127595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.128035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.260236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:11.268203 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd2bb31f-1d10-4cf3-9f8f-51911fd2f8cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1388 microversion: 2.1 time: 0.155132 Oct 19 01:38:11.268805 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3079/6271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:11 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:11.291620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:11.292237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:11.299148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.299631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.300073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.300814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.301314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.301685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.430177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:11.437879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d4ab56cc-0f1e-41d7-91da-648902055528 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1388 microversion: 2.1 time: 0.150777 Oct 19 01:38:11.438462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3193/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:11 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:11.461891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:11.462522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:11.468534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.469062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.469513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.470237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.470710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.471149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.603702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:11.611587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53042667-edba-47f1-beee-8b85ded96ff1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1388 microversion: 2.1 time: 0.154367 Oct 19 01:38:11.612173 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3080/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:11 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1388 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:11.633864 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:11.634720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:11.640701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.641198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.641647 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.642355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.642822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.643259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.669542 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:38:11.745966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4da15528-720d-4293-b822-3fa978ac375c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 204 len: 0 microversion: 2.1 time: 0.115748 Oct 19 01:38:11.746578 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3194/6274] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:38:11 2022] DELETE /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:38:11.755421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:11.756050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:11.762177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.762661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.763109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.763815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:11.764284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:11.764758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:11.891062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:11.899357 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9cbe05a7-fa8b-46f8-a0cb-1b8a10b06023 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1394 microversion: 2.1 time: 0.148382 Oct 19 01:38:11.899939 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3081/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:11 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1394 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:12.923849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:12.924554 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:12.932160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:12.932668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:12.933115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:12.933813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:12.934273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:12.934703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:13.328431 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:13.336706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6231dd4d-789b-4a7b-a909-c64854a0e2dc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1394 microversion: 2.1 time: 0.416867 Oct 19 01:38:13.337285 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3195/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:12 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1394 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:14.004806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d99d679-ea7b-418b-8039-a1388eb19cd9", "name": "network-vif-deleted", "tag": "0fc58150-e83b-438b-be32-2e1975d0d106"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:14.015925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:14.016377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:14.017006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:14.029540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] Creating event network-vif-deleted:0fc58150-e83b-438b-be32-2e1975d0d106 for instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 on n-h1-master-1 Oct 19 01:38:14.034654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b9dd5e67-2e28-4d11-9587-377affe06a7a req-af189191-3613-4bdc-b9d3-d74b06acd53e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033536 Oct 19 01:38:14.035603 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3082/6277] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:38:14.359592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:14.360201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:14.367105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:14.368137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:14.368574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:14.369287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:14.369743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:14.370160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:14.431838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:14.439682 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b3da5f6-1016-4792-96b2-8e1a24333731 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1187 microversion: 2.1 time: 0.084242 Oct 19 01:38:14.440247 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3196/6278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:14 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:15.464779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:15.465481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:15.471721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:15.472204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:15.472659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:15.473356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:15.473824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:15.474252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:15.540809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:15.548758 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-114fc1cd-d304-4515-b153-293ba0a77916 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1187 microversion: 2.1 time: 0.089881 Oct 19 01:38:15.549347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3083/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:15 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:16.573685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:16.574314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:16.581534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:16.582023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:16.582465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:16.583170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:16.583634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:16.584066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:16.645606 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:16.654341 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d525f089-6f2b-4dc3-a3bc-6c4462f0fdf7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1187 microversion: 2.1 time: 0.085102 Oct 19 01:38:16.654932 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3197/6280] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:16 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:17.679372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:17.680050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:17.687616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:17.688118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:17.688572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:17.689321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:17.689788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:17.690224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:17.762204 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:17.771272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86937d43-8d16-488b-96a1-cedfdabbe264 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 200 len: 1187 microversion: 2.1 time: 0.095680 Oct 19 01:38:17.772023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3084/6281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:17 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:18.796524 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:18.797176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4d99d679-ea7b-418b-8039-a1388eb19cd9] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:18.804003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:18.805147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:18.805599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:18.806304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:18.806765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:18.807196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:18.820756 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 HTTP/1.1 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '4d99d679-ea7b-418b-8039-a1388eb19cd9'} Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:38:18.822445 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 4d99d679-ea7b-418b-8039-a1388eb19cd9 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-220909b5-6dcf-4e6c-a97c-d9d48837367a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9" status: 404 len: 111 microversion: 2.1 time: 0.031243 Oct 19 01:38:18.826411 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3198/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:18 2022] GET /compute/v2.1/servers/4d99d679-ea7b-418b-8039-a1388eb19cd9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:38:23.798085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1414631618", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fd7dc9bb-fa5a-4f7d-86a4-3b857160a691", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:23.808947 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=33 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:23.859168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:38:24.242359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:38:24.242794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:38:24.243281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:38:24.243698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:38:24.244119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:38:24.253181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:24.253669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:24.254136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:24.254864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:24.255323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:24.255755 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:24.262007 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=77 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:24.275372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:38:24.280608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:38:24.340423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:38:24.342837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fd7dc9bb-fa5a-4f7d-86a4-3b857160a691',volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:38:24.469569 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee18dfe4-b9df-4933-bf2e-c17d427f7d57 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675307 Oct 19 01:38:24.470226 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3085/6283] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:38:24.481433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f154fd78-6e40-4bcb-a087-ae9313c9f01e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:24.482050 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f154fd78-6e40-4bcb-a087-ae9313c9f01e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:24.484690 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:24.543121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f154fd78-6e40-4bcb-a087-ae9313c9f01e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:24.550247 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f154fd78-6e40-4bcb-a087-ae9313c9f01e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1057 microversion: 2.1 time: 0.072842 Oct 19 01:38:24.550821 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3199/6284] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:24 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1057 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:25.576055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:25.576731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:25.584261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:25.584783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:25.585234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:25.586941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:25.587463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:25.587910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:25.656970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:25.666241 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a204d5c7-5da5-4db8-8478-e4ae69d02446 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1155 microversion: 2.1 time: 0.095744 Oct 19 01:38:25.667158 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3086/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:25 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1155 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:26.691794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:26.693358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:26.702782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:26.703512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:26.703964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:26.704705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:26.705173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:26.705613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:26.708816 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:26.902135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:26.910196 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a56ed648-25b8-4f36-a622-697b7c5740f5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1215 microversion: 2.1 time: 0.223698 Oct 19 01:38:26.925513 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3200/6286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:26 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:27.232338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6fbc75d-0ce0-4315-858f-d272df3d855c", "tag": "1b9c3fcd-6f88-4a02-8ffa-41ac2235b811"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:27.244776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:27.245431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:27.246866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:27.261830 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] Creating event network-changed:1b9c3fcd-6f88-4a02-8ffa-41ac2235b811 for instance c6fbc75d-0ce0-4315-858f-d272df3d855c on n-h1-master-1 Oct 19 01:38:27.267307 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a1373fe8-ac5c-4de2-ab8d-b3bc36b3c8ad req-f7cbbf5f-fec3-4f92-91ee-b266c3c8697a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038694 Oct 19 01:38:27.267920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3087/6287] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:38:27.935329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:27.936192 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:27.943743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:27.944325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:27.945769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:27.946549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:27.947006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:27.947600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:28.150402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:28.159559 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c704dbb-fd34-48a7-995a-3403883b5488 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1215 microversion: 2.1 time: 0.228908 Oct 19 01:38:28.160165 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3201/6288] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:27 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:29.184454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:29.185200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:29.192738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:29.193234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:29.193678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:29.194384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:29.195546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:29.195994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:29.327791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:29.335851 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9dcb2846-2814-4de0-853b-de6de40dfbc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1215 microversion: 2.1 time: 0.156238 Oct 19 01:38:29.336432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3088/6289] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:29 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:30.358971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:30.359591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:30.367050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:30.367547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:30.367993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:30.368734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:30.369199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:30.369631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:30.513668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:30.521832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d16a786a-f9e3-4e7c-bd28-e4e41d606cc1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1215 microversion: 2.1 time: 0.166995 Oct 19 01:38:30.522441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3202/6290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:30 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:31.545629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:31.546304 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:31.553156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:31.553641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:31.554845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:31.555555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:31.556009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:31.556440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:31.684633 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:31.692657 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ecbd63fd-6af1-4b38-9459-b9f38739639c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.150657 Oct 19 01:38:31.693231 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3089/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:31 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:32.716030 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:32.716681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:32.723919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:32.724413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:32.724887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:32.725596 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:32.726947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:32.727401 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:32.856338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:32.864082 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b06bbffe-d3cc-405e-96d1-ab810acfa22e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.152011 Oct 19 01:38:32.864680 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3203/6292] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:32 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:38:33.888088 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:33.888793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:33.895383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:33.895966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:33.896375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:33.897144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:33.897613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:33.898106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:34.025661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:34.033429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-83260543-c6bd-40e0-997d-136433a7b3ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.150034 Oct 19 01:38:34.034014 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3090/6293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:33 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:35.059073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:35.059702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:35.062270 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:35.068429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:35.068958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:35.069404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:35.070789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:35.071254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:35.071686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:35.199641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:35.207476 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f96aa34-20ac-49da-a39c-030902203ab8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.153751 Oct 19 01:38:35.208056 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3204/6294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:35 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:36.230889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:36.231510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:36.233589 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:36.234404 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:38:36.240897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:36.241984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:36.242513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:36.243236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:36.243702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:36.244141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:36.684083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:36.691759 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-614826b5-64a5-47fa-9cc7-f683928f4245 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.464813 Oct 19 01:38:36.692685 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3091/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:36 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:37.715373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:37.715994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:37.722803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:37.723316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:37.723758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:37.724454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:37.724944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:37.725383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:37.853231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:37.860957 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9af375a3-2faf-4eb3-99e6-932f2754f86d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.149494 Oct 19 01:38:37.861533 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3205/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:37 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:38.885498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:38.886570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:38.893552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:38.894048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:38.894496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:38.895203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:38.895671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:38.896105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:39.035886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:39.048526 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66888b1e-6f35-4cd3-929a-bdce9c2c28a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.165092 Oct 19 01:38:39.048526 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3092/6297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:38 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:40.068866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:40.069576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:40.076226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:40.076735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:40.077166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:40.077855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:40.078309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:40.078733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:40.204892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:40.213558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-446afa06-9b0c-4b6c-92c7-52425dc3255a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.148852 Oct 19 01:38:40.214138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3206/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:40 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:41.163413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fbc75d-0ce0-4315-858f-d272df3d855c", "name": "network-vif-plugged", "status": "completed", "tag": "1b9c3fcd-6f88-4a02-8ffa-41ac2235b811"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:41.174560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:41.175046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:41.175486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:41.188080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] Creating event network-vif-plugged:1b9c3fcd-6f88-4a02-8ffa-41ac2235b811 for instance c6fbc75d-0ce0-4315-858f-d272df3d855c on n-h1-master-1 Oct 19 01:38:41.193581 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-650c0572-e3a4-4860-8848-968fb1235bd5 req-d327740a-93ad-45f5-968f-298adba10662 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Oct 19 01:38:41.194370 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3093/6299] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:38:41.237276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:41.237898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:41.246423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:41.246916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:41.247351 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:41.248056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:41.248545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:41.249455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:41.435743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:41.443747 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5c0aa7e6-5396-4616-a5fc-bb7193a68f62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.210353 Oct 19 01:38:41.444915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3207/6300] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:41 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:38:42.468384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:42.469132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:42.475323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:42.475927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:42.476363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:42.477082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:42.477538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:42.477962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:42.611644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:42.620129 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf9daea6-e3d5-45b3-b644-3ea213c90d9d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1203 microversion: 2.1 time: 0.156826 Oct 19 01:38:42.620735 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3094/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:42 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1203 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:43.643518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:43.644134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:43.651923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.652408 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.652880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:43.653584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.654041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.654466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:43.788798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:43.796675 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2371863f-35db-4543-9d61-3bbf432e6867 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1389 microversion: 2.1 time: 0.157118 Oct 19 01:38:43.797261 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3208/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:43 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1389 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:38:43.819094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:43.820268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:43.827119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.827606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.828048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:43.828794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.829257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.829689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:43.959716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:43.967650 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e8bbdb1a-8b17-4e39-ac47-dc288072ef63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1389 microversion: 2.1 time: 0.152665 Oct 19 01:38:43.968230 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3095/6303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:43 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1389 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:38:43.989430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:43.990047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:43.996739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.997222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.997658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:43.998346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:43.998797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:43.999225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:44.131546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:44.140059 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd803ef3-20a0-4f42-bbda-dbe33ca285c0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1389 microversion: 2.1 time: 0.154555 Oct 19 01:38:44.140649 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3209/6304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:43 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:44.162406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:44.162887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:44.169165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:44.169660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:44.170113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:44.170818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:44.171284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:44.171723 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:44.196860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:38:44.272022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-30ace343-b0ae-4861-84db-5ed663e19983 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 204 len: 0 microversion: 2.1 time: 0.113602 Oct 19 01:38:44.273194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3096/6305] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:38:44 2022] DELETE /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:38:44.281469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:44.282117 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:44.288792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:44.289287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:44.289801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:44.290494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:44.290946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:44.291368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:44.417893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:44.425665 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92e97aaa-f61b-4b73-982b-0b2f76143a75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1395 microversion: 2.1 time: 0.148177 Oct 19 01:38:44.426237 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3210/6306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:44 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1395 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:45.450421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:45.451130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:45.458739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:45.459236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:45.459682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:45.460895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:45.461366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:45.461806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:45.594600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:45.602826 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08f93ee9-4256-42a5-8c65-d220b5fcd6f2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1395 microversion: 2.1 time: 0.156745 Oct 19 01:38:45.603411 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3097/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:45 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:46.505592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6fbc75d-0ce0-4315-858f-d272df3d855c", "name": "network-vif-deleted", "tag": "1b9c3fcd-6f88-4a02-8ffa-41ac2235b811"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:38:46.516598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:46.517117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:46.517544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:46.530383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] Creating event network-vif-deleted:1b9c3fcd-6f88-4a02-8ffa-41ac2235b811 for instance c6fbc75d-0ce0-4315-858f-d272df3d855c on n-h1-master-1 Oct 19 01:38:46.535670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-074a98e8-5cfb-40d1-bbaa-993cb2684377 req-45961c03-0474-47b0-9d74-7622e8c819cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033589 Oct 19 01:38:46.536853 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3211/6308] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:38:46.626854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:46.627503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:46.635983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:46.636488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:46.636969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:46.637752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:46.638223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:46.638661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:46.707701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:46.716219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2d6a202-a375-41f6-886f-d15491552603 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1188 microversion: 2.1 time: 0.093406 Oct 19 01:38:46.716896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3098/6309] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:46 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1188 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:47.740910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:47.742289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:47.748674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:47.749171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:47.749618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:47.750324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:47.750789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:47.751224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:47.818392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:47.827450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b5e1209-368a-491b-b4b5-6252896549e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1188 microversion: 2.1 time: 0.091755 Oct 19 01:38:47.828231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3212/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:47 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1188 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:48.850975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:48.851671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:48.858651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:48.859154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:48.859593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:48.860307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:48.860806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:48.861245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:48.934229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:48.943453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-13ec6d76-11af-4c96-84d5-130c955cabe5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1188 microversion: 2.1 time: 0.096889 Oct 19 01:38:48.944718 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3099/6311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:48 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1188 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:49.967437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:49.968239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:49.975370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:49.976541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:49.977190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:49.977905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:49.978366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:49.978799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:50.040571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:50.048926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5a17f735-da13-4264-97fd-93461d75e6cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1188 microversion: 2.1 time: 0.085739 Oct 19 01:38:50.049779 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3213/6312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:49 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:51.071746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:51.072286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:51.079267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:51.079752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:51.080194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:51.080933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:51.081390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:51.081854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:51.113044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:51.113528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:51.113969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:51.115067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lazy-loading 'fault' on Instance uuid c6fbc75d-0ce0-4315-858f-d272df3d855c {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:38:51.156722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:38:51.165381 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96f31029-2bb0-42af-a0d9-02b0c82a5d31 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 200 len: 1193 microversion: 2.1 time: 0.097943 Oct 19 01:38:51.165964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3100/6313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:51 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:38:52.188830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:38:52.189453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: c6fbc75d-0ce0-4315-858f-d272df3d855c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:38:52.196575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:52.197099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:52.197550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:52.198256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:38:52.198721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:38:52.199157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:38:52.213242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c HTTP/1.1 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: exception: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'c6fbc75d-0ce0-4315-858f-d272df3d855c'} Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:38:52.214905 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance c6fbc75d-0ce0-4315-858f-d272df3d855c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-373d5def-0fa5-4483-9acc-8c08bd986ef5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c" status: 404 len: 111 microversion: 2.1 time: 0.031662 Oct 19 01:38:52.219434 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3214/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:38:52 2022] GET /compute/v2.1/servers/c6fbc75d-0ce0-4315-858f-d272df3d855c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:39:13.150956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-938323321", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d7a0527c-65f6-4d26-8381-e2c4184395bc", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:39:13.161189 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:13.161863 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:13.244768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:39:13.617101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:39:13.617541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:39:13.618032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:39:13.618476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:39:13.618899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:39:13.628947 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:13.629442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:13.629895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:13.630665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:13.631134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:13.631574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:13.648948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:39:13.654337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:39:13.667211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:39:13.669292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d7a0527c-65f6-4d26-8381-e2c4184395bc',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:39:13.742751 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77e57522-d36e-4e40-8d9a-b5fd7569dfdd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595797 Oct 19 01:39:13.743416 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3101/6315] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:39:13.754679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37de6b6b-12b3-45bb-8648-ff9881b51e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:13.755295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37de6b6b-12b3-45bb-8648-ff9881b51e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:13.758262 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=33 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:13.758916 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=81 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:13.814082 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37de6b6b-12b3-45bb-8648-ff9881b51e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:13.821345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37de6b6b-12b3-45bb-8648-ff9881b51e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1056 microversion: 2.1 time: 0.070590 Oct 19 01:39:13.821959 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3215/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:13 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:14.845613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:14.846239 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:14.853584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:14.854086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:14.854527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:14.855236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:14.855708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:14.856143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:14.919642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:14.927603 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e80765c-8f00-4ef7-8d17-1979c382cbd5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1108 microversion: 2.1 time: 0.086782 Oct 19 01:39:14.928607 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3102/6317] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:14 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1108 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:15.952888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:15.954227 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:15.962906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:15.963715 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:15.964261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:15.965238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:15.965941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:15.966610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:16.155567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:16.163842 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0eacf809-9106-448e-82d7-2790c3008c78 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.215118 Oct 19 01:39:16.164654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3216/6318] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:15 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:16.533495 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ebab8a-f3e1-45eb-bd71-24dee57a2355", "tag": "bd6a90e5-e56d-4532-874f-ee81f2eadf4d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:39:16.546943 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:16.547681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:16.548336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:16.562742 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] Creating event network-changed:bd6a90e5-e56d-4532-874f-ee81f2eadf4d for instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 on n-h1-master-1 Oct 19 01:39:16.568438 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0c3bb8f4-f334-4a30-8f61-3cef89c898d9 req-67cc99fa-f39d-487e-a2bb-657352d169e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039112 Oct 19 01:39:16.569163 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3103/6319] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:39:17.187678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:17.188308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:17.196574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:17.197102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:17.197548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:17.198264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:17.198721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:17.199347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:17.406453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:17.416857 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5eea8984-ffc3-4bdf-be1e-7ef1eaf71655 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.233223 Oct 19 01:39:17.417678 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3217/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:17 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:18.445121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:18.445861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:18.452139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:18.452657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:18.453102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:18.453807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:18.454276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:18.454712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:18.598010 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:18.607476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0fcbbb34-69b6-43e2-b956-db47a3b126ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.167780 Oct 19 01:39:18.608065 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3104/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:18 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:19.635802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:19.637101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:19.650068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:19.651032 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:19.651907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:19.652890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:19.653440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:19.654183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:19.855166 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:19.869975 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8272e86d-6a84-4f8b-8570-bc475fdccc97 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.241525 Oct 19 01:39:19.872030 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3218/6322] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:19 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:20.895499 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:20.896251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:20.903757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:20.904461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:20.905117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:20.905815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:20.906278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:20.906711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:21.046074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:21.055590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d7642401-b1b0-4b1a-9ee0-82ab895befe9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.164359 Oct 19 01:39:21.056501 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3105/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:20 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:22.080552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:22.081320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:22.090812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:22.092016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:22.093013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:22.094670 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:22.095748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:22.096828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:22.263494 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:22.271156 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-55848e74-b8ef-48b3-950a-5a7dc06df4a5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.194998 Oct 19 01:39:22.271730 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3219/6324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:22 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:23.304275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:23.304961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:23.311756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:23.312253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:23.312753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:23.313458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:23.313921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:23.314359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:23.449594 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:23.457272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a7b3b48-6715-4348-a468-459a38a5d7ce tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.157174 Oct 19 01:39:23.457854 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3106/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:23 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:24.482056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:24.482682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:24.485488 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:24.490903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:24.491378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:24.491812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:24.493310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:24.493769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:24.494197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:24.625323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:24.633769 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-74aaa6f3-8043-4d69-b14a-d9b055d4d2e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.155849 Oct 19 01:39:24.634358 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3220/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:24 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:25.657641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:25.658262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:25.660359 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:25.661058 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:25.669573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:25.670048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:25.670635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:25.671313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:25.671852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:25.672429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:25.810777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:25.818846 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afef588a-ce14-479e-801d-c8455b0d7b62 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.165138 Oct 19 01:39:25.819432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3107/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:25 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:26.841852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:26.842476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:26.849348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:26.849834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:26.850278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:26.850978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:26.852512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:26.852984 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:26.988174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:26.996648 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ffedc983-5ec4-438e-b020-8b462262447e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.158745 Oct 19 01:39:26.997251 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3221/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:26 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:28.020188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:28.020901 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:28.028736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:28.029246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:28.029695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:28.030419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:28.030890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:28.031335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:28.167467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:28.175471 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2dc2f08-5489-4820-ae80-bda56e500a9e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.159355 Oct 19 01:39:28.176065 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3108/6329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:28 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:29.199299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:29.199929 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:29.207722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:29.208211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:29.208686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:29.209385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:29.209854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:29.210304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:29.341180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:29.349169 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f137dcc1-3964-4f39-9e96-1a253c13aa85 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1168 microversion: 2.1 time: 0.154022 Oct 19 01:39:29.349752 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3222/6330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:29 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1168 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:30.374579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:30.375249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:30.383180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:30.383912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:30.384685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:30.385406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:30.385884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:30.386326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:30.517820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:30.526578 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-daeaa79e-3ac6-4c07-9ca8-99e1276b0c44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.156887 Oct 19 01:39:30.527156 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3109/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:30 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:31.550116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:31.550741 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:31.558349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:31.558844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:31.559300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:31.560007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:31.560470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:31.560931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:31.697698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:31.705518 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a6c59fe-96c3-46b8-bd0b-d802d4d4efcb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.159402 Oct 19 01:39:31.706102 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3223/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:31 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:32.728258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:32.728935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:32.735817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:32.736312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:32.736871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:32.737605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:32.738073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:32.738512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:32.866588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:32.874689 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afb76fd6-47b9-450d-a21c-2836fb370174 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.150609 Oct 19 01:39:32.875307 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3110/6333] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:32 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:33.899427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:33.900051 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:33.906057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:33.906550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:33.906994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:33.907696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:33.908189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:33.908651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:34.040868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:34.048718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c28134bc-3527-442f-9952-bfc8d216f691 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.154624 Oct 19 01:39:34.049302 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3224/6334] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:33 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:35.072225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:35.072871 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:35.079512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:35.079995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:35.080434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:35.081150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:35.081605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:35.082034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:35.213201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:35.220899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-540e4eea-f8da-494a-ba05-ca3ff2b14a30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.153343 Oct 19 01:39:35.221474 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3111/6335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:35 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:36.244159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:36.244802 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:36.251731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:36.252214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:36.252667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:36.253369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:36.253821 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:36.254272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:36.381392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:36.389771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-59735459-55f2-472f-83c9-c21c392aef5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.149653 Oct 19 01:39:36.390362 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3225/6336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:36 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:37.415681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:37.416431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:37.423993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:37.424597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:37.425065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:37.426485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:37.426924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:37.427428 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:37.566055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:37.574044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e6b975c7-6d1c-4de9-8292-33e5d2a48683 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.164684 Oct 19 01:39:37.574630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3112/6337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:37 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:38.597763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:38.598384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:38.605944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:38.606426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:38.606859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:38.607550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:38.608004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:38.608435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:38.738595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:38.746670 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-285c0b80-738d-4422-a30c-98cdb92db054 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.152783 Oct 19 01:39:38.747286 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3226/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:38 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:39.422071 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ebab8a-f3e1-45eb-bd71-24dee57a2355", "name": "network-vif-plugged", "status": "completed", "tag": "bd6a90e5-e56d-4532-874f-ee81f2eadf4d"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:39:39.434385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:39.434882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:39.435322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:39.447238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] Creating event network-vif-plugged:bd6a90e5-e56d-4532-874f-ee81f2eadf4d for instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 on n-h1-master-1 Oct 19 01:39:39.452271 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5aea4d0f-d810-4a77-91ec-ba11681ad9cf req-ef79cd56-070a-4c98-bd95-dd1a128dce18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Oct 19 01:39:39.452920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3113/6339] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:39:39.770323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:39.770946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:39.778831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:39.779315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:39.779756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:39.780455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:39.780941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:39.781380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:39.909045 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:39.917485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aee0f6a6-cf2e-4fbf-8574-c067916769ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1202 microversion: 2.1 time: 0.151055 Oct 19 01:39:39.918059 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3227/6340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:39 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:40.943711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:40.944426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:40.951034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:40.951527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:40.951975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:40.952707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:40.953178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:40.953617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.087692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:41.096074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5bd9ee65-6719-4b7e-9d70-e46616a112df tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1389 microversion: 2.1 time: 0.159684 Oct 19 01:39:41.096669 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3114/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:40 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:41.119660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:41.120290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:41.127217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.127707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.128153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.128877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.129340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.129768 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.256332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:41.264214 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4fd304d4-1af0-4ee7-bf11-75187f66d7cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1389 microversion: 2.1 time: 0.149223 Oct 19 01:39:41.264826 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3228/6342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:41 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1389 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:41.286396 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:41.287023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:41.293722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.294217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.294700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.295399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.295864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.296299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.421910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:41.429910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d867465a-fd28-463a-8ca8-bb36d5bd1b1b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1389 microversion: 2.1 time: 0.147379 Oct 19 01:39:41.430497 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3115/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:41 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1389 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:41.510062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:41.510566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:41.516415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.516928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.517364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.518060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.518512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.518938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.547355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:39:41.620795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e694b0b0-e6f9-44f8-b4dc-8c858dcc607a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 204 len: 0 microversion: 2.1 time: 0.114328 Oct 19 01:39:41.621402 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3229/6344] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:39:41 2022] DELETE /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:39:41.629909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:41.630537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:41.637431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.637931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.638382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.639086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:41.639556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:41.640016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:41.773654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:41.781961 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4397ec0b-2e90-4ed7-8188-2b707c2d979d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1395 microversion: 2.1 time: 0.156236 Oct 19 01:39:41.782551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3116/6345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:41 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1395 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:42.805892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:42.806605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:42.808843 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:39:42.808977 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:39:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 (ip 10.222.0.27) !!! Oct 19 01:39:42.816785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:42.817528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:42.817987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:42.818693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:42.819159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:42.819719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:42.953143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:42.956610 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:42.962740 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-130ed78d-3a1b-4d8a-bd8d-db1c9f51b553 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1395 microversion: 2.1 time: 0.161216 Oct 19 01:39:42.963329 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3230/6346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:42 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1395 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:43.986949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:43.987570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:43.990464 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:43.996456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:43.996985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:43.997435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:43.998387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:43.998652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:43.999097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:44.002474 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=85 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:44.223500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ebab8a-f3e1-45eb-bd71-24dee57a2355", "name": "network-vif-deleted", "tag": "bd6a90e5-e56d-4532-874f-ee81f2eadf4d"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:39:44.243995 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:39:44.247081 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:44.247577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:44.248024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:44.255827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:44.266226 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b074ed02-5c2f-4123-b933-364385c494b4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1395 microversion: 2.1 time: 0.283023 Oct 19 01:39:44.272193 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] Creating event network-vif-deleted:bd6a90e5-e56d-4532-874f-ee81f2eadf4d for instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 on n-h1-master-1 Oct 19 01:39:44.273008 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3117/6347] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:43 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1395 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:44.285344 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-50accad4-8f0d-4eb0-a36d-0fe4e81cf6de req-2867f0f8-0144-4f4d-bdc6-f79ab35d658d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065526 Oct 19 01:39:44.286018 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3231/6348] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:39:45.291997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:45.292641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:45.299647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:45.300143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:45.300595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:45.301384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:45.301800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:45.302241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:45.365133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:45.373896 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a331fc33-25c0-4040-87b0-03a7b5631a92 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1187 microversion: 2.1 time: 0.086392 Oct 19 01:39:45.374482 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3118/6349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:45 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:46.400033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:46.400770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:46.406937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:46.407432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:46.407881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:46.408579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:46.409072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:46.409507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:46.473266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:46.481450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc66489f-a0f7-4757-8b6d-ab0a9981433a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1187 microversion: 2.1 time: 0.087808 Oct 19 01:39:46.482051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3232/6350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:46 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:47.505091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:47.505723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:47.512738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:47.513224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:47.513665 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:47.514400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:47.514837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:47.515266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:47.581084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:47.589778 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52311767-5a20-44ef-a9f5-9366bf78c27a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1187 microversion: 2.1 time: 0.088652 Oct 19 01:39:47.590355 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3119/6351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:47 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:48.613450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:48.614070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:48.622582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:48.623077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:48.623538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:48.624237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:48.624738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:48.625176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:48.657876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:48.658368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:48.658812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:48.659264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lazy-loading 'fault' on Instance uuid 98ebab8a-f3e1-45eb-bd71-24dee57a2355 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:39:48.711341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:39:48.719605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a27d68c-af82-41eb-8c85-cc11a46335ef tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 200 len: 1192 microversion: 2.1 time: 0.110085 Oct 19 01:39:48.731788 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3233/6352] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:48 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:39:49.744212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:49.744873 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:49.751848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:49.752344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:49.752830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:49.753537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:49.754018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:49.754444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:49.768440 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 HTTP/1.1 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '98ebab8a-f3e1-45eb-bd71-24dee57a2355'} Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:49.770154 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e39fb1bd-7b0e-4545-8cec-0870bae11807 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 404 len: 111 microversion: 2.1 time: 0.032191 Oct 19 01:39:49.773851 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3120/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:49 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:39:51.921875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:51.922901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:51.929738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:51.930233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:51.930675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:51.931372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:51.931828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:51.932316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:51.946126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 HTTP/1.1 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '98ebab8a-f3e1-45eb-bd71-24dee57a2355'} Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:39:51.947806 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe87c1b1-8939-4daa-9c03-cfbd1d6b5235 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 404 len: 111 microversion: 2.1 time: 0.031479 Oct 19 01:39:51.951242 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3234/6354] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:39:51 2022] DELETE /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:39:51.958176 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:39:51.958935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 98ebab8a-f3e1-45eb-bd71-24dee57a2355] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:39:51.966564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:51.967136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:51.967657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:51.968431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:39:51.969180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:39:51.969693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:39:51.984551 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 HTTP/1.1 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '98ebab8a-f3e1-45eb-bd71-24dee57a2355'} Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:39:51.986196 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 98ebab8a-f3e1-45eb-bd71-24dee57a2355 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-79af38ec-92eb-47de-adc8-e846b86fa350 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355" status: 404 len: 111 microversion: 2.1 time: 0.033622 Oct 19 01:39:51.990250 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3121/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:39:51 2022] GET /compute/v2.1/servers/98ebab8a-f3e1-45eb-bd71-24dee57a2355 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:40:11.642566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1304525026", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "db0183c8-48bc-4056-ab97-d34f18ebe441", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:11.653805 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=9 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:11.654468 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=18 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:11.708034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:40:12.120455 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:40:12.120917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:40:12.121407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:40:12.121828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:40:12.122312 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:40:12.131361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:12.131852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:12.132299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:12.133959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:12.134430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:12.134868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:12.151416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:40:12.156705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:40:12.215567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:40:12.217690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db0183c8-48bc-4056-ab97-d34f18ebe441',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:40:12.343008 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8d92a14-055c-4396-b97c-fb40f8e8d43e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704432 Oct 19 01:40:12.343664 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3235/6356] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:40:12.355498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02a6e7a8-e941-48c6-b592-353f58258157 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:12.356121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02a6e7a8-e941-48c6-b592-353f58258157 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:12.358326 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=9 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:12.358984 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=21 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:12.415228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02a6e7a8-e941-48c6-b592-353f58258157 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:12.422355 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02a6e7a8-e941-48c6-b592-353f58258157 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1071 microversion: 2.1 time: 0.071517 Oct 19 01:40:12.422928 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3122/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:12 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1071 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:13.448174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:13.448951 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:13.456654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:13.457319 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:13.457878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:13.458955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:13.459669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:13.459901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:13.537549 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:13.545801 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a272e81c-7a05-4ea2-b163-7244e659e378 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1177 microversion: 2.1 time: 0.104039 Oct 19 01:40:13.546636 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3236/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:13 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1177 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:14.570391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:14.571767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:14.580174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:14.580698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:14.581148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:14.582084 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:14.582555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:14.582995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:14.838675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:14.847341 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d5d06545-6998-4866-8569-5cf4abacdb2d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1229 microversion: 2.1 time: 0.281185 Oct 19 01:40:14.848148 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3123/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:14 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1229 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:15.053343 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81d317a4-36e6-4599-9655-8970180b803a", "tag": "51524f6d-8661-4696-8bd3-71453fdec20b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:15.066772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:15.066772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:15.068006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:15.081491 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] Creating event network-changed:51524f6d-8661-4696-8bd3-71453fdec20b for instance 81d317a4-36e6-4599-9655-8970180b803a on n-h1-master-1 Oct 19 01:40:15.088067 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1a463224-ca3c-4d52-9bd9-ff040c70e8c4 req-ea08af41-dfd3-4d82-a4d8-c581e82b2ffa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038671 Oct 19 01:40:15.089985 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3237/6360] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:40:15.872051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:15.872753 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:15.879896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:15.880645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:15.881130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:15.881901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:15.882425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:15.883981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:16.091086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:16.099978 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80c803a7-7e8e-4180-920a-5c8533f2af13 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1229 microversion: 2.1 time: 0.232454 Oct 19 01:40:16.100898 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3124/6361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:15 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1229 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:17.125934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:17.126680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:17.133409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:17.133797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:17.134243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:17.134950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:17.135437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:17.135871 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:17.270064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:17.279108 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e824e2e6-fe29-4fc4-ad27-0e3d60a90c63 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1229 microversion: 2.1 time: 0.158359 Oct 19 01:40:17.279689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3238/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:17 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:40:18.302766 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:18.303310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:18.311232 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:18.311721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:18.312162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:18.312899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:18.313356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:18.313815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:18.458535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:18.467222 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24aebafd-8103-4442-8372-1e54e4eb53ea tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1229 microversion: 2.1 time: 0.168462 Oct 19 01:40:18.467817 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3125/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:18 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:19.491153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:19.491779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:19.498925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:19.499413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:19.499857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:19.500593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:19.501083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:19.501518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:19.630714 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:19.638558 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5c42aa78-5805-479a-99d3-7863dbd571d0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.151417 Oct 19 01:40:19.639144 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3239/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:19 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:20.661886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:20.662512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:20.669760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:20.670255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:20.670699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:20.671401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:20.671871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:20.672308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:20.806459 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:20.814485 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-42cc37a4-c047-4916-b082-27a14c9c54d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.156460 Oct 19 01:40:20.814993 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3126/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:20 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:21.837652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:21.838278 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:21.845030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:21.845522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:21.845969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:21.846673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:21.847139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:21.847572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:21.977136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:21.984838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14c896a1-7a34-4938-bbfb-5a8c73cdc0eb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.151118 Oct 19 01:40:21.985406 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3240/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:21 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:23.008931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:23.009491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:23.012299 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:23.017898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:23.018394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:23.018845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:23.019550 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:23.020019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:23.020456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:23.154098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:23.161845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c485f093-af71-45ff-b813-33fd85d0c05b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.157527 Oct 19 01:40:23.162426 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3127/6367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:23 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:24.185197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:24.185824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:24.187810 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:24.188481 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:24.195962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:24.196455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:24.196929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:24.197630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:24.198093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:24.198528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:24.330185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:24.338634 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2f17105d-c1bf-43e4-9aba-6e27ef98445a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.157455 Oct 19 01:40:24.339226 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3241/6368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:24 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:25.361632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:25.362262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:25.369541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:25.370094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:25.370543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:25.371251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:25.371719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:25.372163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:25.506921 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:25.515401 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8bc1888f-e498-4308-b3c4-e15d464dd33f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.157709 Oct 19 01:40:25.515983 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3128/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:25 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:26.537555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:26.538176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:26.545677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:26.546159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:26.546595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:26.547283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:26.547740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:26.548167 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:26.684499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:26.692737 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f6fce14b-6100-467d-a434-461352491d66 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.158765 Oct 19 01:40:26.693321 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3242/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:26 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:27.606587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d317a4-36e6-4599-9655-8970180b803a", "name": "network-vif-plugged", "status": "completed", "tag": "51524f6d-8661-4696-8bd3-71453fdec20b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:27.617340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:27.617835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:27.618307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:27.630628 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] Creating event network-vif-plugged:51524f6d-8661-4696-8bd3-71453fdec20b for instance 81d317a4-36e6-4599-9655-8970180b803a on n-h1-master-1 Oct 19 01:40:27.636122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-724e8b1b-c9c5-4c66-893b-2491fa0f8852 req-53c9a458-a4b7-41da-b301-0b63dea670ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Oct 19 01:40:27.636727 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3129/6371] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:40:27.717277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:27.717918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:27.724886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:27.725381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:27.725862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:27.726579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:27.727066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:27.727501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:27.915903 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:27.923834 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-726fb654-4c7b-470a-ae8d-4d1e1335398a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.210524 Oct 19 01:40:27.924423 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3243/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:27 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:28.950206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:28.950957 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:28.957312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:28.957804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:28.958254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:28.958961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:28.959421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:28.959857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:29.094741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:29.104398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93cf7e3b-4947-494f-ab88-a69c3a60b4b0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1217 microversion: 2.1 time: 0.159272 Oct 19 01:40:29.112670 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3130/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:28 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:30.135523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:30.136147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:30.143206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.143700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.144149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.144903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.145365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.145799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.273667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:30.281397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-30705c44-6cf0-4de1-8505-07e24fd5ea23 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1403 microversion: 2.1 time: 0.150608 Oct 19 01:40:30.281976 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3244/6374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:30 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1403 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:30.303863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:30.304411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:30.312099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.312696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.313235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.314015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.314613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.315143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.452521 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:30.462863 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3e25c92-d399-4b04-80a9-1b88cb116209 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1403 microversion: 2.1 time: 0.162807 Oct 19 01:40:30.463459 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3131/6375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:30 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1403 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:30.486583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2078783974"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:30.489058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:30.496657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.497060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.497508 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.498221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:30.498681 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:30.499112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:30.593669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.api [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Attempting to quiesce instance before volume snapshot. Oct 19 01:40:30.666850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.api [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 19 01:40:30.736717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Creating snapshot from volume db0183c8-48bc-4056-ab97-d34f18ebe441. {{(pid=131449) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 19 01:40:31.568317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c74dfb6-5b45-45a9-992e-0a575914e785 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a/action" status: 202 len: 0 microversion: 2.1 time: 1.085680 Oct 19 01:40:31.569026 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3245/6376] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:40:30 2022] POST /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a/action => generated 0 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 01:40:32.722326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1553583274", "imageRef": "1a3cf295-fec5-44cf-b817-ddc0c197cc8a", "flavorRef": "452", "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:32.779534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:40:33.149723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:40:33.150158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:40:33.151295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:40:33.151819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:40:33.152250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:40:33.161523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:33.161991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:33.162484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:33.163259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:33.163788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:33.164322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:33.182090 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:40:33.187598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:40:33.200319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:40:33.202992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5d36d98d-77ed-459d-9e72-0659046f9091',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:40:33.279541 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-84c1c055-fd18-49a5-bc9c-9c60235820c6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561053 Oct 19 01:40:33.280198 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3132/6377] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:40:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:40:33.293535 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a752d781-07eb-4053-97ef-32cd4ffef573 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:33.294273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a752d781-07eb-4053-97ef-32cd4ffef573 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:33.349718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a752d781-07eb-4053-97ef-32cd4ffef573 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:33.357162 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a752d781-07eb-4053-97ef-32cd4ffef573 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1230 microversion: 2.1 time: 0.069624 Oct 19 01:40:33.357751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3246/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:33 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:34.380196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:34.380878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:34.386999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:34.387482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:34.388363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:34.388652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:34.389094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:34.389521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:34.471975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:34.480713 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bf35cd41-ea13-4e0d-a4be-381079ac8b2f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1300 microversion: 2.1 time: 0.105208 Oct 19 01:40:34.481331 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3133/6379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:34 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:35.503705 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:35.504350 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:35.512972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:35.513495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:35.514173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:35.514916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:35.515396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:35.515848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:36.023024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:36.031762 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-857c536e-ac8c-4486-9093-17cbf67194cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.531950 Oct 19 01:40:36.036731 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3247/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:35 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:36.229290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010b324-ee86-49ce-8edc-8e52e8c5af5d", "tag": "83bd167b-f225-4b09-89cf-e0048ddf48b9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:36.240481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:36.240922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:36.241357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:36.252892 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] Creating event network-changed:83bd167b-f225-4b09-89cf-e0048ddf48b9 for instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d on n-h2-master-1 Oct 19 01:40:36.257733 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f630283a-5c8c-4302-b6ae-082bce957704 req-a0401c00-bb7e-4e47-a729-9098b78c06b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Oct 19 01:40:36.258507 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3134/6381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:40:37.056904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:37.057949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:37.065113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:37.065738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:37.066308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:37.067124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:37.068104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:37.068680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:37.289177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:37.299900 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91a68598-6789-45e5-8408-cea595eff587 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.246805 Oct 19 01:40:37.313534 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3248/6382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:37 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:38.328347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:38.329360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:38.336270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:38.337317 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:38.337611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:38.338933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:38.339520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:38.339962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:38.487187 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:38.500782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e68aee5a-30a7-4e1d-a50c-5852fe43068f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.179274 Oct 19 01:40:38.505313 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3135/6383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:38 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:39.529729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:39.530915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:39.548448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:39.549213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:39.549810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:39.551980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:39.552905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:39.553498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:39.814791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:39.823928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b166b98-9049-4af5-b54c-864d82d0aa30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.300658 Oct 19 01:40:39.824761 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3249/6384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:39 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:40.851805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:40.853141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:40.862286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:40.862990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:40.863524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:40.864330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:40.865149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:40.865719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:41.063185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:41.071710 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2be6cb00-608f-4caa-98b0-a6372f0d7bff tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.224462 Oct 19 01:40:41.072468 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3136/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:40 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:42.094921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:42.096226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:42.099187 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:42.104636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:42.105152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:42.105634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:42.106359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:42.106833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:42.107280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:42.112157 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:42.246015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:42.254669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddbdd58e-6248-432f-83c5-f1042bb204a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.163739 Oct 19 01:40:42.255270 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3250/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:42 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:43.278670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:43.279292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:43.282390 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:43.283062 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:43.283871 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:43.290462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:43.291535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:43.292544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:43.293291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:43.293757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:43.294190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:43.299328 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=73 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:43.430162 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:43.438196 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f88de59-c64d-4501-a905-13986da9d049 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.163857 Oct 19 01:40:43.438788 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3137/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:43 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:44.462104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:44.462739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:44.466099 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:40:44.471612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:44.472065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:44.472521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:44.473271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:44.473745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:44.474192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:44.608283 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:44.616147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee4e3316-af03-4650-b8a5-78dc2668ed3f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.158126 Oct 19 01:40:44.616760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3251/6388] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:44 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:45.639658 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:45.640286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:45.647561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:45.648058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:45.648499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:45.649240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:45.649700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:45.650132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:45.790160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:45.798554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77aee6f1-58d6-4831-ba5e-d5495b069bc9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.162993 Oct 19 01:40:45.799229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3138/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:45 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:46.822400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:46.822924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:46.830636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:46.831130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:46.831582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:46.832287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:46.832788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:46.833229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:46.966853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:46.974865 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b76f142-7a6a-40a9-90cc-d2a994714c6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.156540 Oct 19 01:40:46.975543 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3252/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:46 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:48.000230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:48.000890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:48.009005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:48.009685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:48.010151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:48.011230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:48.011672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:48.012261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:48.173573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:48.182362 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-23586f16-976f-4643-ae84-945e557cccbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1342 microversion: 2.1 time: 0.186445 Oct 19 01:40:48.191139 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3139/6391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:47 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:40:49.207721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:49.208265 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:49.215787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:49.216277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:49.216756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:49.217464 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:49.217929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:49.218373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:49.352909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:49.361102 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39c47820-4cb3-4697-9694-06bbe540511d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.157592 Oct 19 01:40:49.361696 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3253/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:49 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:50.385301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:50.385919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:50.392688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:50.393174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:50.393613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:50.394299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:50.394754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:50.395180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:50.529290 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:50.537154 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dd21703e-b33f-4a2c-9db9-da6d08f22719 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.155803 Oct 19 01:40:50.537757 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3140/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:50 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:51.561337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:51.561983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:51.569219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:51.569728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:51.570194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:51.570911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:51.571395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:51.571877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:51.712979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:51.720937 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b109a26-e0c9-436f-984d-5b78940ec4ab tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.163584 Oct 19 01:40:51.721538 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3254/6394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:51 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:52.743700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:52.744350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:52.751576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:52.752067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:52.752514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:52.753254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:52.753720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:52.754157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:52.887387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:52.895368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f82ea8ff-f02b-45c6-beac-628fd0a995a3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.155870 Oct 19 01:40:52.895957 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3141/6395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:52 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:53.920311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:53.920989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:53.928035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:53.928542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:53.929029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:53.929863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:53.930440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:53.930938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:54.068862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:54.077181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f1653b86-341f-4931-901b-f408731b7cd1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.161875 Oct 19 01:40:54.077865 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3255/6396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:53 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:55.101334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:55.101973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:55.110739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:55.111236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:55.111686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:55.112394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:55.112890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:55.113334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:55.253536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:55.261339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e93822ad-cec0-4e9c-ad5f-cb200c18d5e6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.164222 Oct 19 01:40:55.261927 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3142/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:55 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:56.284957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:56.285744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:56.292566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:56.293171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:56.293588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:56.294248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:56.294832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:56.295232 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:56.430696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:56.442080 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f72bfb6c-fe55-4ffc-8a5f-486a9b294986 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.161082 Oct 19 01:40:56.442973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3256/6398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:56 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:57.465730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:57.466300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:57.473905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:57.474402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:57.474848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:57.475576 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:57.476035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:57.476472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:57.613075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:57.620877 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95fb67fd-ea85-4d3f-b726-0dc20ebf0f75 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.159146 Oct 19 01:40:57.621463 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3143/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:57 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:58.645750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:58.646420 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:58.654579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:58.655073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:58.656238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:58.657027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:58.657567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:58.658041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:58.799665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:40:58.808914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6eaf63fd-1b2d-4497-9301-fd0f9b055888 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.167438 Oct 19 01:40:58.809928 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3257/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:58 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:40:59.834954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:40:59.835631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:40:59.842709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:59.843207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:59.843676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:59.844561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:59.845152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:59.845641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:59.925452 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010b324-ee86-49ce-8edc-8e52e8c5af5d", "name": "network-vif-plugged", "status": "completed", "tag": "83bd167b-f225-4b09-89cf-e0048ddf48b9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:40:59.952860 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:40:59.954905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:40:59.955780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:40:59.971925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] Creating event network-vif-plugged:83bd167b-f225-4b09-89cf-e0048ddf48b9 for instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d on n-h2-master-1 Oct 19 01:40:59.978484 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-662c0403-a227-4be4-9c12-597a74f606a1 req-a7823eaa-e8d7-486f-bb3c-26a8393493f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064153 Oct 19 01:40:59.979658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3258/6401] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:00.013402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:00.023076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b817a07-d9ec-4d04-8ac4-535fdbb49760 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.191973 Oct 19 01:41:00.024276 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3144/6402] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:40:59 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:01.059556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:01.060289 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:01.068803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:01.069591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:01.070059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:01.070780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:01.071269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:01.071833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:01.227402 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:01.241107 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e2722157-2f9a-479f-a966-d9ba82822fdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1376 microversion: 2.1 time: 0.186013 Oct 19 01:41:01.256654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3259/6403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:01 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:02.266710 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:02.267323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:02.274171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.274654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.275091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.275780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.276236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.276688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.422009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:02.430754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dfed3f71-1d7b-4354-afa1-29d648b8f435 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1563 microversion: 2.1 time: 0.168556 Oct 19 01:41:02.431336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3145/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:02 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:02.455315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:02.456153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:02.464747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.465552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.466117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.467063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.467551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.468165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.615828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:02.623718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-37234287-633b-4921-a839-7b7f9f8940bb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1563 microversion: 2.1 time: 0.173131 Oct 19 01:41:02.624306 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3260/6405] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:02 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:02.711806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:02.712315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:02.718707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.720265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.720757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.721465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.721935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.722379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.752445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:41:02.830607 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5fae1592-3b7b-4df9-9792-ac14c049827d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 204 len: 0 microversion: 2.1 time: 0.122494 Oct 19 01:41:02.831269 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3146/6406] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:41:02 2022] DELETE /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 01:41:02.841848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:02.842669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:02.851904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.852404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.853069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:02.853829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:02.854553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:02.855234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:03.008146 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:03.016182 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec1d65b5-6f14-432a-ad00-87f10a34db30 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1569 microversion: 2.1 time: 0.180354 Oct 19 01:41:03.016795 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3261/6407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:02 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:41:04.039859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:04.040485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:04.048489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:04.049057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:04.049509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:04.050221 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:04.050675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:04.051098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:04.184235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:04.193206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82076d79-7341-42f8-972b-8227814aefaa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1569 microversion: 2.1 time: 0.157756 Oct 19 01:41:04.193799 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3147/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:04 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:04.885190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010b324-ee86-49ce-8edc-8e52e8c5af5d", "name": "network-vif-deleted", "tag": "83bd167b-f225-4b09-89cf-e0048ddf48b9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:04.896476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:04.897046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:04.897505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:04.910535 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] Creating event network-vif-deleted:83bd167b-f225-4b09-89cf-e0048ddf48b9 for instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d on n-h2-master-1 Oct 19 01:41:04.916466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-877ee778-5f9c-43c0-9ba9-ca663d2e26e1 req-bc3c8970-2149-4d28-b57d-1885bbcc154d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Oct 19 01:41:04.920336 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3262/6409] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:05.216701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:05.217326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:05.224532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:05.225056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:05.225503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:05.226477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:05.227267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:05.228038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:05.295530 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:05.303876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51c7b232-c93b-4598-bcf5-ccb8b8470d8a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1361 microversion: 2.1 time: 0.091085 Oct 19 01:41:05.304464 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3148/6410] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:05 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:06.329785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:06.330565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:06.337124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:06.337642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:06.338107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:06.338823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:06.339304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:06.339754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:06.406333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:06.415110 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d37ea91b-1b71-4d2c-83a2-142e5e5360a6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1361 microversion: 2.1 time: 0.091422 Oct 19 01:41:06.415689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3263/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:06 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1361 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:07.438268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:07.438991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:07.446156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:07.446655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:07.447104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:07.447824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:07.448419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:07.448891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:07.515318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:07.523590 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-771a27a7-44a8-44ad-839c-baa4b25d15d4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1361 microversion: 2.1 time: 0.089413 Oct 19 01:41:07.524180 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3149/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:07 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:08.547905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:08.548546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:08.556211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:08.556763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:08.557229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:08.557995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:08.558474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:08.558927 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:08.624883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:08.634523 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4df98208-cdbb-42d1-ac93-bd5ff6d18c0f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 200 len: 1361 microversion: 2.1 time: 0.091180 Oct 19 01:41:08.635116 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3264/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:08 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:09.658157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:09.658940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:09.665812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:09.666302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:09.666743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:09.667471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:09.667927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:09.668356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:09.682615 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d HTTP/1.1 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4010b324-ee86-49ce-8edc-8e52e8c5af5d'} Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:09.684354 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e2ed75ae-7413-4601-a437-57cfc5fa7d84 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 404 len: 111 microversion: 2.1 time: 0.032234 Oct 19 01:41:09.689820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3150/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:09 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:14.000093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:14.001748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:14.004725 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=30 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:14.010178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:14.010683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:14.011146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:14.011867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:14.012341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:14.012845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:14.018155 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=82 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:14.041173 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:41:14.122994 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c430e755-1bf1-480e-86c2-521ecc7c9de8 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 204 len: 0 microversion: 2.1 time: 0.126751 Oct 19 01:41:14.123734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3265/6415] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:41:13 2022] DELETE /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:41:14.134024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:14.134895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:14.139734 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:14.144156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:14.144759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:14.145246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:14.145968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:14.146464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:14.146969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:14.150991 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:14.306391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:14.314723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ce61d12-aa81-4861-987b-92392f3bb8ba tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1409 microversion: 2.1 time: 0.185385 Oct 19 01:41:14.315285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3151/6416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:14 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1409 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:15.339477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:15.340199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:15.347591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:15.348093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:15.348547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:15.349278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:15.349748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:15.350197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:15.482838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:15.490935 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db9ad34b-5e54-44a9-8eb0-cc082c6c7afe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1409 microversion: 2.1 time: 0.155831 Oct 19 01:41:15.491516 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3266/6417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:15 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:16.514761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:16.516640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:16.524854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:16.525356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:16.525800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:16.526517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:16.526978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:16.527412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:16.624399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:16.635390 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-016a5d69-7b0b-4b66-bb8d-a53bfe70d05c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1367 microversion: 2.1 time: 0.125170 Oct 19 01:41:16.635991 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3152/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:16 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1367 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:16.637430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81d317a4-36e6-4599-9655-8970180b803a", "name": "network-vif-deleted", "tag": "51524f6d-8661-4696-8bd3-71453fdec20b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:16.649886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:16.650511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:16.651099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:16.666367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] Creating event network-vif-deleted:51524f6d-8661-4696-8bd3-71453fdec20b for instance 81d317a4-36e6-4599-9655-8970180b803a on n-h1-master-1 Oct 19 01:41:16.671901 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a15f17a1-588f-4cf0-9dfe-55134f6f1179 req-1e7b1a75-b69a-495d-bd9e-b03277a7bbd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038570 Oct 19 01:41:16.673179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3267/6419] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:41:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:17.661002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:17.661788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:17.668707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:17.669205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:17.669657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:17.670360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:17.670832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:17.671276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:17.737666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:17.745642 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7762b9ed-1f2a-412f-95dd-4377db9e4ea4 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1202 microversion: 2.1 time: 0.088860 Oct 19 01:41:17.746433 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3153/6420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:17 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:18.771039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:18.771815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:18.778183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:18.778692 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:18.779184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:18.779912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:18.780391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:18.780875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:18.847736 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:18.856878 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8bbc19d4-7025-4669-8491-dd5471625f5e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1202 microversion: 2.1 time: 0.091952 Oct 19 01:41:18.857476 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3268/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:18 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:19.886408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:19.887033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:19.894033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:19.894527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:19.894977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:19.895676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:19.896143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:19.896579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:19.960974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:19.970058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2cf84a0e-e4ea-4cdf-af1b-15fd8a7af32c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1202 microversion: 2.1 time: 0.087584 Oct 19 01:41:19.970671 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3154/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:19 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:20.993943 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:20.994726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:21.002301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:21.002818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:21.003281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:21.004014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:21.004745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:21.005205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:21.041137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:21.041652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:21.042114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:21.042592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lazy-loading 'fault' on Instance uuid 81d317a4-36e6-4599-9655-8970180b803a {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:41:21.102473 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:21.112429 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-080705fe-1b9e-4961-9ba3-d0630217541c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 200 len: 1207 microversion: 2.1 time: 0.122586 Oct 19 01:41:21.113047 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3269/6423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:20 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 1207 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:22.135473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:22.136130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:22.143978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:22.144472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:22.145048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:22.145760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:22.146235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:22.146674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:22.160260 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a HTTP/1.1 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '81d317a4-36e6-4599-9655-8970180b803a'} Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:22.161847 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:22.166233 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ffe78ba1-fee4-4adf-8296-9b75d6d0744c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 404 len: 111 microversion: 2.1 time: 0.031836 Oct 19 01:41:22.167006 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3155/6424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:22 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:24.310976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:24.311504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:24.319339 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.319850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.320312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.321137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.321618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.322068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.336525 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d HTTP/1.1 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '4010b324-ee86-49ce-8edc-8e52e8c5af5d'} Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:24.338266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5f9db4e-e5f6-4e7b-9b66-317a0239105e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 404 len: 111 microversion: 2.1 time: 0.032821 Oct 19 01:41:24.341851 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3270/6425] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:41:24 2022] DELETE /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:24.349801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:24.350627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 4010b324-ee86-49ce-8edc-8e52e8c5af5d] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:24.357595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.358161 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.358680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.359966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.360539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.361081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.374894 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d HTTP/1.1 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '4010b324-ee86-49ce-8edc-8e52e8c5af5d'} Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.377005 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 4010b324-ee86-49ce-8edc-8e52e8c5af5d could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ed7aae04-2acb-4370-a495-c1ed66f1e1fc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d" status: 404 len: 111 microversion: 2.1 time: 0.032617 Oct 19 01:41:24.380953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3156/6426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:24 2022] GET /compute/v2.1/servers/4010b324-ee86-49ce-8edc-8e52e8c5af5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:24.748139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:24.748692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:24.755227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.755733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.756191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.756929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.757412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.757875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.771952 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a HTTP/1.1 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '81d317a4-36e6-4599-9655-8970180b803a'} Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:24.773525 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-94ba67c4-aae8-43dd-932e-ad08db426505 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 404 len: 111 microversion: 2.1 time: 0.030930 Oct 19 01:41:24.777709 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3271/6427] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:41:24 2022] DELETE /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:41:24.784516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:24.785190 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 81d317a4-36e6-4599-9655-8970180b803a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:24.791135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.791621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.792066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.792801 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:24.793250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:24.793683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:24.808282 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a HTTP/1.1 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '81d317a4-36e6-4599-9655-8970180b803a'} Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:41:24.809856 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 81d317a4-36e6-4599-9655-8970180b803a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f97d256-44ac-460b-8b84-2908e396e2de tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a" status: 404 len: 111 microversion: 2.1 time: 0.031637 Oct 19 01:41:24.813920 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3157/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:24 2022] GET /compute/v2.1/servers/81d317a4-36e6-4599-9655-8970180b803a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:41:24.892154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-893f90a5-16ee-4b71-8919-f5227cb0cdb0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: .version_select at 0x7f2aefdf8f70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1972199879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEukHCZDuPjSzMxhA5lKZiNnJxVEGMPOvLrbUF+OObE7nySL03e7PObJkWiCF3lLkFrZZ++agQyQK5tG7Q0e8oN/i4uhRJNmy2+gM4ZWeY6XUNtsiP+sZyn3SMp12l/u2Q=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:24.907852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-893f90a5-16ee-4b71-8919-f5227cb0cdb0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:41:24.912984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-893f90a5-16ee-4b71-8919-f5227cb0cdb0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:41:24.940194 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-893f90a5-16ee-4b71-8919-f5227cb0cdb0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.053917 Oct 19 01:41:24.940967 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3272/6429] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:41:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:41.160321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1976215812", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1972199879", "security_groups": [{"name": "tempest-secgroup-smoke-1104314578"}], "block_device_mapping_v2": [{"uuid": "84b3f6df-0391-4a79-b8e7-0c38a848d87f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:41.171414 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=13 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:41.172070 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=29 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:41.352126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:41:41.776609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:41:41.777076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:41:41.777608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:41:41.777976 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:41:41.778394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:41:41.787906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:41.788392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:41.788880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:41.789613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:41.790071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:41.790506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:41.807898 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:41:41.813255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:41:41.870960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:41:41.873556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84b3f6df-0391-4a79-b8e7-0c38a848d87f',volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:41:41.999963 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbcad289-36de-4b79-aac3-ad99643ed9da tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843709 Oct 19 01:41:42.000639 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3158/6430] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:41:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:41:42.009789 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:42.011112 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:42.011751 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:42.016081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c45efd89-c8b8-4a0a-8dea-748478ad015d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:42.016925 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c45efd89-c8b8-4a0a-8dea-748478ad015d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:42.202941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c45efd89-c8b8-4a0a-8dea-748478ad015d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:42.210260 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c45efd89-c8b8-4a0a-8dea-748478ad015d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1095 microversion: 2.1 time: 0.202661 Oct 19 01:41:42.210951 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3273/6431] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:42 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1095 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:43.235632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:43.236339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:43.242915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:43.243423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:43.243850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:43.244659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:43.245044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:43.245472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:43.321695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:43.331164 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60ad7042-c4c9-4d6f-840f-9166ba717bc0 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1201 microversion: 2.1 time: 0.100890 Oct 19 01:41:43.331978 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3159/6432] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:43 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1201 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:44.354020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:44.354772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:44.363046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:44.363792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:44.364422 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:44.365497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:44.366113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:44.366707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:44.581558 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:44.589829 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d193f0c-5c0d-48e6-84ea-fb76c0da4754 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1279 microversion: 2.1 time: 0.239748 Oct 19 01:41:44.590614 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3274/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:44 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1279 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:45.127353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6c0217-e9af-4eb5-b76a-06d3eae377b8", "tag": "c426ec90-49b6-4912-a93d-b0f70c88b016"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:45.138998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:45.139638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:45.140195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:45.161205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] Creating event network-changed:c426ec90-49b6-4912-a93d-b0f70c88b016 for instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 on n-h1-master-1 Oct 19 01:41:45.169465 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b0917db4-731c-4dbf-95e6-fc84f5acd46b req-975b1d50-87ed-4ac3-9887-a210a1b74ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045538 Oct 19 01:41:45.170524 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3160/6434] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:45.615103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:45.615751 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:45.624364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:45.625439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:45.626533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:45.627534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:45.628451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:45.629111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:45.857116 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:45.867467 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-096411b3-d5b8-48b3-96fd-0c6bdf117cfa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1279 microversion: 2.1 time: 0.257656 Oct 19 01:41:45.868069 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3275/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:45 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1279 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:46.893870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:46.894704 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:46.901227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:46.901802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:46.902348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:46.903066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:46.903537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:46.903989 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:47.163694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:47.172078 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6aa95622-9968-4345-852e-4bbe3ced2704 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1279 microversion: 2.1 time: 0.283931 Oct 19 01:41:47.172951 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3161/6436] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:46 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1279 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:48.196479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:48.197781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:48.206601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:48.207111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:48.207582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:48.208366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:48.208960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:48.209537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:48.357010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:48.366549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6761db95-726d-4340-a4ad-0591497a4492 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1279 microversion: 2.1 time: 0.174922 Oct 19 01:41:48.367168 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3276/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:48 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:49.390280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:49.391251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:49.398384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:49.398881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:49.399332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:49.400045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:49.400511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:49.400982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:49.535377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:49.543090 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-01a87286-d210-460c-9de0-1f0a55487c3d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.156822 Oct 19 01:41:49.543672 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3162/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:49 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:50.566243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:50.566923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:50.574166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:50.574677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:50.575188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:50.575898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:50.576381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:50.576876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:50.709179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:50.717197 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a57f1369-c6fa-4dc4-b525-eb299cc80999 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.155163 Oct 19 01:41:50.717796 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3277/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:50 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:51.740827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:51.741488 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:51.748439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:51.748990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:51.749437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:51.750392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:51.750855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:51.751297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:51.798901 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:51.820190 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:51.886107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:51.894071 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7188346b-16ad-44db-aed9-13d5345a768e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.157227 Oct 19 01:41:51.894654 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3163/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:51 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:41:52.917354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:52.917989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:52.920355 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:41:52.926366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:52.926864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:52.927311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:52.928019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:52.928487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:52.929023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:53.060273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:53.068656 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2159b869-26ee-49c8-9d6b-6ef6d0380e9b tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.155303 Oct 19 01:41:53.069250 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3278/6441] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:52 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:54.091523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:54.092146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:54.099836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:54.100324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:54.100799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:54.101493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:54.101948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:54.102466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:54.236571 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:54.244232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c7352503-5a24-4d88-95fc-ed35a07585c2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.156780 Oct 19 01:41:54.244832 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3164/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:54 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:55.266956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:55.267617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:55.275531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:55.276043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:55.276504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:55.277259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:55.277740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:55.278191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:55.410744 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:55.418477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d90b15ac-0f9c-4886-a7b8-84ab5a49a4f6 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.155558 Oct 19 01:41:55.419057 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3279/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:55 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:56.441515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:56.442392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:56.449638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:56.450299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:56.450741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:56.451439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:56.451895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:56.452323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:56.593875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:56.602391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c2ca1646-deb9-450c-8716-784216699260 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.164781 Oct 19 01:41:56.602969 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3165/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:56 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:57.625464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:57.626115 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:57.632987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:57.633481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:57.633936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:57.634640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:57.635108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:57.635550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:57.848490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:57.856463 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73be5065-5639-4cfd-8674-92f7694c57f1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.234987 Oct 19 01:41:57.857298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3280/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:57 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:41:58.150581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6c0217-e9af-4eb5-b76a-06d3eae377b8", "name": "network-vif-plugged", "status": "completed", "tag": "c426ec90-49b6-4912-a93d-b0f70c88b016"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:41:58.168713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:58.169591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:58.170377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:58.194488 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] Creating event network-vif-plugged:c426ec90-49b6-4912-a93d-b0f70c88b016 for instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 on n-h1-master-1 Oct 19 01:41:58.204338 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-191b0c78-937b-40ef-9048-8c2a15959c3c req-e1691239-15c5-40b1-ad8b-85f2e5d7958e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056859 Oct 19 01:41:58.205350 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3166/6446] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:41:58.880218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:41:58.880896 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:41:58.888176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:58.888716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:58.889182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:58.889901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:41:58.890380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:41:58.890848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:41:59.026918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:41:59.035398 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8a25dca-3061-44bb-87a8-8f60513e18fe tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1267 microversion: 2.1 time: 0.159897 Oct 19 01:41:59.035984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3281/6447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:41:58 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:42:00.059597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:42:00.060309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:42:00.068295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:42:00.068885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:42:00.069336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:42:00.070031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:42:00.070494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:42:00.070927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:42:00.205272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:42:00.213156 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-acbf4e65-c778-4eb7-9237-a49dd2253d12 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1454 microversion: 2.1 time: 0.157851 Oct 19 01:42:00.213752 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3167/6448] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:42:00 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:42:00.235851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:42:00.236491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:42:00.243407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:42:00.243919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:42:00.244380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:42:00.245140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:42:00.245622 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:42:00.246072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:42:00.385471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:42:00.393565 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eb13d084-062c-4a55-8506-f8bba310fa9f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1454 microversion: 2.1 time: 0.162144 Oct 19 01:42:00.394152 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3282/6449] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:42:00 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:42:01.977848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b6c0217-e9af-4eb5-b76a-06d3eae377b8", "tag": "c426ec90-49b6-4912-a93d-b0f70c88b016"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:42:01.989108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:42:01.989637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:42:01.990115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:42:02.002105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] Creating event network-changed:c426ec90-49b6-4912-a93d-b0f70c88b016 for instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 on n-h1-master-1 Oct 19 01:42:02.007268 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-237d9b9b-b0c2-4c47-8a34-85c7ef266776 req-69c3166f-e254-4405-81a4-93546bc50930 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Oct 19 01:42:02.007872 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3168/6450] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:43:59.314606 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=22 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:43:59.315296 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=54 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:43:59.316377 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:43:59.316523 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 (ip 10.222.0.27) !!! Oct 19 01:43:59.319293 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:43:59.319408 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 (ip 10.222.0.27) !!! Oct 19 01:43:59.321116 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 01:43:59.321225 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 (ip 10.222.0.27) !!! Oct 19 01:43:59.394777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:43:59.395302 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:43:59.401327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:43:59.401830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:43:59.402288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:43:59.403005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:43:59.403487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:43:59.403933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:43:59.432815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:43:59.514806 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a11064e-4592-4fb9-8006-d5b9537daa3c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 204 len: 0 microversion: 2.1 time: 0.202492 Oct 19 01:43:59.519137 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3283/6451] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:43:59 2022] DELETE /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:43:59.523307 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:43:59.524061 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=50 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:43:59.525335 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:43:59.525565 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 (ip 10.222.0.27) !!! Oct 19 01:43:59.531381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:43:59.532246 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:43:59.548949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:43:59.549439 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:43:59.549882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:43:59.550588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:43:59.551049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:43:59.551486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:43:59.693915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:43:59.704025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3b7cfbf5-0777-4656-8dd4-0ec75aecee2c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1579 microversion: 2.1 time: 0.182331 Oct 19 01:43:59.704742 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3169/6452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:43:59 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1579 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:00.731119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:00.731845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:00.739617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:00.740128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:00.740586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:00.741325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:00.741801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:00.742250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:00.875826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:00.883761 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9f1ce30e-b322-4d21-87d2-3e3a4ec377fd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1579 microversion: 2.1 time: 0.157127 Oct 19 01:44:00.884344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3284/6453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:00 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:01.909398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:01.909905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:01.917521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:01.918022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:01.918472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:01.919183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:01.919657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:01.920096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:02.120143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:02.129459 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a812e95-a9e1-41ec-981a-8a8ab8e67961 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1579 microversion: 2.1 time: 0.225095 Oct 19 01:44:02.130056 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3170/6454] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:01 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1579 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:02.557246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b6c0217-e9af-4eb5-b76a-06d3eae377b8", "name": "network-vif-deleted", "tag": "c426ec90-49b6-4912-a93d-b0f70c88b016"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:44:02.572109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:02.572799 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:02.573331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:02.586815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] Creating event network-vif-deleted:c426ec90-49b6-4912-a93d-b0f70c88b016 for instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 on n-h1-master-1 Oct 19 01:44:02.592430 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f02c1161-38ec-4de1-b7ca-9d4223e22e23 req-fc0e5d89-1912-4f1d-b7f8-51ee8f586de9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103032 Oct 19 01:44:02.593221 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3285/6455] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:44:03.154237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:03.155067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:03.163365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:03.164018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:03.164562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:03.165402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:03.166085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:03.166617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:03.247796 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:03.257334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c883d5ae-11d5-4587-82dd-450b0fe73e5c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1226 microversion: 2.1 time: 0.106954 Oct 19 01:44:03.258736 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3171/6456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:03 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:04.283948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:04.284698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:04.290970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:04.291465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:04.291918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:04.292652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:04.293123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:04.293564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:04.357477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:04.365756 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-738014e8-152d-472d-951a-fc1816c9bcbc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1226 microversion: 2.1 time: 0.087616 Oct 19 01:44:04.366451 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3286/6457] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:04 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:05.388486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:05.389138 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:05.399012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:05.399505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:05.399948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:05.400690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:05.401152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:05.401586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:05.465560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:05.473620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-870b1d00-5999-436b-ac7a-ad69b52a9429 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1226 microversion: 2.1 time: 0.089170 Oct 19 01:44:05.474204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3172/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:05 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:06.495800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:06.496453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:06.505282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:06.505801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:06.506268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:06.507047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:06.507526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:06.507976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:06.573394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:06.582679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f487c4e3-c2be-47e2-8e8b-b9ce32aedb6d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 200 len: 1226 microversion: 2.1 time: 0.090818 Oct 19 01:44:06.583396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3287/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:06 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:07.605683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:07.606323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:07.615544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:07.616032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:07.616478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:07.617208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:07.617670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:07.618105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:07.632099 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 HTTP/1.1 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3b6c0217-e9af-4eb5-b76a-06d3eae377b8'} Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:44:07.633767 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64ddfc55-895e-416a-b9f7-f35b86497b04 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 404 len: 111 microversion: 2.1 time: 0.033424 Oct 19 01:44:07.637949 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3173/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:07 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:44:07.684390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-596134827", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1972199879", "security_groups": [{"name": "tempest-secgroup-smoke-1104314578"}], "block_device_mapping_v2": [{"uuid": "84b3f6df-0391-4a79-b8e7-0c38a848d87f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:44:07.803322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:44:08.263681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:44:08.264125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:44:08.264647 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:44:08.265181 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:44:08.266161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:44:08.277414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:08.277916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:08.278372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:08.279127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:08.279606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:08.280058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:08.299853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:44:08.305205 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:44:08.363394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:44:08.365592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84b3f6df-0391-4a79-b8e7-0c38a848d87f',volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:44:08.494110 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc6ab8c6-d4c5-4cda-9530-3eb6a06cdc36 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813674 Oct 19 01:44:08.494777 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3288/6461] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:44:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:44:08.507319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fdc7b33-f686-4869-b9c3-a6c4e9166627 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:08.508063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4fdc7b33-f686-4869-b9c3-a6c4e9166627 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:08.563989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4fdc7b33-f686-4869-b9c3-a6c4e9166627 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:08.573982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fdc7b33-f686-4869-b9c3-a6c4e9166627 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1094 microversion: 2.1 time: 0.070582 Oct 19 01:44:08.574593 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3174/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:08 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:09.598620 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:09.599376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:09.606466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:09.606971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:09.607429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:09.608145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:09.608649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:09.609098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:09.672650 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:09.681022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a008fb3-78b5-4ac0-b8b0-a3f5025b447c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1192 microversion: 2.1 time: 0.087955 Oct 19 01:44:09.681817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3289/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:09 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:10.706607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:10.707235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:10.718625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:10.719131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:10.719587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:10.720305 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:10.720976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:10.721650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:10.929718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:10.939759 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a87e9fed-e34c-440e-a9f0-65dc4959d294 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1278 microversion: 2.1 time: 0.238431 Oct 19 01:44:10.940928 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3175/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:10 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:11.222022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64dff4b-052e-4cfb-9920-810b4a7bab97", "tag": "b0ac1e3e-efcc-4082-a1a9-a432eedf0ded"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:44:11.234773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:11.235537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:11.236275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:11.250624 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] Creating event network-changed:b0ac1e3e-efcc-4082-a1a9-a432eedf0ded for instance b64dff4b-052e-4cfb-9920-810b4a7bab97 on n-h1-master-1 Oct 19 01:44:11.256819 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2b3f1a1b-6b6c-4621-ad70-512c67383dcf req-fdca5e46-ba95-4920-9d95-37f7a72f3ea1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038659 Oct 19 01:44:11.257730 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3290/6465] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:44:11.966145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:11.966806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:11.974297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:11.974800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:11.975256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:11.975976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:11.976444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:11.976917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:12.214892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:12.223194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ed4e1f1-066f-4b34-9b85-8a53fb13fed3 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1278 microversion: 2.1 time: 0.260964 Oct 19 01:44:12.223814 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3176/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:11 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:13.248698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:13.249336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:13.256398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:13.256945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:13.257405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:13.258128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:13.258609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:13.259061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:13.397465 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:13.405490 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9cbc999f-a126-4b2a-8fba-49f59e730207 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1278 microversion: 2.1 time: 0.162155 Oct 19 01:44:13.406507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3291/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:13 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:14.428506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:14.429145 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:14.436190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:14.436718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:14.437164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:14.437975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:14.438432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:14.438863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:14.584606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:14.593948 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc7ea367-38a7-4690-ae0d-95952d631538 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1278 microversion: 2.1 time: 0.169012 Oct 19 01:44:14.594542 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3177/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:14 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:15.617214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:15.617856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:15.624833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:15.625337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:15.625798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:15.626520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:15.627003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:15.627456 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:16.064828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:16.073059 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c6eab987-ae70-4189-a90b-8524200bd0e5 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.459795 Oct 19 01:44:16.073638 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3292/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:15 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:17.096518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:17.097174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:17.103997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:17.104478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:17.104963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:17.105654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:17.106110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:17.106537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:17.237619 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:17.245378 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-256d3f1d-b756-4c5c-825e-ffd072a302d7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.153291 Oct 19 01:44:17.245948 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3178/6470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:17 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:18.267966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:18.268596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:18.275497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:18.275993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:18.276440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:18.277173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:18.277643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:18.278082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:18.293522 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:18.311706 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:18.412604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:18.420445 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2ad20d4b-2767-4ba8-a69f-566a2bfebffa tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.157024 Oct 19 01:44:18.421045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3293/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:18 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:19.444231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:19.444812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:19.447585 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:44:19.453499 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:19.453991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:19.454440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:19.455140 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:19.455608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:19.456046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:19.586402 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:19.595182 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-457e4f5a-3ed8-477f-b830-30f2899df4b2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.155187 Oct 19 01:44:19.595760 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3179/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:19 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:20.617928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:20.618573 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:20.625631 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:20.626125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:20.626589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:20.627305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:20.627777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:20.628223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:20.764222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:20.772256 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ac1e098-f554-4998-a7e4-446c675eb5cf tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.158414 Oct 19 01:44:20.772868 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3294/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:20 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:21.795695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:21.796388 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:21.803485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:21.803971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:21.804412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:21.805123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:21.805580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:21.806007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:21.936008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:21.943933 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ceb99dd-445f-4a7f-b726-90f24636014a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.152183 Oct 19 01:44:21.944502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3180/6474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:21 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:22.970049 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:22.970696 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:22.977446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:22.977892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:22.978505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:22.979248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:22.979738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:22.980173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:23.133861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:23.141929 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db4e74a6-6698-4dde-9e93-c3833c3462e7 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.177330 Oct 19 01:44:23.142551 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3295/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:22 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:24.165494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:24.166133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:24.173667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:24.174158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:24.174600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:24.175296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:24.175764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:24.176193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:24.315336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:24.323267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-42bd8036-f53a-4ebf-938f-ab5fe6ffdf4a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.161720 Oct 19 01:44:24.323858 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3181/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:24 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:44:24.753572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64dff4b-052e-4cfb-9920-810b4a7bab97", "name": "network-vif-plugged", "status": "completed", "tag": "b0ac1e3e-efcc-4082-a1a9-a432eedf0ded"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:44:24.765547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:24.766044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:24.766496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:24.777815 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] Creating event network-vif-plugged:b0ac1e3e-efcc-4082-a1a9-a432eedf0ded for instance b64dff4b-052e-4cfb-9920-810b4a7bab97 on n-h1-master-1 Oct 19 01:44:24.783778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3bb33185-f1a2-45da-b000-df84e99a5590 req-df835bb1-5ba1-4175-8332-fb8522b0fd6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089131 Oct 19 01:44:24.784354 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3296/6477] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:44:25.345583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:25.346201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:25.353142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:25.353633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:25.354081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:25.354781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:25.355248 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:25.355689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:25.490477 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:25.498298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f688d0f-cd34-4632-9235-3ec7d9e661ec tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1266 microversion: 2.1 time: 0.156709 Oct 19 01:44:25.498880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3182/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:25 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:26.523224 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:26.523941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:26.533680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:26.534186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:26.534643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:26.535353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:26.535825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:26.536268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:26.669085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:26.677203 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bda2b64a-7f91-4821-ad44-b98e73fbfc45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1452 microversion: 2.1 time: 0.159130 Oct 19 01:44:26.677789 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3297/6479] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:26 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:44:26.700518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:44:26.701180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:44:26.708692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:26.709191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:26.709639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:26.710345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:26.710812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:26.711252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:26.841982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:44:26.850441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5faeca96-2221-49b6-8bc7-c97036c74a49 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1452 microversion: 2.1 time: 0.153864 Oct 19 01:44:26.851023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3183/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:44:26 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:44:28.500601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64dff4b-052e-4cfb-9920-810b4a7bab97", "tag": "b0ac1e3e-efcc-4082-a1a9-a432eedf0ded"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:44:28.514222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:44:28.514736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:44:28.515845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:44:28.527727 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] Creating event network-changed:b0ac1e3e-efcc-4082-a1a9-a432eedf0ded for instance b64dff4b-052e-4cfb-9920-810b4a7bab97 on n-h1-master-1 Oct 19 01:44:28.534158 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b5e964be-cefe-4775-a0a4-b2ce79bbc40a req-76c260cd-e047-42d1-b2a6-0b40b42528c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037574 Oct 19 01:44:28.534787 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3298/6481] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:46:18.836455 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=32 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:18.837303 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=80 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:18.838814 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:46:18.838949 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 19 01:46:18.840252 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:46:18.840368 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:46:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Oct 19 01:46:18.845544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1714006705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1972199879", "security_groups": [{"name": "tempest-secgroup-smoke-1104314578"}], "block_device_mapping_v2": [{"uuid": "94584848-af49-4105-b136-44fbc1d1e0c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f29b6926-59f1-4e68-8ef3-077d19ede2cd"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:46:18.965431 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] validate_networks() for [('f29b6926-59f1-4e68-8ef3-077d19ede2cd', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:46:19.417556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:46:19.418046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:46:19.418531 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:46:19.418961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:46:19.419412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:46:19.429269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:19.429761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:19.430219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:19.430980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:19.431427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:19.431868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:19.451613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:46:19.457784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Getting quotas for user ee07628620204cd485da142cf386e51f and project 034b5ba57eb7442e860a47761dfd8471. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:46:19.516154 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:46:19.518383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94584848-af49-4105-b136-44fbc1d1e0c2',volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:46:19.647121 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d198cbac-9f42-44e2-a640-909b9838d9a1 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812562 Oct 19 01:46:19.647777 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3184/6482] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:46:19.658532 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:19.659607 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:19.665525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31fbc328-44a9-4fe5-9f88-ae61784aef8c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:19.666253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31fbc328-44a9-4fe5-9f88-ae61784aef8c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:19.730715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31fbc328-44a9-4fe5-9f88-ae61784aef8c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:19.738056 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31fbc328-44a9-4fe5-9f88-ae61784aef8c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1095 microversion: 2.1 time: 0.082990 Oct 19 01:46:19.738635 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3299/6483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:19 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:20.760783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:20.761591 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:20.769670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:20.770252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:20.770619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:20.771345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:20.771813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:20.772255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:21.163817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:21.173219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-97a8a241-57b3-4581-85bc-1946902234be tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1201 microversion: 2.1 time: 0.416263 Oct 19 01:46:21.174141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3185/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:20 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1201 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:22.195208 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 01:46:22.198989 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:22.199853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:22.208236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:22.209038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:22.209504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:22.210237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:22.210721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:22.211169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:22.489565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:22.498703 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c29fa015-bca8-4254-9bed-c53c99daab9a tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1279 microversion: 2.1 time: 0.304844 Oct 19 01:46:22.517652 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3300/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:22 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1279 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:22.754027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8347b4-d53c-4452-8983-a3880365ded7", "tag": "b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:46:22.771384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:22.773820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:22.773820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:22.787125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] Creating event network-changed:b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f for instance 1d8347b4-d53c-4452-8983-a3880365ded7 on n-h2-master-1 Oct 19 01:46:22.794746 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2e01cff3-6d10-4ecd-8642-02642b4f4254 req-d97a6af8-1530-47bf-a1ea-f14a000969ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046624 Oct 19 01:46:22.796961 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3186/6486] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:46:23.527429 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:23.528007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:23.543779 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38968. Oct 19 01:46:23.546178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:23.547252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:23.547753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:23.548518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:23.549013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:23.549452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:23.779395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:23.788540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e255e1b-8587-4b97-a86c-645261253476 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1279 microversion: 2.1 time: 0.265104 Oct 19 01:46:23.802697 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3301/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:23 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:24.814119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:24.815161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:24.823568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:24.824748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:24.825205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:24.826167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:24.826642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:24.827400 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:24.993401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:25.001958 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f6080e3-064f-43b1-abea-44e293a4279e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1279 microversion: 2.1 time: 0.194493 Oct 19 01:46:25.002577 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3187/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:24 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:26.025900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:26.026528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:26.034714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:26.035446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:26.035837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:26.036591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:26.037114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:26.037566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:26.173430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:26.181308 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27aed105-4fac-4147-8b05-dce23fd4606c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.159765 Oct 19 01:46:26.181895 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3302/6489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:26 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:27.205483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:27.206101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:27.212858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:27.213348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:27.213796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:27.214486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:27.214953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:27.215385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:27.348391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:27.356073 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-829c8010-b5fc-48a7-8337-bbf4a74cb656 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.154553 Oct 19 01:46:27.356665 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3188/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:27 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:28.379810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:28.380441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:28.387343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:28.387838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:28.388282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:28.389015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:28.389485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:28.390012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:28.524048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:28.531767 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3fba6ba-75bb-4162-9395-096260d2251f tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.155993 Oct 19 01:46:28.532344 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3303/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:28 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:29.554842 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:29.555458 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:29.558258 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:29.558918 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:29.564812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:29.565302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:29.565742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:29.566689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:29.567147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:29.567575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:29.703610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:29.711457 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-527a1138-8b97-495a-b8d7-f419bf780318 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.160537 Oct 19 01:46:29.712042 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3189/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:29 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:30.735393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:30.735985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:30.738803 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:46:30.744194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:30.744725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:30.745185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:30.745904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:30.746388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:30.746859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:30.879986 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:30.887853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9cbdfb3-8fc0-4580-88c7-3d4c06106246 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.156556 Oct 19 01:46:30.888430 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3304/6493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:30 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:31.911195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:31.911840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:31.918759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:31.919250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:31.919692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:31.920396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:31.921431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:31.921962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:32.056597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:32.065035 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ad00427-e289-4831-b445-6e0f14e3ab45 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.157724 Oct 19 01:46:32.065622 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3190/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:31 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:33.088138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:33.088857 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:33.095933 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:33.096439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:33.096920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:33.097646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:33.098125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:33.098574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:33.231669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:33.239678 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42be7deb-7e4d-4015-8194-225f98d17c8e tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.155497 Oct 19 01:46:33.240265 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3305/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:33 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:34.262919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:34.263543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:34.269935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:34.270423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:34.270867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:34.271561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:34.272022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:34.272456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:34.405165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:34.412841 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03a96210-d2a1-4427-9565-768c53e0347d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.153950 Oct 19 01:46:34.413407 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3191/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:34 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:35.437719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:35.438389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:35.445558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:35.446072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:35.446560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:35.447280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:35.447756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:35.448205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:35.589363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:35.597941 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1b45dde6-8fd0-45b4-9e41-41ea9ccab921 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.164464 Oct 19 01:46:35.612849 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3306/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:35 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:36.621409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:36.622021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:36.629092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:36.629585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:36.630021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:36.630708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:36.631166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:36.631592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:36.762391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:36.770754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4bb75003-0b88-44d8-af16-211a54a0a939 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.153249 Oct 19 01:46:36.771315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3192/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:36 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:46:37.605747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8347b4-d53c-4452-8983-a3880365ded7", "name": "network-vif-plugged", "status": "completed", "tag": "b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:46:37.617453 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:37.618094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:37.618553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:37.630618 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] Creating event network-vif-plugged:b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f for instance 1d8347b4-d53c-4452-8983-a3880365ded7 on n-h2-master-1 Oct 19 01:46:37.635747 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5c17fb0e-049d-4d60-8dfb-fa59146b695a req-e26550c9-9082-4d4d-aef4-6057bf63f93a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033892 Oct 19 01:46:37.636407 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3307/6499] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:46:37.794050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:37.794670 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:37.802091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:37.802581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:37.803026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:37.803732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:37.804192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:37.804692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:37.937360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:37.945356 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c37554bd-37fd-4dd7-8d5c-52f786933479 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1267 microversion: 2.1 time: 0.155244 Oct 19 01:46:37.945943 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3193/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:37 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:38.971262 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:38.971954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:38.978323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:38.978836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:38.979296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:38.980012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:38.980488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:38.980965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:39.114125 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:39.122004 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-38187ced-c50a-45bb-8634-3f81adfd5e80 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1453 microversion: 2.1 time: 0.156656 Oct 19 01:46:39.122579 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3308/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:38 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:39.144915 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:46:39.145536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:46:39.152245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:39.152770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:39.153227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:39.153959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:39.154425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:39.154868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:39.289729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:46:39.297648 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-677e6ba0-1cd8-4b8a-b7f7-984509ef26d2 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1453 microversion: 2.1 time: 0.156746 Oct 19 01:46:39.298229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3194/6502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:46:39 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:46:40.894851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8347b4-d53c-4452-8983-a3880365ded7", "tag": "b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:46:40.905781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:46:40.906896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:46:40.907355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:46:40.918685 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] Creating event network-changed:b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f for instance 1d8347b4-d53c-4452-8983-a3880365ded7 on n-h2-master-1 Oct 19 01:46:40.924397 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f83ed0e9-a85b-46b9-8cc2-51cc9b0481a3 req-e87d77d2-004a-4666-bb24-a776c8bd6368 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033496 Oct 19 01:46:40.925099 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3309/6503] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:48:09.400434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:09.405208 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=24 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:09.405974 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=52 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:09.407151 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:48:09.407299 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 01:48:09.408495 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:48:09.409147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:09.411718 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:09.412445 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=58 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:09.413407 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:48:09.413637 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 01:48:09.416889 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:48:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 (ip 10.222.0.27) !!! Oct 19 01:48:09.423208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d8347b4-d53c-4452-8983-a3880365ded7", "tag": "b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:09.441615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:09.442113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:09.442553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:09.443260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:09.443721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:09.444151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:09.452830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:09.453333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:09.453779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:09.466549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] Creating event network-changed:b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f for instance 1d8347b4-d53c-4452-8983-a3880365ded7 on n-h2-master-1 Oct 19 01:48:09.471593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8e3d6945-4171-496f-a3cb-ae8248237113 req-45bb5e09-a187-4519-b4ed-14adf5a0c506 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069445 Oct 19 01:48:09.472377 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3310/6504] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:48:09.479783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:48:09.567105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ddd72cc0-0e91-4c57-8734-6a6e5b908621 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 204 len: 0 microversion: 2.1 time: 0.170926 Oct 19 01:48:09.567894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3195/6505] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:48:09 2022] DELETE /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:48:09.578745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:09.580139 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:09.587190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:09.587701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:09.588164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:09.588915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:09.589394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:09.589848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:09.892984 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:09.901283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c0ef7648-9d15-41a5-8b14-3a7088c6e342 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1578 microversion: 2.1 time: 0.328441 Oct 19 01:48:09.901906 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3311/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:09 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1578 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:10.926745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:10.927464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:10.935184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:10.935680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:10.936134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:10.936868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:10.937335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:10.937773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:11.199016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:11.207277 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-954952a2-815c-4761-b275-b85007d141ae tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1578 microversion: 2.1 time: 0.284805 Oct 19 01:48:11.207866 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3196/6507] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:10 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1578 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:11.805942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d8347b4-d53c-4452-8983-a3880365ded7", "name": "network-vif-deleted", "tag": "b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:11.816814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:11.817317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:11.817771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:11.830098 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] Creating event network-vif-deleted:b9bb770b-e00b-4d8c-8b98-6b93ad1b2d1f for instance 1d8347b4-d53c-4452-8983-a3880365ded7 on n-h2-master-1 Oct 19 01:48:11.835091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9a53ae7b-498a-4e60-9230-856cff94f30d req-368b34e1-3698-40ea-b40c-e04841956a4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081976 Oct 19 01:48:11.835751 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3312/6508] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:48:12.232191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:12.232827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:12.239951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:12.240443 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:12.240915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:12.241623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:12.242081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:12.242513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:12.305562 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:12.313480 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96966beb-0fcc-4e2c-a89e-4de1dbeb8844 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1226 microversion: 2.1 time: 0.085974 Oct 19 01:48:12.314063 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3197/6509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:12 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:48:13.339544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:13.340893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:13.347433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:13.347943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:13.348402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:13.349179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:13.349653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:13.350101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:13.415442 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:13.424297 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a7f6c0ce-1026-4fe5-8d47-6733880353bc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1226 microversion: 2.1 time: 0.090041 Oct 19 01:48:13.424913 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3313/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:13 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:14.447671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:14.448283 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:14.456144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:14.456662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:14.457116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:14.457826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:14.458288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:14.458721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:14.522756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:14.532408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0bffe9cf-095e-4190-97ce-b2014700ff44 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1226 microversion: 2.1 time: 0.088778 Oct 19 01:48:14.533029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3198/6511] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:14 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:48:15.555560 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:15.556201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:15.563347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:15.563854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:15.564314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:15.565074 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:15.565811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:15.566261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:15.632276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:15.641084 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0a355d1-7d8f-4ccb-a656-401e4e4288fb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 200 len: 1226 microversion: 2.1 time: 0.089560 Oct 19 01:48:15.641678 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3314/6512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:15 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:16.664123 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:16.664770 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 1d8347b4-d53c-4452-8983-a3880365ded7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:16.672740 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:16.673231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:16.673676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:16.674372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:16.674835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:16.675277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:16.688997 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 HTTP/1.1 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '1d8347b4-d53c-4452-8983-a3880365ded7'} Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:16.690891 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 1d8347b4-d53c-4452-8983-a3880365ded7 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f7f5ad6c-57fb-4e0a-98ce-a7392ca1735d tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7" status: 404 len: 111 microversion: 2.1 time: 0.032156 Oct 19 01:48:16.695578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3199/6513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:16 2022] GET /compute/v2.1/servers/1d8347b4-d53c-4452-8983-a3880365ded7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:48:23.216167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:23.216749 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:23.218946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b64dff4b-052e-4cfb-9920-810b4a7bab97", "tag": "b0ac1e3e-efcc-4082-a1a9-a432eedf0ded"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:23.223782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:23.224500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:23.224974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:23.225915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:23.226388 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:23.226835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:23.234030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:23.234754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:23.235304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:23.246266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] Creating event network-changed:b0ac1e3e-efcc-4082-a1a9-a432eedf0ded for instance b64dff4b-052e-4cfb-9920-810b4a7bab97 on n-h1-master-1 Oct 19 01:48:23.251901 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-fa61a1fb-77cc-4ed5-a305-e78c87ec8e07 req-5701d7e9-62b9-48d3-aaae-98cf80e37417 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037563 Oct 19 01:48:23.253065 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3200/6514] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:48:23.254901 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:48:23.338351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10524fff-7a87-4363-8741-ec0db44c7551 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 204 len: 0 microversion: 2.1 time: 0.126396 Oct 19 01:48:23.339068 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3315/6515] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:48:23 2022] DELETE /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:48:23.348174 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:23.348913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:23.356891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:23.357751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:23.358206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:23.358927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:23.359388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:23.360011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:23.493728 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:23.503003 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29e62533-5d9b-4e14-9b81-5ae53b1098d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1577 microversion: 2.1 time: 0.159093 Oct 19 01:48:23.503597 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3201/6516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:23 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:24.529953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:24.530634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:24.537303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:24.537805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:24.538261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:24.538974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:24.539447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:24.539889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:24.755327 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:24.763898 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9177b67a-6964-4214-bd51-42d222f2b752 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1577 microversion: 2.1 time: 0.239375 Oct 19 01:48:24.764526 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3316/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:24 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:25.787209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:25.787857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:25.798296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:25.798793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:25.799257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:25.799968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:25.800433 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:25.800895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:26.110115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:26.123311 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66a84132-1ae8-4d3d-b242-b1a1f6ea7311 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1577 microversion: 2.1 time: 0.340009 Oct 19 01:48:26.124017 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3202/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:25 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1577 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:26.409006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b64dff4b-052e-4cfb-9920-810b4a7bab97", "name": "network-vif-deleted", "tag": "b0ac1e3e-efcc-4082-a1a9-a432eedf0ded"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:26.419278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:26.419774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:26.420223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:26.431728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] Creating event network-vif-deleted:b0ac1e3e-efcc-4082-a1a9-a432eedf0ded for instance b64dff4b-052e-4cfb-9920-810b4a7bab97 on n-h1-master-1 Oct 19 01:48:26.437420 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-21de68a2-57ba-4837-a1e8-c051ec5e5bc9 req-c1b44da5-bb60-4a81-bfee-7e2d80d7ac2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Oct 19 01:48:26.438025 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3317/6519] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:48:27.154512 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:27.155046 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:27.162068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:27.162561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:27.163006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:27.163715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:27.164204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:27.164658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:27.228698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:27.237433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78ee4587-d189-4b45-b413-e060c61ff7b9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1225 microversion: 2.1 time: 0.087603 Oct 19 01:48:27.238015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3203/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:27 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:28.263273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:28.264003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:28.270335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:28.270833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:28.271290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:28.272007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:28.272481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:28.272953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:28.341915 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:28.349892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0171755-6000-44ec-9748-3fcc25f0f747 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1225 microversion: 2.1 time: 0.092318 Oct 19 01:48:28.350494 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3318/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:28 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:29.373730 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:29.374362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:29.381434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:29.382030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:29.382549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:29.383377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:29.383868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:29.384311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:29.449671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:29.458180 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-466d7692-020a-49a9-aa24-6c12d35e84dd tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1225 microversion: 2.1 time: 0.089476 Oct 19 01:48:29.458764 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3204/6522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:29 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:30.481920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:30.482501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:30.490052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:30.490551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:30.491003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:30.491725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:30.492195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:30.492644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:30.561298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee07628620204cd485da142cf386e51f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b5ba57eb7442e860a47761dfd8471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:30.569331 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a804fa80-75c2-4a2f-b845-9e4f42cc8cdc tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 200 len: 1225 microversion: 2.1 time: 0.091774 Oct 19 01:48:30.569964 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3319/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:30 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:31.593712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:31.594326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: b64dff4b-052e-4cfb-9920-810b4a7bab97] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:31.601219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:31.601698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:31.602134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:31.602824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:31.603276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:31.603702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:31.617459 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 HTTP/1.1 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: exception: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b64dff4b-052e-4cfb-9920-810b4a7bab97'} Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:31.619083 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance b64dff4b-052e-4cfb-9920-810b4a7bab97 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2fa4e2c6-64c3-4afd-9fe7-ded5777d45d9 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97" status: 404 len: 111 microversion: 2.1 time: 0.031245 Oct 19 01:48:31.623581 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3205/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:31 2022] GET /compute/v2.1/servers/b64dff4b-052e-4cfb-9920-810b4a7bab97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:48:32.058578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:32.059122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:32.066281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:32.066778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:32.067229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:32.067945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:32.068414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:32.068884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:32.083113 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 HTTP/1.1 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '3b6c0217-e9af-4eb5-b76a-06d3eae377b8'} Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:48:32.084930 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e9fb56e9-7d39-45cd-a154-185b228277cb tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 404 len: 111 microversion: 2.1 time: 0.032121 Oct 19 01:48:32.088792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3320/6525] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:48:32 2022] DELETE /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:48:32.096042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:32.096694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] [instance: 3b6c0217-e9af-4eb5-b76a-06d3eae377b8] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:32.102864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:32.103361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:32.103813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:32.104518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:32.105025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:32.105467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:32.118910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] HTTP exception thrown: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Request method failure captured: Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 HTTP/1.1 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1TnfLJAL8Lj_L8qqO8b91_t8KAKVBIdKw7ZdeGzk2e3A4fpHJW1yQInSaafE0B1mBuljSaZWDrNUTIjt3Zby_3VVwc3Epqk9u3VuKO_lVGkqwHplgugX6LWCcgrgfqcEMyULAUgEpLeebs80xAuq9OLPcneFHEtjYrsXboOckr0ir0 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_034b5ba57eb7442e860a47761dfd8471", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/034b5ba57eb7442e860a47761dfd8471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/034b5ba57eb7442e860a47761dfd8471"}]}] Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 034b5ba57eb7442e860a47761dfd8471 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestVolumeBootPattern-2145268078 Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: ee07628620204cd485da142cf386e51f Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestVolumeBootPattern-2145268078-project Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '3b6c0217-e9af-4eb5-b76a-06d3eae377b8'} Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:48:32.120471 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Returning 404 to user: Instance 3b6c0217-e9af-4eb5-b76a-06d3eae377b8 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a58dd8ff-6ca8-43dd-a276-bd3441861121 tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8" status: 404 len: 111 microversion: 2.1 time: 0.029871 Oct 19 01:48:32.124831 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3206/6526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:32 2022] GET /compute/v2.1/servers/3b6c0217-e9af-4eb5-b76a-06d3eae377b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:48:35.542389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-19549863-ba9f-4ea1-b640-0c8682f7498c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] Calling method '.version_select at 0x7f2af584d1f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:35.576375 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-19549863-ba9f-4ea1-b640-0c8682f7498c tempest-TestVolumeBootPattern-2145268078 tempest-TestVolumeBootPattern-2145268078-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1972199879" status: 202 len: 0 microversion: 2.1 time: 0.038357 Oct 19 01:48:35.577390 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3321/6527] 10.222.0.27 () {58 vars in 1263 bytes} [Wed Oct 19 01:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1972199879 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:48:54.357858 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:54.358606 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:54.465417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1314878950", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:54.518551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] validate_networks() for None {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:48:54.794833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:48:54.795282 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:48:54.795763 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:48:54.796179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:48:54.796601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:48:54.805413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:54.805897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:54.806340 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:54.807067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:54.807554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:54.807990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:54.824951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Getting quotas for project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:48:54.830119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Getting quotas for user 551b20cf7739476fb8d28dce9afd1002 and project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:48:54.843371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:48:54.845684 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:48:54.890467 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c2e651c-fa1f-4324-964c-561a7a0a6b58 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538191 Oct 19 01:48:54.891032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3207/6528] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:48:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:48:54.901898 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:54.903745 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:48:54.910595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0196e8bd-29ca-4486-87f5-ec80e016b27d tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:54.911326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0196e8bd-29ca-4486-87f5-ec80e016b27d tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:54.977007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0196e8bd-29ca-4486-87f5-ec80e016b27d tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:54.985820 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0196e8bd-29ca-4486-87f5-ec80e016b27d tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1222 microversion: 2.1 time: 0.085586 Oct 19 01:48:54.986685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3322/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:54 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:56.011539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:56.012542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:56.018810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:56.019293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:56.019736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:56.020427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:56.020913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:56.021347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:56.085630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:56.094076 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51ab1f9b-b5dc-44fe-bb38-82cbf7e85640 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1274 microversion: 2.1 time: 0.087370 Oct 19 01:48:56.094682 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3208/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:56 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:57.119333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:57.119974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:57.127693 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:57.128200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:57.128685 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:57.129420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:57.129901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:57.130352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:57.200599 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:57.208362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b319fbd-f1a0-4a06-881d-e22918dd3fda tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1280 microversion: 2.1 time: 0.093091 Oct 19 01:48:57.209047 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3323/6531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:57 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1280 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:58.011586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6bdf20e-062c-4af3-b904-0c8f10a581a5", "tag": "a544b61d-a24e-4a88-a8ee-0c98a918eba9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:48:58.028746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:58.029240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:58.029689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:58.041481 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] Creating event network-changed:a544b61d-a24e-4a88-a8ee-0c98a918eba9 for instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 on n-h1-master-1 Oct 19 01:48:58.051393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c2e98cff-f14b-4ab0-9749-ffb5c0e0ee27 req-23eb749e-1f0a-4b9e-9bf2-a5831acb88a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043449 Oct 19 01:48:58.051905 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3209/6532] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:48:58.232888 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:58.233527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:58.240443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:58.240978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:58.241438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:58.242190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:58.242665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:58.243114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:58.446557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:58.454959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-99172dd8-6b79-4f86-bf46-44f4b86328db tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.226208 Oct 19 01:48:58.455550 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3324/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:58 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:48:59.480161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:48:59.481489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:48:59.488114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:59.488603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:59.489112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:59.489800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:48:59.490255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:48:59.490680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:48:59.656027 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:48:59.663879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-90a8d068-4174-401e-9278-917315fe0792 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.188832 Oct 19 01:48:59.664461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3210/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:48:59 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:00.687892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:00.688533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:00.695741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:00.696248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:00.696738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:00.697459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:00.697939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:00.698393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:00.832892 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:00.841263 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-917f4edd-d069-4966-9804-69d70548384c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.157955 Oct 19 01:49:00.841855 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3325/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:00 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:01.865129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:01.865745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:01.873250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:01.873741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:01.874183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:01.874884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:01.875361 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:01.875791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:02.014208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:02.023883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d699756b-3d17-40bd-8b67-5191fc3e6816 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.162605 Oct 19 01:49:02.024549 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3211/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:01 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:03.047259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:03.047894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:03.054964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:03.055463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:03.055920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:03.056660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:03.057136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:03.057585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:03.192165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:03.200602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43b87a5c-ab81-4bf9-8551-b8dcfb0d0413 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.157365 Oct 19 01:49:03.201251 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3326/6537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:03 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:03.998074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bdf20e-062c-4af3-b904-0c8f10a581a5", "name": "network-vif-plugged", "status": "completed", "tag": "a544b61d-a24e-4a88-a8ee-0c98a918eba9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:04.008354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:04.008903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:04.009337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:04.020527 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] Creating event network-vif-plugged:a544b61d-a24e-4a88-a8ee-0c98a918eba9 for instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 on n-h1-master-1 Oct 19 01:49:04.025494 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a1058cbd-8a81-4c7d-8f17-be7d5a6c0f67 req-204fc7a4-33a2-4fe9-86c1-3ad12de00794 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031313 Oct 19 01:49:04.026263 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3212/6538] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:04.223810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:04.224449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:04.231951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:04.232455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:04.232949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:04.233677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:04.234153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:04.234610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:04.365006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:04.373538 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-af5f6e39-0957-44cb-b981-9ffbfc5ca479 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.153662 Oct 19 01:49:04.374135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3327/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:04 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:05.395273 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:05.396214 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:05.403268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:05.404127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:05.412128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:05.412638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:05.413134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:05.413841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:05.414345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:05.414876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:05.555795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:05.563687 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7aae9b6c-0152-4d6e-ba03-16c38e5c07ea tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1322 microversion: 2.1 time: 0.169512 Oct 19 01:49:05.564251 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3213/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:05 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:06.586007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:06.586639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:06.588559 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:06.595309 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:06.595813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:06.596270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:06.597017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:06.597490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:06.597934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:06.729645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:06.737468 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-49f8a0bf-5fb5-4c8b-b907-1cd2e76c5a14 tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1472 microversion: 2.1 time: 0.155423 Oct 19 01:49:06.738044 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3328/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:06 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:06.809172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-38bf87e3-55c8-4672-9e33-87de440de663 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '.version_select at 0x7f2af4d84c10>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:06.872957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-38bf87e3-55c8-4672-9e33-87de440de663 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/62984549702e4a9db66711e941728324" status: 200 len: 371 microversion: 2.1 time: 0.113837 Oct 19 01:49:06.873533 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3214/6542] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:49:06 2022] GET /compute/v2.1/os-quota-sets/62984549702e4a9db66711e941728324 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:06.885772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f39a2f45-566a-45d9-abe6-cfd2daf2498b tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-605715227", "id": 1640669346, "os-flavor-access:is_public": "True"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:06.905549 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f39a2f45-566a-45d9-abe6-cfd2daf2498b tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023676 Oct 19 01:49:06.906136 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3329/6543] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:49:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:49:06.918474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1640669346"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:06.920718 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:06.926619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:06.927101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:06.927543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:06.928237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:06.928726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:06.929158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.018440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8ed7b36f792427d80020d79263a55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62984549702e4a9db66711e941728324', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:07.024699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-605715227 {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:49:07.031561 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.032046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.032489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.033253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.033719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.034153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.055713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Getting quotas for project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:49:07.061498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Getting quotas for user 551b20cf7739476fb8d28dce9afd1002 and project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:49:07.073894 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] ram quota exceeded for 62984549702e4a9db66711e941728324, tried to resize instance. Oct 19 01:49:07.075117 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Request method failure captured: Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action HTTP/1.1 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 39 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1eG3q4DzUd8x4FL4GEc1rWvqBixoaj4RSMv2z59FngrDZgm4cHbyzk7lb5qQXJcydO9cYxtvWyaEzEwsHYB1lvh09KFyRkVO4ckb0Chy2WX8GHVUy8IpbM87OUnCeOGeycfBkp4WrHk2fy3jwsyytUz2jnFYVZLpiTmGdK_ywmxf0A Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 62984549702e4a9db66711e941728324 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,admin,reader Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,admin,reader Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_62984549702e4a9db66711e941728324", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62984549702e4a9db66711e941728324"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/62984549702e4a9db66711e941728324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62984549702e4a9db66711e941728324"}]}] Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 62984549702e4a9db66711e941728324 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersAdminNegativeTestJSON-1769029474-project-admin Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: c8ed7b36f792427d80020d79263a55d5 Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1769029474-project-admin Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: {"resize": {"flavorRef": "1640669346"}} Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b6bdf20e-062c-4af3-b904-0c8f10a581a5', 'body': {'resize': {'flavorRef': '1640669346'}}} Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.077258 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0dddeb17-6136-4169-baef-b0c138940aa4 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action" status: 403 len: 118 microversion: 2.1 time: 0.164029 Oct 19 01:49:07.081580 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3215/6544] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:49:06 2022] POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:49:07.089972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-de2de518-d4e0-44e3-a3e4-e2d64dd3a63b tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.107447 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-de2de518-d4e0-44e3-a3e4-e2d64dd3a63b tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1640669346" status: 202 len: 0 microversion: 2.1 time: 0.023270 Oct 19 01:49:07.108033 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3330/6545] 10.222.0.27 () {58 vars in 1161 bytes} [Wed Oct 19 01:49:07 2022] DELETE /compute/v2.1/flavors/1640669346 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:49:07.115827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-67ea6c9d-4589-47a4-8d85-eec1f1f9dcb2 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.137074 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-67ea6c9d-4589-47a4-8d85-eec1f1f9dcb2 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024610 Oct 19 01:49:07.137743 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3216/6546] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:07.158522 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4f6237cf-cc8d-48e4-ac33-efc50a248f48 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '.version_select at 0x7f2af45ab5e0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.231709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4f6237cf-cc8d-48e4-ac33-efc50a248f48 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/62984549702e4a9db66711e941728324" status: 200 len: 371 microversion: 2.1 time: 0.076138 Oct 19 01:49:07.232296 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3331/6547] 10.222.0.27 () {58 vars in 1242 bytes} [Wed Oct 19 01:49:07 2022] GET /compute/v2.1/os-quota-sets/62984549702e4a9db66711e941728324 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:07.244211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f971dd37-4f2c-401e-846e-357593a48971 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-465534334", "id": 720943245, "os-flavor-access:is_public": "True"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:07.262107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f971dd37-4f2c-401e-846e-357593a48971 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021570 Oct 19 01:49:07.262689 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3217/6548] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:49:07 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:07.274834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "720943245"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:07.277288 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:07.284251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.284826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.285284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.285996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.286471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.286915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.382272 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c8ed7b36f792427d80020d79263a55d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62984549702e4a9db66711e941728324', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:07.388361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-465534334 {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:49:07.395055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.395552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.396008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.396783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.397257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.397703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.418435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Getting quotas for project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:49:07.423378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Getting quotas for user 551b20cf7739476fb8d28dce9afd1002 and project 5a3ec273a1dd47c5badbc1156aeb1775. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:49:07.436100 n-d-master-1 devstack@n-api.service[131449]: INFO nova.compute.api [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] cores quota exceeded for 62984549702e4a9db66711e941728324, tried to resize instance. Oct 19 01:49:07.436686 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Request method failure captured: Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action HTTP/1.1 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 38 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1eG3q4DzUd8x4FL4GEc1rWvqBixoaj4RSMv2z59FngrDZgm4cHbyzk7lb5qQXJcydO9cYxtvWyaEzEwsHYB1lvh09KFyRkVO4ckb0Chy2WX8GHVUy8IpbM87OUnCeOGeycfBkp4WrHk2fy3jwsyytUz2jnFYVZLpiTmGdK_ywmxf0A Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 62984549702e4a9db66711e941728324 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,admin,reader Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,admin,reader Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_62984549702e4a9db66711e941728324", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62984549702e4a9db66711e941728324"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/62984549702e4a9db66711e941728324"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/62984549702e4a9db66711e941728324"}]}] Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 62984549702e4a9db66711e941728324 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1769029474 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminNegativeTestJSON-1769029474-project-admin Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: c8ed7b36f792427d80020d79263a55d5 Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1769029474-project-admin Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: {"resize": {"flavorRef": "720943245"}} Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b6bdf20e-062c-4af3-b904-0c8f10a581a5', 'body': {'resize': {'flavorRef': '720943245'}}} Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.438652 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0fa74650-d8ef-4235-aace-6b51c8fdd4c1 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action" status: 403 len: 113 microversion: 2.1 time: 0.169267 Oct 19 01:49:07.443533 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3332/6549] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:49:07 2022] POST /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5/action => generated 113 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:49:07.449050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95830ac4-a5ee-47cb-9370-dc85e468f76d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.466266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95830ac4-a5ee-47cb-9370-dc85e468f76d tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/720943245" status: 202 len: 0 microversion: 2.1 time: 0.020829 Oct 19 01:49:07.466832 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3218/6550] 10.222.0.27 () {58 vars in 1158 bytes} [Wed Oct 19 01:49:07 2022] DELETE /compute/v2.1/flavors/720943245 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:49:07.474848 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-409ce33e-37e8-457d-844b-89a6a45c2cc8 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.496831 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-409ce33e-37e8-457d-844b-89a6a45c2cc8 tempest-ServersAdminNegativeTestJSON-1769029474 tempest-ServersAdminNegativeTestJSON-1769029474-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025677 Oct 19 01:49:07.497432 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3333/6551] 10.222.0.27 () {58 vars in 1146 bytes} [Wed Oct 19 01:49:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:07.518485 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.518994 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:07.524985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.525472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.525915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.526610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.527070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.528051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.553496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:49:07.629131 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c9e3df2-daf3-441e-b4d7-c7cf03d9550b tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 204 len: 0 microversion: 2.1 time: 0.113939 Oct 19 01:49:07.629959 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3219/6552] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:49:07 2022] DELETE /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:49:07.638156 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:07.638788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:07.645566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.646065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.646515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.647219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:07.647698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:07.648138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:07.784248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:07.792000 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b554cf6-e852-4d22-b9a7-4989cd64590c tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1478 microversion: 2.1 time: 0.157972 Oct 19 01:49:07.792573 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3334/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:07 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:08.816885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:08.817593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:08.824031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:08.824551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:08.825027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:08.825727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:08.826191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:08.826625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:08.961203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:08.969911 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a1e31f65-2afe-4479-869a-82d63a9f3f4e tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1478 microversion: 2.1 time: 0.157716 Oct 19 01:49:08.970664 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3220/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:08 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1478 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:09.754345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6bdf20e-062c-4af3-b904-0c8f10a581a5", "name": "network-vif-deleted", "tag": "a544b61d-a24e-4a88-a8ee-0c98a918eba9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:09.770589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:09.771285 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:09.771896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:09.787444 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] Creating event network-vif-deleted:a544b61d-a24e-4a88-a8ee-0c98a918eba9 for instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 on n-h1-master-1 Oct 19 01:49:09.794280 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-373364ed-9b98-41b5-b716-5b79201657ef req-ca1dea25-d60f-4d41-9f60-7a36d785ff14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113878 Oct 19 01:49:09.795057 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3335/6555] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:09.995817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:09.996717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:10.004238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:10.004817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:10.005276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:10.006086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:10.006648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:10.007094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:10.040792 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:10.041214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:10.041720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:10.042249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lazy-loading 'fault' on Instance uuid b6bdf20e-062c-4af3-b904-0c8f10a581a5 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:49:10.088105 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '551b20cf7739476fb8d28dce9afd1002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3ec273a1dd47c5badbc1156aeb1775', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:10.097016 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7a9ad0de-c9f4-4951-8b6a-4ff0e1967ebc tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 200 len: 1312 microversion: 2.1 time: 0.105133 Oct 19 01:49:10.097599 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3221/6556] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:09 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:11.123403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:11.124137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] [instance: b6bdf20e-062c-4af3-b904-0c8f10a581a5] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:11.130503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:11.131009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:11.131470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:11.132188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:11.132691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:11.133147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:11.146733 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] HTTP exception thrown: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Request method failure captured: Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 HTTP/1.1 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1eFQZ0avNPIhoV0hdwTfjWdd5-_nWlGeYfCtIsfgyk65CQb3FeFJqiWn1PW3QPbsi-wDvcYktZ1exFY179Na0NKxqjc1gHkt-8UP5yRHBmVOc0P5y0LUSv6xwrDZrKtN3AKYNvTfdMwMJgITMWtOreJhNTkikC5W_M1uz2yiAFv3pQ Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5a3ec273a1dd47c5badbc1156aeb1775 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1417302873 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a3ec273a1dd47c5badbc1156aeb1775", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a3ec273a1dd47c5badbc1156aeb1775"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a3ec273a1dd47c5badbc1156aeb1775"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a3ec273a1dd47c5badbc1156aeb1775"}]}] Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1417302873 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5a3ec273a1dd47c5badbc1156aeb1775 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1417302873 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersAdminNegativeTestJSON-1417302873-project Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 551b20cf7739476fb8d28dce9afd1002 Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1417302873-project Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: exception: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b6bdf20e-062c-4af3-b904-0c8f10a581a5'} Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:11.148417 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] Returning 404 to user: Instance b6bdf20e-062c-4af3-b904-0c8f10a581a5 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-208921d7-b0aa-4251-822f-b253b1a572da tempest-ServersAdminNegativeTestJSON-1417302873 tempest-ServersAdminNegativeTestJSON-1417302873-project] 10.222.0.27 "GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5" status: 404 len: 111 microversion: 2.1 time: 0.032241 Oct 19 01:49:11.152944 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3336/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:11 2022] GET /compute/v2.1/servers/b6bdf20e-062c-4af3-b904-0c8f10a581a5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:49:17.256818 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:17.257770 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:17.378307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1023440399", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "21d3c518-bf14-44d6-9cf2-9f3b88f23af3"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:17.434177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] validate_networks() for [('21d3c518-bf14-44d6-9cf2-9f3b88f23af3', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:49:17.851830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:49:17.852260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:49:17.852942 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:49:17.853360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:49:17.853772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:49:17.864014 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:17.864427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:17.864913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:17.865638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:17.866119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:17.866580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:17.884281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Getting quotas for project cd50de3fc33641aa996967fe934311e8. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:49:17.890202 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Getting quotas for user de8b634f360c40d595de8f641b1ac2ba and project cd50de3fc33641aa996967fe934311e8. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:49:17.903600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:49:17.905985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:49:17.954827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef0b8571-1d33-4c4f-997b-0549f73b2160 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703615 Oct 19 01:49:17.955493 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3222/6558] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:49:17.967633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7d94908-ba04-4c7c-b333-8c4c4edac9eb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:17.968344 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7d94908-ba04-4c7c-b333-8c4c4edac9eb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:17.972688 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:17.974291 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:18.075257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7d94908-ba04-4c7c-b333-8c4c4edac9eb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:18.089147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7d94908-ba04-4c7c-b333-8c4c4edac9eb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1215 microversion: 2.1 time: 0.125917 Oct 19 01:49:18.091062 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3337/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:17 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:19.114768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:19.115659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:19.123542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:19.124034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:19.124500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:19.125244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:19.125707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:19.126186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:19.199364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:19.207546 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cf08d336-98fa-43a6-bbd7-afd341985180 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1267 microversion: 2.1 time: 0.096741 Oct 19 01:49:19.208141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3223/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:19 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:20.232849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:20.234419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:20.243760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:20.244366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:20.245024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:20.246359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:20.247013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:20.247493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:20.524201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:20.533682 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc54d4fc-da84-4ebb-9579-009bbdb6af10 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.304858 Oct 19 01:49:20.534282 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3338/6561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:20 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:20.971359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:20.983251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:20.983739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:20.984177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:20.998026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] Creating event network-changed:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h1-master-1 Oct 19 01:49:21.003949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-92da9bf7-67b6-43d4-a142-895da3168f97 req-60c17468-7008-4bd6-8c8a-f5167a45b8f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036486 Oct 19 01:49:21.005155 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3224/6562] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:21.558923 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:21.559562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:21.566797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:21.567343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:21.567841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:21.568591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:21.569141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:21.569632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:21.708225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:21.716362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92e187a6-578d-4083-bd65-06101e3e5a82 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.161479 Oct 19 01:49:21.716986 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3339/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:21 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:22.741982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:22.742686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:22.748932 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:22.749625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:22.750076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:22.750778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:22.751245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:22.751679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:22.995450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:23.004793 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4515f9d3-eee6-43f7-bdc6-f3aa9f39e76e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.267880 Oct 19 01:49:23.005382 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3225/6564] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:22 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:24.028031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:24.028725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:24.037635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:24.039043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:24.039522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:24.040667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:24.041261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:24.041758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:24.181282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:24.190536 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54e6c72c-9525-4d39-8c26-1a31c7369021 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.166536 Oct 19 01:49:24.191476 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3340/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:24 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:25.214702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:25.215354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:25.218216 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:25.223500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:25.223983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:25.224434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:25.225152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:25.225607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:25.226036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:25.231002 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:25.365944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:25.374265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-242e548e-63cb-497a-b626-1ffc5bdaaf7e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.162902 Oct 19 01:49:25.374844 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3226/6566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:25 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:26.159895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "name": "network-vif-plugged", "status": "completed", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:26.166036 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:26.181977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:26.182484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:26.182940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:26.186269 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=78 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:26.196712 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] Creating event network-vif-plugged:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h1-master-1 Oct 19 01:49:26.201923 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-43022ecb-8a39-4e43-bbfd-28d2eb4a365b req-a5c1a50b-c721-4862-9a9a-16720441fc58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126063 Oct 19 01:49:26.202531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3341/6567] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:26.398371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:26.399032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:26.406544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:26.407043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:26.407512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:26.408201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:26.408695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:26.409134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:26.544225 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:26.552741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37f815ed-3049-4868-9910-0ee0e988c042 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1315 microversion: 2.1 time: 0.158095 Oct 19 01:49:26.553454 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3227/6568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:26 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:27.578047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:27.578788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:27.585202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.585711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.586170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:27.586895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.587360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.587828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:27.726071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:27.734671 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a87fe1ca-374d-42b0-8a9d-91142faac3c3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1502 microversion: 2.1 time: 0.162426 Oct 19 01:49:27.735298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3342/6569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:27 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:27.757872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:27.760147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:27.767641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.768123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.768595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:27.769312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.769768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.770195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:27.797853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:27.803206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Old instance type m1.heat2, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:49:27.809629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:49:27.810051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:49:27.810526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:49:27.811576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:49:27.811995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:49:27.874679 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68c503d0-12ed-429b-8009-8711f552d6a4 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "POST /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a/action" status: 202 len: 0 microversion: 2.1 time: 0.120696 Oct 19 01:49:27.875356 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3228/6570] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:49:27 2022] POST /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:49:27.883484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:27.884158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:27.890277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.890788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.891253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:27.891968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:27.892445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:27.892918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:28.031102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:28.039290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-10bf2396-29e2-49c3-b025-6af5febb24f5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1511 microversion: 2.1 time: 0.159737 Oct 19 01:49:28.039864 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3343/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:27 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:29.060163 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:29.060989 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:29.066494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:29.067108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:29.074780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:29.075372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:29.075831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:29.077253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:29.077889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:29.078332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:29.215451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:29.223322 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18dc3d34-0e82-434e-b572-0e416aeff96d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1511 microversion: 2.1 time: 0.163796 Oct 19 01:49:29.223849 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3229/6572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:29 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:30.246081 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:30.246710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:30.249490 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:30.255722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:30.256236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:30.256752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:30.257525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:30.258030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:30.258485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:30.388634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:30.396689 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec9ad485-6283-4b9e-85db-def713329fcb tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.154611 Oct 19 01:49:30.397273 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3344/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:30 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:31.421072 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:31.421671 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:31.428446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:31.428971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:31.429407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:31.430093 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:31.430549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:31.430984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:31.564240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:31.572442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c8bd9301-dc60-4a8f-baa3-b7d4932f3a62 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.155906 Oct 19 01:49:31.573067 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3230/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:31 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:32.596066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:32.597021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:32.604288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:32.604813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:32.605270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:32.605986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:32.606454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:32.606892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:32.745960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:32.753842 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-afe2e330-fa48-4241-897c-8a33c5ffb83f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.162335 Oct 19 01:49:32.754419 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3345/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:32 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:33.778314 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:33.778948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:33.786090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:33.786584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:33.787038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:33.787744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:33.788211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:33.788675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:33.922445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:33.930265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff457f13-a807-408c-a9bc-1cd54e833f5d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156155 Oct 19 01:49:33.930847 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3231/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:33 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:34.954395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:34.955058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:34.962012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:34.962591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:34.963048 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:34.963780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:34.964259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:34.964749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:35.096795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:35.104636 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7e77f13-61b3-453b-9802-c6eb417de694 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.154443 Oct 19 01:49:35.105234 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3346/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:34 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:36.129211 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:36.129830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:36.136705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:36.137191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:36.137629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:36.138321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:36.138778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:36.139207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:36.268735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:36.276604 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-126ae5c0-11a3-4630-ba4b-75d4ec5b1b9a tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.151719 Oct 19 01:49:36.277209 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3232/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:36 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:37.300815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:37.301370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:37.308246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:37.308783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:37.309248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:37.309959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:37.310437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:37.310885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:37.444613 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:37.453123 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6bdda6e9-f33f-4db5-8431-88808e0971fe tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156340 Oct 19 01:49:37.453705 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3347/6579] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:37 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:38.476430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:38.477085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:38.484874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:38.485369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:38.485818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:38.486524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:38.486987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:38.487423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:38.620408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:38.629119 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5180a557-69c5-405e-9f7c-b6201d8044b2 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156581 Oct 19 01:49:38.630054 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3233/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:38 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:39.653419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:39.654060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:39.661787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:39.662290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:39.662748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:39.663466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:39.663942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:39.664392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:39.798355 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:39.806235 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61489860-4d13-472e-aa09-159b6e5d03c6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156816 Oct 19 01:49:39.806823 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3348/6581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:39 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:40.831917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:40.832532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:40.839495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:40.839980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:40.840423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:40.841148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:40.841642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:40.842073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:40.971654 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:40.979333 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ad354d93-fd20-4014-9b41-a1c626ce1ece tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.151458 Oct 19 01:49:40.979923 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3234/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:40 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:42.003698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:42.004362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:42.011368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:42.011865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:42.012314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:42.013071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:42.013544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:42.013987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:42.148120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:42.156401 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e712df5a-d60c-49da-b9c8-b7978f06dfef tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156705 Oct 19 01:49:42.157017 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3349/6583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:41 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:43.180909 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:43.181561 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:43.189230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:43.189729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:43.190445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:43.191154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:43.191622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:43.192064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:43.328016 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:43.336009 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d455ce2-1446-4991-9a78-c2884caf78bd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.159724 Oct 19 01:49:43.336608 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3235/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:43 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:44.360039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:44.360723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:44.367625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:44.368128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:44.368583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:44.369322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:44.369794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:44.370239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:44.508598 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:44.517454 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-11650736-a620-4006-8f11-51d50c626e20 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.162131 Oct 19 01:49:44.518027 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3350/6585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:44 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:45.540990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:45.541620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:45.548732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:45.549225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:45.549673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:45.550413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:45.550877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:45.551315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:45.684782 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:45.693261 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f81f734-6de3-4420-a49f-d7c3116d1311 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156255 Oct 19 01:49:45.693843 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3236/6586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:45 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:46.718147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:46.718782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:46.725861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:46.726367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:46.726828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:46.727552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:46.728029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:46.728487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:46.859692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:46.867749 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4a2203a-6f06-44e2-8e27-46422da4c9ce tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.154083 Oct 19 01:49:46.868375 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3351/6587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:46 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:47.891260 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:47.891895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:47.898883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:47.899377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:47.899833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:47.900541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:47.901029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:47.901467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:48.039309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:48.048848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-40b42402-c855-463d-ad8d-360bfe6f38ab tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.161481 Oct 19 01:49:48.049989 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3237/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:47 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:49.073693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:49.074360 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:49.081770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:49.082268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:49.082755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:49.083454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:49.083920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:49.084358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:49.214128 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:49.223011 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-90ceb424-6c38-4ee5-964f-3ac4006427d6 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.153196 Oct 19 01:49:49.223558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3352/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:49 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:50.247340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:50.247965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:50.255802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:50.256302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:50.256777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:50.257493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:50.257984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:50.258452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:50.418267 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:50.426691 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-585e2452-8e3a-4446-8cf2-326723f8c34e tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.183276 Oct 19 01:49:50.427257 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3238/6590] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:50 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:51.450094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:51.450733 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:51.459077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:51.459583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:51.460047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:51.460797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:51.461277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:51.461724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:51.594410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:51.602406 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-880b2634-b2b7-485c-a4e9-ffd0c0738204 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156353 Oct 19 01:49:51.602994 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3353/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:51 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:52.627237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:52.627870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:52.634977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:52.635474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:52.635950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:52.636679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:52.637150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:52.637588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:52.769444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:52.777306 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99adedfc-4294-494b-947d-aece82609ada tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.155562 Oct 19 01:49:52.777892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3239/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:52 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:53.800786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:53.801428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:53.807982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:53.808490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:53.808986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:53.809708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:53.810188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:53.810640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:53.941167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:53.948979 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9fc6c514-6d58-45ee-bcd3-93f6be8fc9e5 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.152334 Oct 19 01:49:53.949564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3354/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:53 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:54.973596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:54.974153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:54.980879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:54.981360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:54.981799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:54.983159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:54.983800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:54.984238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:55.115511 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:55.123478 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1986743a-525a-4e89-aab5-5c24be241aee tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.153772 Oct 19 01:49:55.124062 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3240/6594] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:54 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:56.146941 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:56.147578 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:56.155057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:56.155643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:56.156112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:56.156865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:56.157340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:56.157787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:56.290031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:56.292230 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=84 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:56.299485 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-86d499ab-696c-458e-b91b-ca6f54bf8e43 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.156498 Oct 19 01:49:56.300099 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3355/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:56 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:57.323751 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:57.324309 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:57.327062 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:57.332293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:57.332807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:57.333251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:57.333939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:57.334397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:57.334826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:57.337538 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:57.499486 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:57.507298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4f059cb-1b05-41c6-a740-b1facf2b4ee3 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1516 microversion: 2.1 time: 0.187484 Oct 19 01:49:57.507902 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3241/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:57 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:58.076140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "name": "network-vif-unplugged", "status": "completed", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:49:58.083216 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=30 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:49:58.088885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:58.089314 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:58.089766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:58.103073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Creating event network-vif-unplugged:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h2-master-1 Oct 19 01:49:58.109687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:49:58.120935 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-602fe5b9-fb66-46d7-bf4e-4e67db2665cf req-df463e7f-dad3-472e-b980-2ebc26572970 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048525 Oct 19 01:49:58.121578 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3356/6597] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:49:58.531833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:58.532487 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:58.539393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:58.539892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:58.540347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:58.541082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:58.541582 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:58.542022 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:58.680193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:58.688145 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86f38608-2a8b-42bb-81cb-da381a98abdd tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1515 microversion: 2.1 time: 0.160829 Oct 19 01:49:58.688757 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3242/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:58 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:49:59.713774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:49:59.714553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:49:59.720894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:59.721548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:59.722163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:59.723089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:49:59.723691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:49:59.724289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:49:59.853707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:49:59.862298 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-66238bd5-a031-41a7-b10a-7782c7a3cef8 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1513 microversion: 2.1 time: 0.153741 Oct 19 01:49:59.862893 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3357/6599] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:49:59 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:00.147003 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:00.157895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:00.158411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:00.158882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:00.171540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Creating event network-changed:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h2-master-1 Oct 19 01:50:00.177043 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:50:00.187970 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cc559a06-c5b1-46d1-8a75-5fa5b6583b16 req-ac509126-0397-4fdc-9ec6-d502ba1bedf1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044750 Oct 19 01:50:00.188574 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3243/6600] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:50:00.887727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:00.888363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:00.896043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:00.896545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:00.897037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:00.897765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:00.898234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:00.898674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:01.127428 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:01.135702 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd96cd97-1fde-4456-a301-1b1c506698b7 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1510 microversion: 2.1 time: 0.251832 Oct 19 01:50:01.136304 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3358/6601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:00 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:01.162251 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:01.162849 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:01.169184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:01.169761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:01.170285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:01.171202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:01.172530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:01.173003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:01.200756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:50:01.252433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Found an unconfirmed migration during delete, id: 16, status: finished Oct 19 01:50:02.908822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f0fe212-d680-4845-ba67-59b7f910b75f tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 204 len: 0 microversion: 2.1 time: 1.752369 Oct 19 01:50:02.909572 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3244/6602] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:50:01 2022] DELETE /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 0 bytes in 1754 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:50:02.918005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:02.918691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:02.926143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:02.926644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:02.927101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:02.927814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:02.928287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:02.928760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:03.064197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:03.072313 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a98508ee-85f7-47ec-953e-f3c979a3ee75 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1502 microversion: 2.1 time: 0.158253 Oct 19 01:50:03.072939 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3359/6603] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:02 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:04.097048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:04.097750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:04.104254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:04.104773 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:04.105215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:04.105906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:04.106390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:04.106819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:04.235795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de8b634f360c40d595de8f641b1ac2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd50de3fc33641aa996967fe934311e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:04.243571 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-40b7fe89-9b13-435e-9767-c34234c2693d tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 200 len: 1502 microversion: 2.1 time: 0.150869 Oct 19 01:50:04.244231 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3245/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:04 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:04.625287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "name": "network-vif-plugged", "status": "completed", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:04.637776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:04.639187 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:04.640015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:04.651934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] Creating event network-vif-plugged:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h2-master-1 Oct 19 01:50:04.657266 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5a9e1268-f630-467b-9027-6580697313c4 req-fe77c61d-e230-4584-b1a1-c8c7687fe0f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036246 Oct 19 01:50:04.658199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3360/6605] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:50:04.816703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abe720d8-e3b1-4d2f-9d14-218f7fcbe19a", "name": "network-vif-deleted", "tag": "1f9567f4-30fd-4b47-84fe-1985f3fdc44f"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:04.827399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:04.827890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:04.828333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:04.840877 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] Creating event network-vif-deleted:1f9567f4-30fd-4b47-84fe-1985f3fdc44f for instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a on n-h2-master-1 Oct 19 01:50:04.847075 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-88c12a2d-9fff-413a-9c17-7e0dbeda8765 req-a4fa181a-5c8b-4817-a003-182b2e87c8de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 Oct 19 01:50:04.848261 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3246/6606] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:50:05.267023 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:05.267770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:05.273996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.274498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.274953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.275672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.276145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.276592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.290498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] HTTP exception thrown: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Request method failure captured: Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a HTTP/1.1 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1eds-c52yxo4extBpTFPP57X_d8gMstm9WaI2yk0no-aXo0iynDajM7ICHGfz2iUR3RuKmO1J2Z4VViB_0WZuPUqzQ7RCBfrIvdmoB8Q9QA_IEv8xfZ_cQWPm7iUCPhy0DD25yc0Y95vZwwNNNwC__SGN90D8CrUiRvCoWibVejbjI Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd50de3fc33641aa996967fe934311e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}] Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: de8b634f360c40d595de8f641b1ac2ba Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: exception: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'abe720d8-e3b1-4d2f-9d14-218f7fcbe19a'} Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.292160 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Returning 404 to user: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57e02485-0d75-4ff6-b520-fdfbe6eba1b1 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 404 len: 111 microversion: 2.1 time: 0.030967 Oct 19 01:50:05.296904 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3361/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:05 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:50:05.309795 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:05.310330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:05.316790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.317275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.317717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.318434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.318893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.319325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.332729 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] HTTP exception thrown: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Request method failure captured: Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a HTTP/1.1 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1eds-c52yxo4extBpTFPP57X_d8gMstm9WaI2yk0no-aXo0iynDajM7ICHGfz2iUR3RuKmO1J2Z4VViB_0WZuPUqzQ7RCBfrIvdmoB8Q9QA_IEv8xfZ_cQWPm7iUCPhy0DD25yc0Y95vZwwNNNwC__SGN90D8CrUiRvCoWibVejbjI Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd50de3fc33641aa996967fe934311e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}] Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: de8b634f360c40d595de8f641b1ac2ba Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: exception: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'abe720d8-e3b1-4d2f-9d14-218f7fcbe19a'} Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:50:05.334340 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Returning 404 to user: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32019c17-e181-42e0-8308-dc08176380ae tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "DELETE /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 404 len: 111 microversion: 2.1 time: 0.031117 Oct 19 01:50:05.338544 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3247/6608] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:50:05 2022] DELETE /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:50:05.344588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:05.345256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] [instance: abe720d8-e3b1-4d2f-9d14-218f7fcbe19a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:05.351143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.351635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.352091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.352832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:05.353302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:05.353748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:05.367675 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] HTTP exception thrown: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Request method failure captured: Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a HTTP/1.1 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1eds-c52yxo4extBpTFPP57X_d8gMstm9WaI2yk0no-aXo0iynDajM7ICHGfz2iUR3RuKmO1J2Z4VViB_0WZuPUqzQ7RCBfrIvdmoB8Q9QA_IEv8xfZ_cQWPm7iUCPhy0DD25yc0Y95vZwwNNNwC__SGN90D8CrUiRvCoWibVejbjI Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd50de3fc33641aa996967fe934311e8", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd50de3fc33641aa996967fe934311e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd50de3fc33641aa996967fe934311e8"}]}] Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: cd50de3fc33641aa996967fe934311e8 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-DeleteServersTestJSON-317976476 Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: de8b634f360c40d595de8f641b1ac2ba Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-DeleteServersTestJSON-317976476-project Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: exception: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'abe720d8-e3b1-4d2f-9d14-218f7fcbe19a'} Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:50:05.369233 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] Returning 404 to user: Instance abe720d8-e3b1-4d2f-9d14-218f7fcbe19a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3468461f-c5be-4c81-b7bf-0221bbaf64c0 tempest-DeleteServersTestJSON-317976476 tempest-DeleteServersTestJSON-317976476-project] 10.222.0.27 "GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a" status: 404 len: 111 microversion: 2.1 time: 0.030505 Oct 19 01:50:05.373580 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3362/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:05 2022] GET /compute/v2.1/servers/abe720d8-e3b1-4d2f-9d14-218f7fcbe19a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:50:14.042195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1738189177", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "281ea901-731d-4e76-9c92-3e05076eb57f"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:14.114959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] validate_networks() for [('281ea901-731d-4e76-9c92-3e05076eb57f', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:50:14.514289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:50:14.514289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:50:14.514289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:50:14.514289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:50:14.514289 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:50:14.523545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:14.524095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:14.524601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:14.525444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:14.525936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:14.526419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:14.546193 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:50:14.551800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for user fcb986b39582494d9483241b4d38ce93 and project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:50:14.565498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:50:14.567885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:50:14.617214 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-db115550-e236-47d5-8e89-8f4bf74ed7ac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703641 Oct 19 01:50:14.618120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3248/6610] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:50:14.630073 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec65d7c8-cc47-404b-9147-da39f2d69c5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:14.631229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec65d7c8-cc47-404b-9147-da39f2d69c5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:14.691662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec65d7c8-cc47-404b-9147-da39f2d69c5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:14.700109 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec65d7c8-cc47-404b-9147-da39f2d69c5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1218 microversion: 2.1 time: 0.073894 Oct 19 01:50:14.701396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3363/6611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:14 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:15.725209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:15.725867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:15.741051 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:15.741695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:15.742009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:15.742848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:15.743382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:15.743804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:15.834001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:15.843848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f86e96df-4672-4b77-87f3-867e097f94c2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1278 microversion: 2.1 time: 0.124218 Oct 19 01:50:15.860753 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3249/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:15 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:16.867697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:16.868504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:16.870818 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=29 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:16.882223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:16.882842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:16.883492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:16.884561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:16.885149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:16.885711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:17.039898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:17.049151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec11facc-2efa-478e-a5aa-5fe6ec645c67 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.185499 Oct 19 01:50:17.049766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3364/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:16 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:17.588243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:17.600761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:17.601534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:17.601980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:17.618673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] Creating event network-changed:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h2-master-1 Oct 19 01:50:17.624189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-07e336d3-d4f1-4169-8d2e-6e131fe4e98a req-af02991b-8ea8-4f37-a702-5db82ed51c37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039945 Oct 19 01:50:17.624857 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3250/6614] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:50:18.074495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:18.076158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:18.083355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:18.084078 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:18.084635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:18.085557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:18.086043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:18.086632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:18.228370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:18.237547 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f86c4591-d598-4175-9f8e-c604c47fd5c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.167171 Oct 19 01:50:18.238150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3365/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:18 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:19.264999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:19.265706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:19.271732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:19.272219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:19.272683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:19.273379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:19.273836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:19.274270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:19.409346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:19.416899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-375ecb5d-2a6a-4ed4-b4fc-28a18a33ae36 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.158037 Oct 19 01:50:19.417478 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3251/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:19 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:20.441337 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:20.442083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:20.449766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:20.450772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:20.451164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:20.451999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:20.452531 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:20.453037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:20.590682 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:20.599274 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-561cdee9-e6ea-4339-96f8-4d78df4688f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.162883 Oct 19 01:50:20.599878 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3366/6617] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:20 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:21.624024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:21.624679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:21.631517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:21.632004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:21.632453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:21.633185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:21.633650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:21.634085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:21.764482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:21.772242 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5270fa87-3d38-4993-b5b9-3a96741a8d2b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.152741 Oct 19 01:50:21.772854 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3252/6618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:21 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:22.695630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "name": "network-vif-plugged", "status": "completed", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:22.708036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:22.708827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:22.709324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:22.722096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] Creating event network-vif-plugged:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h2-master-1 Oct 19 01:50:22.727710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a265e424-37ba-456c-9c7d-3bcf23b13c54 req-b313dfa9-ea69-456f-b2a9-e26580f9f3c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036225 Oct 19 01:50:22.728493 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3367/6619] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:50:22.796198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:22.796737 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:22.803621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:22.804109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:22.804574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:22.805301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:22.805760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:22.806195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:22.945133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:22.952982 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b522363b-f814-4db1-a1e0-438f023f3488 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1318 microversion: 2.1 time: 0.161517 Oct 19 01:50:22.953584 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3253/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:22 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:23.976266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:23.977014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:23.984473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:23.985011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:23.985470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:23.986191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:23.986663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:23.987107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.120462 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:24.128918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d6adbf71-5aff-49f3-8abf-dcd7e1ff5ae6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1508 microversion: 2.1 time: 0.157029 Oct 19 01:50:24.129505 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3368/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:23 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:24.151929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:24.152515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.159554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.160050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.160500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.161230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.161698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.162136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.295386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:24.303080 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e06f0418-0ecb-4670-bef5-fc997df059d2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1508 microversion: 2.1 time: 0.155138 Oct 19 01:50:24.303660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3254/6622] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:24 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:24.327963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:24.330403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.336377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.336917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.337378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.338097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.338571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.339019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.401353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa3677ff-3d86-4550-9ae0-6777c9530ced tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "PUT /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1080 microversion: 2.1 time: 0.077459 Oct 19 01:50:24.402219 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3369/6623] 10.222.0.27 () {60 vars in 1256 bytes} [Wed Oct 19 01:50:24 2022] PUT /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:24.421482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:24.422100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.428068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.428554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.429025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.429739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.430182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.430617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.535147 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:24.558755 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:24.563601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:24.571879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e370d3f-03d1-4de4-b215-febf87232437 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1506 microversion: 2.1 time: 0.154971 Oct 19 01:50:24.572484 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3255/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:24 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:24.594218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:24.594860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.601047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.601546 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.602004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.602729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.603186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.603634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.700136 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:24.742492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:24.750231 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e4c8229-20ba-4110-b8fe-a6ab8450967c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1506 microversion: 2.1 time: 0.160027 Oct 19 01:50:24.750807 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3370/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:24 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:24.774000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:24.776317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.782951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.783465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.783910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.784654 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.785147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.785588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.814381 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:24.820295 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Old instance type m1.heat2, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:50:24.827007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:50:24.827437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:50:24.827932 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:50:24.828340 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:50:24.828789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:50:24.892600 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53846c41-ae5a-4504-8c89-3dbf77a5964e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516/action" status: 202 len: 0 microversion: 2.1 time: 0.122594 Oct 19 01:50:24.893417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3256/6626] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:50:24 2022] POST /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:50:24.901634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:24.902384 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:24.909149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.909732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.910261 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:24.910988 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:24.911462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:24.911914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:25.050832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:25.059690 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-246ac76e-e2aa-4fe9-8ccf-0ba0ac4520b3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1517 microversion: 2.1 time: 0.161755 Oct 19 01:50:25.060396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3371/6627] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:24 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:26.083313 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:26.083939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:26.092150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:26.092658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:26.093121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:26.093830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:26.094295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:26.094729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:26.097399 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:26.227172 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:26.236012 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04d5c7c4-2b2b-4e6a-b0c1-cc6dba09331f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1517 microversion: 2.1 time: 0.156609 Oct 19 01:50:26.236642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3257/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:26 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:27.259239 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:27.259875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:27.266994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:27.267492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:27.267945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:27.268684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:27.269161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:27.269608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:27.410654 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:27.418422 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa8ef5ba-00cc-4c59-a994-63cf42a8c068 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.163190 Oct 19 01:50:27.419000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3372/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:27 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:28.444887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:28.445510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:28.448269 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:28.455013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:28.455509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:28.455955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:28.456689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:28.457160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:28.457597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:28.589300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:28.597497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81db0389-3ef5-436f-9fa0-c356652b9384 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.156686 Oct 19 01:50:28.598083 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3258/6630] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:28 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:29.621119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:29.621777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:29.625112 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:29.630763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:29.631271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:29.631740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:29.632463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:29.632961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:29.633412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:29.767375 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:29.775336 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-01744412-f1a3-42dc-ad87-e3310383b0a2 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.158078 Oct 19 01:50:29.775923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3373/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:29 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:30.799231 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:30.799853 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:30.806913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:30.807412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:30.807885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:30.808646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:30.809126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:30.809562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:30.940412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:30.948129 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3ff968b-acdd-4556-9564-6def88b73717 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.152826 Oct 19 01:50:30.948733 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3259/6632] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:30 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:31.972457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:31.973109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:31.979894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:31.980381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:31.980853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:31.981557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:31.982518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:31.982980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:32.115366 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:32.123766 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b84d5595-3b90-4339-92cb-8a3de0c45d5f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.155276 Oct 19 01:50:32.124343 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3374/6633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:31 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:33.147653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:33.148299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:33.155733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:33.156207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:33.156682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:33.157389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:33.157849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:33.158285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:33.292120 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:33.300428 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b5cd353e-5aa3-4b1e-8497-60dbcef7cfbe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.156707 Oct 19 01:50:33.300963 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3260/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:33 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:34.324273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:34.324938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:34.332244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:34.332770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:34.333229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:34.333938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:34.334415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:34.334866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:34.465980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:34.474189 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad95f882-d26e-4ab9-9717-6c288d3b263e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.153842 Oct 19 01:50:34.474771 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3375/6635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:34 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:35.497569 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:35.498178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:35.505973 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:35.506451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:35.506889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:35.507575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:35.508028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:35.508451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:35.643908 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:35.653107 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1b1ed1dc-c390-4052-9aef-874b5935f951 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.159430 Oct 19 01:50:35.653697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3261/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:35 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:36.676946 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:36.677585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:36.685051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:36.685553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:36.686017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:36.686733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:36.687209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:36.687656 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:36.817605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:36.825415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9cb7834-5187-44b2-b46c-fb26e4a92af0 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.152525 Oct 19 01:50:36.825998 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3376/6637] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:36 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:37.851153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:37.851773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:37.858162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:37.858647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:37.859085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:37.859785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:37.860276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:37.861255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:37.991642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:37.999434 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9e0335eb-68b8-4c94-b2b4-b81bc3b0d5b1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.153203 Oct 19 01:50:38.000015 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3262/6638] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:37 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:39.023214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:39.023887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:39.030858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:39.031363 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:39.031853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:39.032573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:39.033588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:39.034087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:39.167167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:39.175153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-596bfd1b-c627-47cc-9619-835cb4707592 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.155893 Oct 19 01:50:39.175735 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3377/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:39 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:40.198925 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:40.199546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:40.206892 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:40.207380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:40.207822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:40.208516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:40.209003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:40.209437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:40.339436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:40.347633 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f2271f3-e3e9-4480-857c-e149c46f3580 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.152698 Oct 19 01:50:40.348204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3263/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:40 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:41.371543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:41.372248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:41.379845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:41.380370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:41.380864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:41.381579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:41.382049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:41.382495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:41.522308 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:41.530095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-56e5135c-0ef5-486b-a0d8-c99423b55b5b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.162633 Oct 19 01:50:41.530677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3378/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:41 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:42.555508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:42.556130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:42.562906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:42.563392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:42.563839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:42.564822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:42.565730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:42.566174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:42.695494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:42.703229 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c387f966-46a5-47e9-b754-f7d73b4bdade tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.151611 Oct 19 01:50:42.703820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3264/6642] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:42 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:43.727472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:43.728059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:43.735119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:43.735615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:43.736077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:43.736824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:43.737903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:43.738353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:43.871725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:43.880349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c69bf8ba-0289-431e-adaf-08626ee45a1f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.157226 Oct 19 01:50:43.880988 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3379/6643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:43 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:44.903318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:44.903935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:44.910780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:44.911271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:44.911718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:44.912412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:44.912903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:44.913334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:45.044580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:45.052424 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73093061-ae53-4f81-a4a2-050b4e9cad4b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.153025 Oct 19 01:50:45.053032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3265/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:44 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:46.076831 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:46.077464 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:46.085013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:46.085524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:46.085971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:46.086679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:46.087143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:46.087582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:46.106583 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:46.217670 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:46.226074 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5315063-23bf-45db-a892-1d4666b771d8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.153268 Oct 19 01:50:46.226653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3380/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:46 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:47.249479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:47.250091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:47.257122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:47.257636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:47.258074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:47.258762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:47.259216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:47.259642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:47.395601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:47.403284 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c3ed678b-798a-4bf6-8769-66c496cae226 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.157657 Oct 19 01:50:47.403862 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3266/6646] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:47 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:48.427826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:48.428458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:48.435502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:48.435999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:48.436454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:48.437200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:48.437669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:48.438113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:48.568820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:48.576765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3ff7c64-4327-48e4-a37b-57c14802589d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.153435 Oct 19 01:50:48.577353 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3381/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:48 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:50:49.600697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:49.601338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:49.608294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:49.608837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:49.609275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:49.609995 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:49.610451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:49.610911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:49.746575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:49.755506 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24cbfd43-7681-4dcf-afef-2b2a0f7766f5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.159056 Oct 19 01:50:49.756091 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3267/6648] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:49 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:50.779419 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:50.780058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:50.787502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:50.788007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:50.788468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:50.789229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:50.789706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:50.790155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:50.918354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:50.926608 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cf199a99-a38a-445a-bbb6-dce9ae081210 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.151135 Oct 19 01:50:50.927183 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3382/6649] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:50 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:51.951007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:51.951615 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:51.959186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:51.959680 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:51.960128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:51.960870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:51.961333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:51.961769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:52.094938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:52.104048 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2faabfee-cb48-49ed-8a43-d4c92dfd8d63 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.156956 Oct 19 01:50:52.104642 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3268/6650] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:51 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:53.127410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:53.128063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:53.134861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:53.135359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:53.135808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:53.136510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:53.137008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:53.137445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:53.270299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:53.278132 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be1ad7c8-0778-45f9-aa91-9330d7fde965 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1522 microversion: 2.1 time: 0.154647 Oct 19 01:50:53.278726 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3383/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:53 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:54.302423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:54.303073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:54.309855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:54.310375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:54.310816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:54.311547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:54.312009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:54.312441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:54.561552 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:54.571232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ec42c33-d6ac-47ab-849f-be4b77be8187 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1521 microversion: 2.1 time: 0.273217 Oct 19 01:50:54.572046 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3269/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:54 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:54.667538 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "name": "network-vif-unplugged", "status": "completed", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:54.678847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:54.679349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:54.679802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:54.692828 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Creating event network-vif-unplugged:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h1-master-1 Oct 19 01:50:54.698596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] Instance 73d683a1-4664-4e24-9442-c54eacce9516 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:50:54.710345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9ea67ae9-fc52-4512-af8d-3739871f6736 req-34678550-e17d-4439-8c79-28ac06d0ecc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046574 Oct 19 01:50:54.710978 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3384/6653] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:50:55.594479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:55.595131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:55.602707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:55.603191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:55.603630 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:55.604321 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:55.604810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:55.605238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:55.734326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:55.742411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-37f4e1ad-8c62-46b2-890e-6c24d27e922a tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1519 microversion: 2.1 time: 0.151925 Oct 19 01:50:55.742987 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3270/6654] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:55 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:56.746438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:56.755979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:56.756474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:56.756955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:56.766149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:56.766773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:56.768522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Creating event network-changed:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h1-master-1 Oct 19 01:50:56.773781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:56.773966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] Instance 73d683a1-4664-4e24-9442-c54eacce9516 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:50:56.774213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:56.774661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:56.775397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:56.775857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:56.776296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:56.779026 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=84 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:56.785836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ca9ce6a0-414c-4a7a-8f0a-e49fa10776cc req-476fce0c-d2e5-4f43-9122-f8a565b91df5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044325 Oct 19 01:50:56.786466 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3385/6655] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:50:56.910017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:56.918143 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7002324b-398e-4a38-94aa-4368d1297a9f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1519 microversion: 2.1 time: 0.155863 Oct 19 01:50:56.918732 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3271/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:56 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:50:57.943564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:57.944285 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:57.951352 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:57.951847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:57.952299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:57.953035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:57.953505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:57.953944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:58.087232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:58.095145 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c719a43-0524-4088-983d-74a62d9a5079 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1516 microversion: 2.1 time: 0.156370 Oct 19 01:50:58.095717 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3386/6657] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:57 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:58.118377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:50:58.118952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:58.125865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:58.126357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:58.126799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:58.127542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:58.128000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:58.128431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:58.184829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4cb3858e-8ffb-4e5d-a79f-04c57bbddeac tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516/action" status: 204 len: 0 microversion: 2.1 time: 0.070127 Oct 19 01:50:58.185559 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3272/6658] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:50:58 2022] POST /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516/action => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:50:58.194143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:58.194697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:58.200851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:58.201353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:58.201803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:58.202517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:58.202983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:58.203423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:58.342435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:58.351850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa628e22-0f4a-441b-a5d6-363fd89af270 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1516 microversion: 2.1 time: 0.161657 Oct 19 01:50:58.352443 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3387/6659] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:58 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:50:59.377006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:50:59.377919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:50:59.380724 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=30 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:50:59.386172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:59.386661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:59.387111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:59.387812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:50:59.388285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:50:59.388733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:50:59.530139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:50:59.538564 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fbd794c0-9deb-43c9-9c79-f9e3df6de368 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1516 microversion: 2.1 time: 0.166038 Oct 19 01:50:59.539159 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3273/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:50:59 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:00.537567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "name": "network-vif-plugged", "status": "completed", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:00.547594 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=30 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:00.551446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:00.552376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:00.552868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:00.563233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:00.563934 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:00.565079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] Creating event network-vif-plugged:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h1-master-1 Oct 19 01:51:00.570796 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c8ef58e0-fd12-44d5-a897-ab4306b39b8c req-ff635cd1-7f91-432d-8849-11cea0e6057e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037302 Oct 19 01:51:00.571605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:00.571793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3388/6661] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:00.572549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:00.573089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:00.574012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:00.574539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:00.575237 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:00.705793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:00.713585 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9c7937f4-d6c4-4bf4-b21e-7658fd410baa tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1508 microversion: 2.1 time: 0.154300 Oct 19 01:51:00.714173 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3274/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:00 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:00.738259 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:00.738987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:00.745274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:00.745779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:00.746238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:00.746953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:00.747427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:00.747872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:00.880243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:00.888055 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9c4a083-888b-4914-b4ab-408cfbb8e103 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1508 microversion: 2.1 time: 0.154895 Oct 19 01:51:00.888658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3389/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:00 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:00.914961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a126f49a-310d-4165-ba06-76e7ad42e79f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'create', calling method: .version_select at 0x7f2af486a280>, body: {"keypair": {"name": "tempest-keypair-310278209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQAhn0r5yuXRDmwPlOOg+EYC/eSaYKOS0MdhtuvppLxsxCXjao+emBSnnKhIgWQhEu8dcXJNE5DxEOvFij84DfzHXJw4iP67s+nqgya9YTcbIIA1mPLB5hSpbRfja5e1Q=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:00.930547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a126f49a-310d-4165-ba06-76e7ad42e79f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:51:00.935660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a126f49a-310d-4165-ba06-76e7ad42e79f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for user fcb986b39582494d9483241b4d38ce93 and project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:51:00.963589 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a126f49a-310d-4165-ba06-76e7ad42e79f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052611 Oct 19 01:51:00.964208 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3275/6664] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:51:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:02.131238 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:02.131867 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:02.138770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:02.139262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:02.139748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:02.140451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:02.140947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:02.141386 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:02.274440 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:02.282212 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1a206a78-082e-42d3-a53b-7da917b24b1d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 200 len: 1508 microversion: 2.1 time: 0.154898 Oct 19 01:51:02.282722 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3390/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:02 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:02.307007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:02.307525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:02.314149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:02.314896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:02.315347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:02.316060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:02.316527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:02.316993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:02.342274 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:51:02.417429 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60b14dda-99a6-4045-846d-8fde5283a7b8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 204 len: 0 microversion: 2.1 time: 0.115254 Oct 19 01:51:02.418032 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3276/6666] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:51:02 2022] DELETE /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:51:02.474605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1622230540", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "281ea901-731d-4e76-9c92-3e05076eb57f"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:02.527981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] validate_networks() for [('281ea901-731d-4e76-9c92-3e05076eb57f', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:51:03.266852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:51:03.267354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:51:03.267778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:51:03.268212 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:51:03.268662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:51:03.277577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:03.278082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:03.278538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:03.279321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:03.279797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:03.280246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:03.296924 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:51:03.302997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Getting quotas for user fcb986b39582494d9483241b4d38ce93 and project e176820ed6b041a3ba53ba3a48d981bc. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:51:03.316228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:51:03.318559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:51:03.365483 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7cdeaa0a-27b0-48ff-ac53-f8e47ed88524 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895439 Oct 19 01:51:03.366610 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3391/6667] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:51:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:51:03.379156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3e81e575-5b60-46b8-8598-70d15fa2edab tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:03.379905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3e81e575-5b60-46b8-8598-70d15fa2edab tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:03.436667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3e81e575-5b60-46b8-8598-70d15fa2edab tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:03.445324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3e81e575-5b60-46b8-8598-70d15fa2edab tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1218 microversion: 2.1 time: 0.071369 Oct 19 01:51:03.445906 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3277/6668] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:03 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:04.468718 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:04.469349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:04.477168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:04.477672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:04.478140 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:04.478854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:04.479327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:04.479771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:04.576801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:04.586586 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c352ef45-0e68-4e8d-900c-31c22dda22cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1270 microversion: 2.1 time: 0.122612 Oct 19 01:51:04.587334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3392/6669] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:04 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:04.640329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73d683a1-4664-4e24-9442-c54eacce9516", "name": "network-vif-deleted", "tag": "5fed393d-a669-4450-a7ba-5a0a291cfb32"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:04.653915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:04.654398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:04.655033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:04.667011 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] Creating event network-vif-deleted:5fed393d-a669-4450-a7ba-5a0a291cfb32 for instance 73d683a1-4664-4e24-9442-c54eacce9516 on n-h1-master-1 Oct 19 01:51:04.674386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c60e9530-a02d-4867-ab26-cdcbab476522 req-ae59e695-4c53-4998-ae2e-6a655ab5fe69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036880 Oct 19 01:51:04.675452 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3278/6670] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:05.609559 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:05.610321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:05.618086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:05.618590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:05.619041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:05.619764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:05.620328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:05.620801 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:05.803418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:05.812389 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d84204a-0a0b-4180-acfc-f506d8f41b50 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.207016 Oct 19 01:51:05.813006 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3393/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:05 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:06.700820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:06.711002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:06.711481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:06.711922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:06.723051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] Creating event network-changed:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h1-master-1 Oct 19 01:51:06.728386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-2b3046be-5a7f-40fe-8cad-19e4ac778006 req-0ed582cd-fcff-4cf6-96d5-c9a72198e2c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032421 Oct 19 01:51:06.729199 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3279/6672] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:51:06.836684 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:06.837358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:06.844396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:06.844880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:06.845367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:06.846295 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:06.846786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:06.847236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:07.002648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:07.011985 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-73784a4b-ed71-4d16-87a2-dcc2a30a3b3d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.179145 Oct 19 01:51:07.012766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3394/6673] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:06 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:08.041298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:08.042002 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:08.048574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:08.049279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:08.049966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:08.051268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:08.051370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:08.051775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:08.261771 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:08.270113 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-554c4403-32fd-4baa-9c41-34c94ea1451d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.233951 Oct 19 01:51:08.270694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3280/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:08 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:09.293370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:09.293913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:09.300966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:09.301462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:09.301914 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:09.302621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:09.303085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:09.303524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:09.435478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:09.444137 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79b1369e-102b-434f-95b7-979808d2c46c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.154744 Oct 19 01:51:09.444749 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3395/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:09 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:10.468524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:10.469169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:10.478578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:10.479069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:10.479512 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:10.480245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:10.480728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:10.481163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:10.618114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:10.620403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "name": "network-vif-plugged", "status": "completed", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:10.628033 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6b0836b-462f-423d-9fce-b041c47188f6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.163247 Oct 19 01:51:10.629467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3281/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:10 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:10.632885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:10.633389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:10.633836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:10.646434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] Creating event network-vif-plugged:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h1-master-1 Oct 19 01:51:10.651552 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-c7e0c519-1e61-4333-9509-6279eee0470a req-e7dab4fc-9865-40b9-9910-3a2a63f71d01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036269 Oct 19 01:51:10.652333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3396/6677] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:51:11.652461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:11.653040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:11.659992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:11.660453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:11.660917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:11.661605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:11.662062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:11.662490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:11.796773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:11.805125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86e16c54-fd29-4800-a991-8afd3d4b90a7 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1318 microversion: 2.1 time: 0.156553 Oct 19 01:51:11.805713 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3282/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:11 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:12.830721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:12.831389 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:12.837630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:12.838129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:12.838586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:12.839290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:12.839760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:12.840203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:12.974490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:12.982226 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa8e6773-9c4d-4554-9556-503c698964c1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1509 microversion: 2.1 time: 0.157961 Oct 19 01:51:12.982817 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3397/6679] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:12 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:13.006108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:13.006731 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:13.016396 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.017388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.018217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.019345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.020050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.020579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.155899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:13.163659 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ed4f6d5-d930-4726-ab69-b5845387a15b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1509 microversion: 2.1 time: 0.162535 Oct 19 01:51:13.164243 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3283/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:12 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:13.186679 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:13.189124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:13.195811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.196311 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.196802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.197504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.197967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.198403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.226884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:13.232354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Old instance type m1.heat2, new instance type m1.heat {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:51:13.239582 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:51:13.240009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:51:13.240491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:51:13.240939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:51:13.241361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:51:13.277811 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:13.291871 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:13.308669 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ffec76f-c9e7-4761-8aa3-34eb2e576db8 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c/action" status: 202 len: 0 microversion: 2.1 time: 0.125857 Oct 19 01:51:13.309298 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3398/6681] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:51:13 2022] POST /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:51:13.317778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:13.318523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:13.324506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.324888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.325332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.326032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:13.326480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:13.326924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:13.441549 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:13.468383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:13.476787 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a8ea07b0-942b-40e1-8598-0e230d961578 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1516 microversion: 2.1 time: 0.163210 Oct 19 01:51:13.477368 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3284/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:13 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:14.497237 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:14.503067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:14.505152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:14.514486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:14.515132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:14.515594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:14.516327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:14.516831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:14.517279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:14.738170 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:14.745959 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1bc51147-f594-4e3f-ae44-61b57ac1a9fb tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1516 microversion: 2.1 time: 0.249524 Oct 19 01:51:14.746554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3399/6683] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:14 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:15.770048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:15.770786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:15.777734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:15.778228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:15.778678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:15.779375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:15.779843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:15.780278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:15.907773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:15.915554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e9f78ecc-6d0c-480b-97a2-82bc4c6cd30f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.150452 Oct 19 01:51:15.916140 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3285/6684] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:15 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:16.939774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:16.940397 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:16.947354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:16.947845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:16.948291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:16.949051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:16.949517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:16.949964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:17.080809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:17.088805 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9cff445-7937-4c9d-8c99-84f72cc92ffd tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.153301 Oct 19 01:51:17.089557 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3400/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:16 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:18.111759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:18.112400 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:18.119430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:18.119926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:18.120374 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:18.121110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:18.121585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:18.122027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:18.253598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:18.261304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-82294048-81de-4212-ba18-6dc12371acfe tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.153517 Oct 19 01:51:18.261883 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3286/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:18 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:19.286219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:19.286762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:19.293545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:19.294039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:19.294483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:19.295186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:19.295646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:19.296094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:19.426120 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:19.433923 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-02c4541e-aa71-4da1-a4ab-a4ed2df389a9 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.152496 Oct 19 01:51:19.434498 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3401/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:19 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:20.457423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:20.458076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:20.464897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:20.465389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:20.465837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:20.466539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:20.467005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:20.467441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:20.602451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:20.610105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b74243ac-3015-4e85-aa98-6317489aaf61 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.156656 Oct 19 01:51:20.611437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3287/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:20 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:21.635409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:21.636039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:21.643912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:21.644419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:21.644907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:21.645634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:21.646109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:21.646568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:21.776642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:21.784722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d84ad947-1d79-446d-ac1b-aebab9876fb5 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.153324 Oct 19 01:51:21.785305 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3402/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:21 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:22.808461 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:22.809122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:22.816673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:22.817170 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:22.817614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:22.818315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:22.818777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:22.819216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:22.823260 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:22.951978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:22.960368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5875db98-46f0-48d8-a710-84f2780ec646 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.155891 Oct 19 01:51:22.960978 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3288/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:22 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:23.984765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:23.985405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:23.992203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:23.992750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:23.993212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:23.993929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:23.994402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:23.994853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:24.132105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:24.140020 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7936a1c-787d-4bda-b449-69d6f9f3ac29 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.159401 Oct 19 01:51:24.140607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3403/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:23 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:25.164006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:25.164641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:25.171671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:25.172158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:25.172600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:25.173894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:25.174360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:25.174795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:25.304184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:25.311874 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b10bf710-6605-4ed2-aad5-83256b7d708d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.151819 Oct 19 01:51:25.312453 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3289/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:25 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:26.336377 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:26.337056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:26.344292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:26.345606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:26.346077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:26.346791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:26.347265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:26.347709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:26.479029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:26.487709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-188c8d4f-fbbc-4cf7-801a-d43b2cacfd97 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.155272 Oct 19 01:51:26.488292 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3404/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:26 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:27.511927 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:27.512540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:27.520481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:27.521360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:27.521543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:27.522717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:27.522717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:27.523083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:27.665050 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:27.674222 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-920efa0e-3443-4050-a3b2-5838337b887e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.166188 Oct 19 01:51:27.674810 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3290/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:27 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:28.699412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:28.700042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:28.707432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:28.707943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:28.708381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:28.709112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:28.709579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:28.710021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:28.845740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:28.853723 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8f05af0f-0555-4e09-8fd1-3d373d7a19e1 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.158262 Oct 19 01:51:28.854492 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3405/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:28 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:29.877596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:29.878212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:29.880946 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:29.886381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:29.886875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:29.887314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:29.888002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:29.888457 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:29.888976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:30.019139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:30.026855 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3899797-31eb-4d73-9462-be78cf4dd296 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.153299 Oct 19 01:51:30.027456 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3291/6696] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:29 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:31.051387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:31.051893 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:31.054653 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:31.060009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:31.060516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:31.061002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:31.061737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:31.062215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:31.062669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:31.195100 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:31.202914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ac99f0e-c961-46ba-9c5a-4394f707a046 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.156580 Oct 19 01:51:31.203497 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3406/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:31 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:32.226393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:32.227013 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:32.234395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:32.234871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:32.235337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:32.236284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:32.236785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:32.237219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:32.370185 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:32.378690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af90aa34-f533-481f-844b-239a1d2daa66 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.156250 Oct 19 01:51:32.379584 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3292/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:32 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:33.402299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:33.402928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:33.405413 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:51:33.405559 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:51:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c (ip 10.222.0.27) !!! Oct 19 01:51:33.413015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:33.413510 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:33.413961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:33.414677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:33.415144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:33.415585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:33.546439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:33.554925 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-458df0cc-6f15-4f22-9616-4dbf98f74f74 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.156555 Oct 19 01:51:33.555508 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3407/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:33 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:34.579759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:34.580414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:34.586909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:34.587401 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:34.587852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:34.588552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:34.589047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:34.589484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:34.723645 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:34.731853 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca648222-f123-45d8-ba7d-d623ff97d31f tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.157272 Oct 19 01:51:34.732432 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3293/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:34 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:35.756169 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:35.756861 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:35.763740 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:35.764234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:35.764705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:35.765412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:35.765876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:35.766345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:35.894457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:35.902408 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dc300d52-0e78-4499-ac19-e8d635aee3d4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.150153 Oct 19 01:51:35.903037 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3408/6701] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:35 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:36.927413 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:36.928038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:36.935037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:36.935530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:36.935981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:36.936708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:36.937176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:36.937610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:37.069948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:37.077865 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0b865944-5765-4ed2-8355-812c7d96a8b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.155004 Oct 19 01:51:37.078452 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3294/6702] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:36 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:38.102044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:38.102772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:38.109717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:38.110223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:38.110688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:38.111419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:38.111888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:38.112338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:38.249001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:38.257383 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27b35106-767f-44e3-a595-d284446c0e09 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.159337 Oct 19 01:51:38.257965 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3409/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:38 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:39.280880 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:39.281494 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:39.288163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:39.288669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:39.289113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:39.289808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:39.290259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:39.290689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:39.421597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:39.429993 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df85c367-b85c-4ba8-a46c-2d5a6161c44b tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.152976 Oct 19 01:51:39.430580 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3295/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:39 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:40.454590 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:40.455215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:40.462123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:40.462613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:40.463063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:40.463796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:40.464262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:40.464729 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:40.602010 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:40.609812 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-997df900-61cd-40f2-bbcf-435f273e5378 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.159210 Oct 19 01:51:40.610501 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3410/6705] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:40 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:41.633639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:41.634258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:41.641594 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:41.642088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:41.642535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:41.643234 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:41.643698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:41.644132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:41.773159 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:41.780856 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-71ff9ae4-6ae0-4668-aac2-7cb21c49b4c6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1521 microversion: 2.1 time: 0.151202 Oct 19 01:51:41.781438 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3296/6706] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:41 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:42.805963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:42.806508 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:42.813966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:42.814932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:42.815392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:42.816123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:42.816599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:42.817133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:42.925455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "name": "network-vif-unplugged", "status": "completed", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:42.936495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:42.937061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:42.937626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:42.952673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Creating event network-vif-unplugged:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h2-master-1 Oct 19 01:51:42.958852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] Instance daa79ae1-c13b-4885-8e91-1eecea31378c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:51:42.963781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:42.971075 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-230971a6-b741-45d8-ad3f-83eadd8fa0d4 req-26ec8a90-65e3-4b1b-a6de-326b2134ea18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050020 Oct 19 01:51:42.971690 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3297/6707] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:51:42.972841 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-338fc766-f83c-4f04-b1a9-60289bee6f2d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1520 microversion: 2.1 time: 0.170986 Oct 19 01:51:42.973501 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3411/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:42 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:43.998146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:43.999469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:44.008838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:44.009349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:44.009783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:44.010493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:44.010952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:44.011391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:44.151998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:44.160524 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-63957af0-b10b-4875-82df-70d0f4270328 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1520 microversion: 2.1 time: 0.166775 Oct 19 01:51:44.161204 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3298/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:43 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:44.991960 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:45.002797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:45.003397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:45.003856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:45.006525 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:45.018091 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Creating event network-changed:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h2-master-1 Oct 19 01:51:45.024031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] Instance daa79ae1-c13b-4885-8e91-1eecea31378c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:51:45.035498 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-76277402-c444-41ce-86d8-09b81a349939 req-0ce97562-3f09-4071-bfa3-4cf626a1258d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047543 Oct 19 01:51:45.036061 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3412/6710] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:45.183391 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:45.184018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:45.191208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:45.191702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:45.192153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:45.192885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:45.193353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:45.193931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:45.744404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:45.754379 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2c185778-117a-4a57-89a1-04136cf20cf3 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1518 microversion: 2.1 time: 0.574970 Oct 19 01:51:45.755977 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3299/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:45 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1518 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:46.784799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:46.785546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:46.792716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:46.793436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:46.793937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:46.794790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:46.795430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:46.795898 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:46.928031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:46.935808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-277a2311-2ff0-4b82-8cd9-c0466ea96216 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1515 microversion: 2.1 time: 0.157277 Oct 19 01:51:46.936395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3413/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:46 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:46.960851 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:46.961387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:46.968061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:46.968546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:46.969611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:46.970323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:46.970791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:46.972214 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:47.034155 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e0d79fc4-04c4-4d2e-b314-d36611644c82 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "POST /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c/action" status: 204 len: 0 microversion: 2.1 time: 0.077066 Oct 19 01:51:47.034811 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3300/6713] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:51:46 2022] POST /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:51:47.043374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:47.044485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:47.051800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:47.052317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:47.052814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:47.053579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:47.054057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:47.054542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:47.185962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:47.194831 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-906cb436-4d72-4eb9-96e5-e29d15ef9782 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1515 microversion: 2.1 time: 0.155643 Oct 19 01:51:47.195434 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3414/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:47 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:51:48.221089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:48.221938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:48.229347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:48.229914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:48.230392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:48.231099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:48.231587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:48.232024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:48.429929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:48.440285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e34ba578-0729-4073-9db4-cd50abb45736 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1515 microversion: 2.1 time: 0.224644 Oct 19 01:51:48.442213 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3301/6715] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:48 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:49.188869 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "name": "network-vif-plugged", "status": "completed", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:49.200238 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.200955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.201272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.215772 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] Creating event network-vif-plugged:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h2-master-1 Oct 19 01:51:49.223946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5fd95875-9515-4592-8026-1bc24e59101d req-e26266a0-a4a3-49a5-a3ed-afe0fe36ce12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039455 Oct 19 01:51:49.225204 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3415/6716] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:49.464887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:49.465514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:49.472671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.473168 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.473612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.474312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.474780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.475368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.607608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:49.615946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e369c235-0d84-4df0-a2c0-2214a8ebf06d tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1507 microversion: 2.1 time: 0.154976 Oct 19 01:51:49.616518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3302/6717] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:49 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:49.638795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:49.639528 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:49.646237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.646730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.647175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.647876 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.648341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.648815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.782470 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:49.790217 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7b8cf738-93ad-4017-85d6-d2a64c43b285 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1507 microversion: 2.1 time: 0.155671 Oct 19 01:51:49.790797 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3416/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:49 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:49.812140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:49.812783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:49.818864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.819345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.819787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.820473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.820961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.821388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.952262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:49.960473 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-673f62c3-e750-43d6-ab3c-73ccdc2b4e83 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1507 microversion: 2.1 time: 0.152137 Oct 19 01:51:49.961142 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3303/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:49 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:49.983386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:49.983909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:49.989972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.990481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.990931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:49.991644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:49.992119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:49.992573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:50.018242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:51:50.095268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ef7d3a1e-1aa3-4b67-8e57-c42b547744e4 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 204 len: 0 microversion: 2.1 time: 0.115537 Oct 19 01:51:50.095885 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3417/6720] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:51:49 2022] DELETE /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:51:50.114456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:50.114997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:50.121420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:50.122160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:50.122616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:50.123322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:50.123787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:50.124224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:50.128044 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:51:50.153725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:51:50.198690 n-d-master-1 devstack@n-api.service[131450]: INFO nova.compute.api [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Instance is already in deleting state, ignoring this request Oct 19 01:51:50.199517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-748b3c41-2c06-43ef-bf68-4ed1720f8b07 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 204 len: 0 microversion: 2.1 time: 0.090627 Oct 19 01:51:50.200077 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3304/6721] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:51:50 2022] DELETE /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:51:50.209407 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:50.210162 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:50.216945 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:50.217448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:50.217899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:50.218609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:50.219237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:50.219672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:50.351243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:50.358984 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e4328b27-5905-43ab-910e-ac6d49db285c tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1513 microversion: 2.1 time: 0.153848 Oct 19 01:51:50.360101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3418/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:50 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:51.382996 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:51.383621 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:51.391128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:51.391656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:51.392107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:51.392842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:51.393306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:51.393743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:51.526372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcb986b39582494d9483241b4d38ce93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e176820ed6b041a3ba53ba3a48d981bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:51:51.534588 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ebf6fb8-0669-4009-95dd-daa04365aeea tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 200 len: 1513 microversion: 2.1 time: 0.155513 Oct 19 01:51:51.535157 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3305/6723] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:51 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:51:52.026529 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa79ae1-c13b-4885-8e91-1eecea31378c", "name": "network-vif-deleted", "tag": "6d25ad7a-9f92-4a6f-87c3-1103352fe74b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:51:52.040948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:52.041582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:52.042109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:52.055578 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] Creating event network-vif-deleted:6d25ad7a-9f92-4a6f-87c3-1103352fe74b for instance daa79ae1-c13b-4885-8e91-1eecea31378c on n-h2-master-1 Oct 19 01:51:52.063339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-04140023-2185-487e-b447-2cea5e25b3d5 req-810414c3-a978-4ae0-a71d-fdc33e37d276 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039437 Oct 19 01:51:52.064491 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3419/6724] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:51:52.558347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:52.558995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: daa79ae1-c13b-4885-8e91-1eecea31378c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:52.566124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:52.566606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:52.567042 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:52.567728 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:52.568181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:52.568606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:52.582345 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] HTTP exception thrown: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Request method failure captured: Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c HTTP/1.1 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1fV0JwOxwVBjqoONC5UX1R3ReCdzfhNb97tNrlb2miEl-DiI8PYPJalEi0AWU7LaUkFG8tM5lhEu2eoyRk3x6PcD-mnPhJyqFtqJAT30NRZU8mkSaDKDi8skjSoKDik_iyxTtjmTU09fUWbue6MQPmebEcFOL_FOszizqj8FUi4qYM Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e176820ed6b041a3ba53ba3a48d981bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}] Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fcb986b39582494d9483241b4d38ce93 Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: exception: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'daa79ae1-c13b-4885-8e91-1eecea31378c'} Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:52.583944 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Returning 404 to user: Instance daa79ae1-c13b-4885-8e91-1eecea31378c could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aca26c16-b31f-4357-ae64-0003c125d4cf tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c" status: 404 len: 111 microversion: 2.1 time: 0.030979 Oct 19 01:51:52.588895 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3306/6725] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:52 2022] GET /compute/v2.1/servers/daa79ae1-c13b-4885-8e91-1eecea31378c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:51:52.595852 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-79901af9-8239-4750-b389-b550912c69ce tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '.version_select at 0x7f2af9370f70>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:52.619176 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-79901af9-8239-4750-b389-b550912c69ce tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310278209" status: 202 len: 0 microversion: 2.1 time: 0.028632 Oct 19 01:51:52.619769 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3420/6726] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310278209 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:51:53.211237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:53.211738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:53.217746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:53.218226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:53.219147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:53.219953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:53.220431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:53.220924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:53.235207 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] HTTP exception thrown: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Request method failure captured: Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 HTTP/1.1 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1fV0JwOxwVBjqoONC5UX1R3ReCdzfhNb97tNrlb2miEl-DiI8PYPJalEi0AWU7LaUkFG8tM5lhEu2eoyRk3x6PcD-mnPhJyqFtqJAT30NRZU8mkSaDKDi8skjSoKDik_iyxTtjmTU09fUWbue6MQPmebEcFOL_FOszizqj8FUi4qYM Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e176820ed6b041a3ba53ba3a48d981bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}] Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: fcb986b39582494d9483241b4d38ce93 Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '73d683a1-4664-4e24-9442-c54eacce9516'} Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:51:53.236791 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Returning 404 to user: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ba53ac14-2b16-4f64-9b48-c9a18a9cf75e tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "DELETE /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 404 len: 111 microversion: 2.1 time: 0.030903 Oct 19 01:51:53.241347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3307/6727] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:51:53 2022] DELETE /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:51:53.247931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:51:53.248796 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] [instance: 73d683a1-4664-4e24-9442-c54eacce9516] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:51:53.255762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:53.256263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:53.256756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:53.257472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:51:53.257947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:51:53.258404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:51:53.271593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] HTTP exception thrown: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Request method failure captured: Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 HTTP/1.1 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1fV0JwOxwVBjqoONC5UX1R3ReCdzfhNb97tNrlb2miEl-DiI8PYPJalEi0AWU7LaUkFG8tM5lhEu2eoyRk3x6PcD-mnPhJyqFtqJAT30NRZU8mkSaDKDi8skjSoKDik_iyxTtjmTU09fUWbue6MQPmebEcFOL_FOszizqj8FUi4qYM Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e176820ed6b041a3ba53ba3a48d981bc", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e176820ed6b041a3ba53ba3a48d981bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e176820ed6b041a3ba53ba3a48d981bc"}]}] Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: e176820ed6b041a3ba53ba3a48d981bc Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1697394269 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: fcb986b39582494d9483241b4d38ce93 Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerDiskConfigTestJSON-1697394269-project Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '73d683a1-4664-4e24-9442-c54eacce9516'} Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:51:53.273266 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] Returning 404 to user: Instance 73d683a1-4664-4e24-9442-c54eacce9516 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa2f993e-7730-4586-bee9-6e438836c1b6 tempest-ServerDiskConfigTestJSON-1697394269 tempest-ServerDiskConfigTestJSON-1697394269-project] 10.222.0.27 "GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516" status: 404 len: 111 microversion: 2.1 time: 0.031713 Oct 19 01:51:53.277832 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3421/6728] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:51:53 2022] GET /compute/v2.1/servers/73d683a1-4664-4e24-9442-c54eacce9516 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:52:01.723678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04efd072-b957-4199-a1d0-919f9c8ba268 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: .version_select at 0x7f2af4bf1af0>, body: {"keypair": {"name": "tempest-keypair-815665172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0cxTmaEnVd7sZBRY8GkqqWzUmbpTejIrfdWYFZEUxzI9s7RIioQ6Rv9E8oRVQjlQ8lrpEcaBN3cxfgDJBCniXbyVfI81pBcZj8hRyFzj+9NwUw5Pmzwce6UNkjySpU2w=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:01.730223 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:01.742859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-04efd072-b957-4199-a1d0-919f9c8ba268 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:52:01.748186 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-04efd072-b957-4199-a1d0-919f9c8ba268 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:52:01.773413 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04efd072-b957-4199-a1d0-919f9c8ba268 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182118 Oct 19 01:52:01.774282 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3308/6729] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:52:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:52:03.081430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1100927699", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "36ba6ca3-54fd-4a5c-8d41-71cfc43609cb"}], "security_groups": [{"name": "tempest-securitygroup--368058306"}], "key_name": "tempest-keypair-815665172", "user_data": "}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:03.096180 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:03.205276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] validate_networks() for [('36ba6ca3-54fd-4a5c-8d41-71cfc43609cb', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:52:03.263365 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:03.591671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:52:03.592215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:52:03.592834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:52:03.593840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:52:03.594345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:52:03.603429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:03.604023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:03.604490 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:03.605280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:03.605760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:03.606209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:03.624183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:52:03.629879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:52:03.642381 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:52:03.644783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:52:03.693506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ff3c3461-e784-4665-91fd-30e6bc51686d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.617427 Oct 19 01:52:03.694359 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3422/6730] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:52:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:52:03.703566 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:03.707977 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-238741ff-3f82-4336-b49f-64d01ff69c94 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:03.708610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-238741ff-3f82-4336-b49f-64d01ff69c94 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:03.787947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-238741ff-3f82-4336-b49f-64d01ff69c94 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:03.797603 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-238741ff-3f82-4336-b49f-64d01ff69c94 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1238 microversion: 2.1 time: 0.094982 Oct 19 01:52:03.798911 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3309/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:03 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:04.822475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:04.823878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:04.830888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:04.831397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:04.831854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:04.832581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:04.833168 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:04.833590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:04.899159 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:04.908175 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9dbcc4ce-7b88-4e59-a396-981745a046d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1290 microversion: 2.1 time: 0.090493 Oct 19 01:52:04.909016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3423/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:04 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:05.932070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:05.932843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:05.940890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:05.942192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:05.942641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:05.944420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:05.944937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:05.945402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:06.159789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:06.168450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f88e723-9050-46b2-a683-9e9d69411db5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.240733 Oct 19 01:52:06.169456 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3310/6733] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:05 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:06.772372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:06.783916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:06.784411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:06.784884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:06.796150 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] Creating event network-changed:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h1-master-1 Oct 19 01:52:06.802205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ea758004-9ff0-401a-a445-8156621730e3 req-684931f9-3b5a-493f-8972-ede404d0ee10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033699 Oct 19 01:52:06.802747 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3424/6734] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:52:07.193080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:07.193716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:07.200847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:07.201383 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:07.201824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:07.203045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:07.203503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:07.203928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:07.626384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:07.634266 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a2a5f94-f37f-4cb1-a567-bbe8526b5711 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.445372 Oct 19 01:52:07.634857 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3311/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:07 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:08.660484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:08.661232 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:08.667713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:08.668230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:08.668718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:08.669507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:08.669982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:08.670432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:08.894815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:08.902928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22a6e3af-9cfb-4c32-8bf8-50a0a89fad17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.248988 Oct 19 01:52:08.903734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3425/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:08 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:09.927993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:09.928631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:09.935306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:09.935796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:09.936244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:09.937020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:09.938547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:09.939241 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:10.075357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:10.083102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-690272c7-a3a3-4792-ad12-6b20842a11b5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.159273 Oct 19 01:52:10.083679 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3312/6737] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:09 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:11.017889 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "name": "network-vif-plugged", "status": "completed", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:11.027975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:11.028476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:11.028975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:11.041240 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] Creating event network-vif-plugged:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h1-master-1 Oct 19 01:52:11.046326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d70cf2b6-c928-4eea-9551-dbb56aeb5ec4 req-9d7942c1-4150-4cce-b944-6c87ac5ecba6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032712 Oct 19 01:52:11.048332 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3426/6738] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:52:11.106273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:11.106861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:11.113990 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:11.114485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:11.114940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:11.115652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:11.116121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:11.116559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:11.299410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:11.307368 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dfb9e73d-83e5-4577-aebe-611e2cc0bbb7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.205105 Oct 19 01:52:11.307966 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3313/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:11 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:12.337382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:12.338123 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:12.344968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:12.345457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:12.345907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:12.346610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:12.347075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:12.347516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:12.480545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:12.488990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-04fad91e-5fae-4d30-bf36-21d31bc85992 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1363 microversion: 2.1 time: 0.156691 Oct 19 01:52:12.489587 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3427/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:12 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:13.513503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:13.514122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:13.521601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:13.522090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:13.522534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:13.523230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:13.523686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:13.524121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:13.655377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:13.663611 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65eb5d49-110c-4864-a1de-66e096970bf0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1549 microversion: 2.1 time: 0.154034 Oct 19 01:52:13.664210 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3314/6741] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:13 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:13.688121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:13.688655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:13.691731 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:13.692538 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:13.698340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:13.698831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:13.699284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:13.699990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:13.700457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:13.700949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:13.781373 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-863400fa-7e4d-45ab-bb2e-23299de713c2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097791 Oct 19 01:52:13.781979 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3428/6742] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:52:13 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:52:14.744510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:14.749414 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:14.755902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:14.756386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:14.756854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:14.768161 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] Creating event network-changed:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h1-master-1 Oct 19 01:52:14.773269 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-688801d1-167c-4702-bb08-6525790e1533 req-df0a16b7-cd37-4c7b-bd03-1877979aa2f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032397 Oct 19 01:52:14.773871 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3315/6743] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:52:50.792968 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:50.793848 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=28 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:50.798686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:50.799309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:50.806452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:50.806948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:50.807415 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:50.808103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:50.808572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:50.809039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:50.943477 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:50.951332 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-44de66f1-a6e8-4f26-b0dc-a83d8a743fd0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.160263 Oct 19 01:52:50.951917 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3429/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:50 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:50.973497 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:50.974315 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=32 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:52:50.978833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:50.979575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:50.988029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:50.988521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:50.988993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:50.989692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:50.990158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:50.990596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.120897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:51.128824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-02000585-3b02-4429-8374-772a705e1c17 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.157481 Oct 19 01:52:51.129407 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3316/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:50 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:51.151887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:51.152476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:51.159310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.159838 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.160329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.161116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.161595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.162046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.294281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:51.302356 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87921318-ea8b-4660-9fa3-88cefca7e6f3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.154386 Oct 19 01:52:51.303032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3430/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:51 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:51.325760 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:52:51.328596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:51.334670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.335164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.335621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.336318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.336829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.337266 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.365848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:51.371226 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Old instance type m1.heat2, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:52:51.377926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:52:51.378351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:52:51.378830 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:52:51.379248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:52:51.379665 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:52:51.441519 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de836532-49b9-4b23-b894-19089b5b4b3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/action" status: 202 len: 0 microversion: 2.1 time: 0.119639 Oct 19 01:52:51.442335 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3317/6747] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:52:51 2022] POST /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:52:51.450368 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:51.451604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:51.458270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.458789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.459245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.459972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:51.460447 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:51.460931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:51.598567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:51.606967 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d58e3c3-a4d3-4da0-aa2f-e17d4f1a42b2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1677 microversion: 2.1 time: 0.160510 Oct 19 01:52:51.607643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3431/6748] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:51 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:52.633938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:52.634555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:52.641415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:52.641899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:52.642341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:52.643027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:52.643486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:52.643914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:52.830478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:52.838447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d94054f7-fb21-48f8-b135-db9f52dc7082 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1677 microversion: 2.1 time: 0.209387 Oct 19 01:52:52.839021 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3318/6749] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:52 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:53.862685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:53.863322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:53.870248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:53.870764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:53.871216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:53.871930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:53.872407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:53.873000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:54.005221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:54.013423 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0504a024-80c9-4363-b6d8-1ea57b277f49 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.154632 Oct 19 01:52:54.014007 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3432/6750] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:53 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:55.037969 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:55.038589 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:55.045558 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:55.046046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:55.046489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:55.047187 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:55.047641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:55.048073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:55.177278 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:55.184960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41963af9-175c-4329-a2dd-37ccbe2df983 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.150872 Oct 19 01:52:55.185837 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3319/6751] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:55 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:56.209671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:56.210304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:56.217303 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:56.217805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:56.218266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:56.218972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:56.219443 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:56.219887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:56.352457 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:56.360860 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6fdb9028-8608-46dc-821d-48585fd85471 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.155099 Oct 19 01:52:56.361441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3433/6752] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:56 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:57.385076 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:57.385700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:57.393220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:57.393751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:57.394206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:57.394914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:57.395379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:57.395813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:57.528160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:57.536004 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cce5dd54-8088-47fb-8d22-83cbccb77a13 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.154937 Oct 19 01:52:57.536587 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3320/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:57 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:58.559184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:58.559846 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:58.567480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:58.567974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:58.568423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:58.569152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:58.569616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:58.570087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:58.705735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:58.713548 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36b6eb9f-0edb-440f-9e53-6b30191ec7a8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.158285 Oct 19 01:52:58.714123 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3434/6754] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:58 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:52:59.738414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:52:59.739028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:52:59.745788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:59.746286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:59.746737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:59.747440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:52:59.748398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:52:59.748907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:52:59.878387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:52:59.886128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0715028-51d7-4d94-856c-4325c7504cd5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.151674 Oct 19 01:52:59.886702 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3321/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:52:59 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:00.911089 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:00.911775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:00.918712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:00.919213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:00.920131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:00.920896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:00.921377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:00.921820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:01.056710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:01.065339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-430a85da-ee06-4e74-b70a-3698cd79a1a6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.158225 Oct 19 01:53:01.065926 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3435/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:00 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:02.089343 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:02.089961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:02.097705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:02.098198 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:02.098641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:02.099338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:02.099788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:02.100216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:02.229006 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:02.237432 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ff8fc3b-1fc4-40f3-bb96-f44c070ef647 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.151960 Oct 19 01:53:02.238076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3322/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:02 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:03.262118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:03.262755 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:03.269911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:03.270419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:03.270882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:03.271598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:03.272072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:03.272518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:03.405540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:03.413323 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d4d6042-422e-4a5d-98b6-05a1d927bf84 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.155254 Oct 19 01:53:03.413910 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3436/6758] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:03 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:04.438404 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:04.439271 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:04.445954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:04.446440 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:04.446883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:04.447574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:04.448031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:04.448463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:04.580961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:04.588827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-053d2a46-9c5f-441f-8c44-85cf337d73ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.154886 Oct 19 01:53:04.589417 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3323/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:04 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:05.613145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:05.613788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:05.620739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:05.621246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:05.621708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:05.622424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:05.622974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:05.623434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:05.751244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:05.759048 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bfcc062-7eae-4ec6-aa51-570d5d3edd5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.149852 Oct 19 01:53:05.759627 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3437/6760] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:05 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:06.783987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:06.784609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:06.791528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:06.792028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:06.792474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:06.793202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:06.793668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:06.794105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:06.927361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:06.935120 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb769830-347e-41d2-8b10-3e479d1dd9e7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.155046 Oct 19 01:53:06.935804 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3324/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:06 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:07.959332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:07.959973 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:07.967504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:07.968006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:07.968461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:07.969203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:07.969680 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:07.970129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:08.104031 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:08.112602 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c581cbe-fb5c-4124-aaec-f91eb29c52d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.157183 Oct 19 01:53:08.113285 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3438/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:07 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:09.137175 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:09.137797 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:09.144402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:09.144919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:09.145364 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:09.146056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:09.146514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:09.146948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:09.273139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:09.281215 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbc899dd-b3f4-46d4-aec1-99f18bf94c24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.147977 Oct 19 01:53:09.281792 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3325/6763] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:09 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:10.305263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:10.305812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:10.313666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:10.314165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:10.314617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:10.315321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:10.315787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:10.316226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:10.861361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:10.869564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-599076c9-1825-45b6-be42-79a00f625694 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1682 microversion: 2.1 time: 0.568349 Oct 19 01:53:10.870253 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3439/6764] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:10 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1682 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:11.482433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "name": "network-vif-unplugged", "status": "completed", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:11.492032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:11.492513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:11.492969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:11.507237 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Creating event network-vif-unplugged:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h2-master-1 Oct 19 01:53:11.512634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] Instance 16e9233a-097d-472c-aba6-9260c04bcacc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:53:11.524403 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a61d7a93-9dbb-435b-bf00-d4bc5558fcff req-8e68068e-3cc2-440a-abc9-cfabadb23a6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102930 Oct 19 01:53:11.525051 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3326/6765] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:53:11.896264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:11.896970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:11.904641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:11.905235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:11.905700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:11.906431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:11.906911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:11.907364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:12.048596 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:12.055680 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f272bd7-479c-4356-957a-0e1bfb0faef4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1681 microversion: 2.1 time: 0.163516 Oct 19 01:53:12.056688 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3440/6766] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:11 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:13.082793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:13.083507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:13.090112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:13.090607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:13.091080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:13.091828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:13.092300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:13.092770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:13.272428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:13.280753 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3bec3d8e-8ff2-4b69-8b8f-4037c1b5d2e1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1679 microversion: 2.1 time: 0.203915 Oct 19 01:53:13.281330 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3327/6767] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:13 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:13.542008 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:13.553981 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:13.554483 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:13.554934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:13.566826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Creating event network-changed:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h2-master-1 Oct 19 01:53:13.572417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] Instance 16e9233a-097d-472c-aba6-9260c04bcacc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:53:13.588323 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-96652075-3c46-4409-8ec9-de73503e2cee req-78cef21c-4b77-4dc6-9073-c1a5ac5a19ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049908 Oct 19 01:53:13.588973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3441/6768] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:53:14.305017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:14.305573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:14.313028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.313794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.314260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.314962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.315427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.315866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.451131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:14.458923 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b22d5e1-860c-439a-8f74-4f80682c6edc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1676 microversion: 2.1 time: 0.157933 Oct 19 01:53:14.459503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3328/6769] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:14 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:14.483633 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:14.484294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:14.490491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.490986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.491438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.492139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.492608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.493070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.551467 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3dce3c46-88fc-42cc-a6d5-edc4dc34e838 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/action" status: 204 len: 0 microversion: 2.1 time: 0.072832 Oct 19 01:53:14.552173 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3442/6770] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:53:14 2022] POST /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:53:14.560742 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:14.561235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:14.567510 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.568004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.568487 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.569243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:14.569709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:14.570147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:14.769157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:14.776850 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8d83cb90-3fce-4dee-8775-23c5bcd3f586 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1676 microversion: 2.1 time: 0.220455 Oct 19 01:53:14.777619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3329/6771] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:14 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:15.802809 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:15.803437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:15.809856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:15.810354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:15.810798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:15.811505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:15.811972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:15.812407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:15.959702 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:15.968423 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ddedbce8-d92d-42a9-95a4-a0e0ea8288d5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1676 microversion: 2.1 time: 0.170800 Oct 19 01:53:15.969051 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3443/6772] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:15 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:16.992989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:16.993960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:17.001275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.001765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.002210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.002905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.003370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.003802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.133132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:17.140910 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d781b21-ed09-4902-830a-ebc2a09a58be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.151861 Oct 19 01:53:17.141492 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3330/6773] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:16 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:17.164060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:17.164720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:17.172292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.172810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.173259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.173964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.174431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.174890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.306875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:17.309213 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:17.317789 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a33010d1-944a-4b9e-bdc9-d570e165e8c7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.157635 Oct 19 01:53:17.318374 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3444/6774] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:17 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:17.340690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:17.341913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:17.348124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.348606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.349066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.349749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.350207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.350676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.368642 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:17.486055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:17.493886 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb3fdbbe-b505-404d-a9d6-9eda598e2b74 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1668 microversion: 2.1 time: 0.157076 Oct 19 01:53:17.494485 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3331/6775] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:17 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:17.519057 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:17.519518 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:17.526686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.527262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.527785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.529329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.529826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.530267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.558560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "name": "network-vif-plugged", "status": "completed", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:17.558933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:53:17.569278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.570089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.570616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.582823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] Creating event network-vif-plugged:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h2-master-1 Oct 19 01:53:17.589065 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d81241b1-1f76-4b2f-a5c8-33d115b2e5dc req-96e77183-2b63-433e-8a95-bd018ed8e983 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Oct 19 01:53:17.589387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3332/6776] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:53:17.639343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec7fb2db-1c8e-48a9-afa0-a6ae2e60cd8f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 204 len: 0 microversion: 2.1 time: 0.124198 Oct 19 01:53:17.639961 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3445/6777] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:53:17 2022] DELETE /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:53:17.649370 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:17.650146 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:17.656538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.657073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.657521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.658230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:17.658697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:17.659135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:17.796460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:17.804205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68201e6c-2d5a-4a6c-8eb5-5fc0d537ca24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1674 microversion: 2.1 time: 0.159716 Oct 19 01:53:17.804818 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3333/6778] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:17 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:18.830364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:18.831127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:18.837903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:18.838395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:18.838848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:18.839575 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:18.840064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:18.840502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:18.970944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:18.978755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e471d1d1-fff2-4c8f-bf42-5ec1a8dafb26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1674 microversion: 2.1 time: 0.153497 Oct 19 01:53:18.979325 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3446/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:18 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:19.854899 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16e9233a-097d-472c-aba6-9260c04bcacc", "name": "network-vif-deleted", "tag": "0497459f-b701-44f4-a3b3-15fdb41a1d8b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:19.866177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:19.867128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:19.867865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:19.881845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] Creating event network-vif-deleted:0497459f-b701-44f4-a3b3-15fdb41a1d8b for instance 16e9233a-097d-472c-aba6-9260c04bcacc on n-h2-master-1 Oct 19 01:53:19.887055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f653e914-64a2-4ad6-a17b-49a19e839174 req-fc8e17a6-601a-4855-9aa8-bc545c68f094 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036171 Oct 19 01:53:19.888684 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3334/6780] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:53:20.003530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:20.004380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:20.012082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:20.013398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:20.014042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:20.015181 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:20.015791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:20.016337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:20.051885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:20.052214 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:20.052712 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:20.053188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lazy-loading 'fault' on Instance uuid 16e9233a-097d-472c-aba6-9260c04bcacc {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:53:20.098152 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:20.107175 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-75871b7a-1737-4e95-9fa2-7a138b1505c6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 200 len: 1328 microversion: 2.1 time: 0.107558 Oct 19 01:53:20.124160 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3447/6781] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:19 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:21.132546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:21.133298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:21.136040 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=43 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:21.142325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.142813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.143258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.143955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.144415 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.144881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.159943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc HTTP/1.1 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '16e9233a-097d-472c-aba6-9260c04bcacc'} Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:53:21.161622 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-25e4a8da-111e-459a-83f2-945ddd6f5b22 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 404 len: 111 microversion: 2.1 time: 0.034759 Oct 19 01:53:21.166127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3335/6782] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:21 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:53:21.177236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:21.177886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:21.180721 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:21.186791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.187298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.187764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.188770 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.189250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.189699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.204473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc HTTP/1.1 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '16e9233a-097d-472c-aba6-9260c04bcacc'} Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:53:21.206165 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c425761f-29d4-454b-871e-454bd961813d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 404 len: 111 microversion: 2.1 time: 0.034362 Oct 19 01:53:21.210750 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3448/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:21 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:53:21.256889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-476864376", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "36ba6ca3-54fd-4a5c-8d41-71cfc43609cb"}], "security_groups": [{"name": "tempest-securitygroup--368058306"}], "key_name": "tempest-keypair-815665172", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:21.370810 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] validate_networks() for [('36ba6ca3-54fd-4a5c-8d41-71cfc43609cb', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:53:21.783789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:53:21.784230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:53:21.784752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:53:21.785177 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:53:21.785602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:53:21.794640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.795135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.795586 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.796325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:21.796819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:21.797257 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:21.814887 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:53:21.820073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:53:21.833067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:53:21.835429 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:53:21.882362 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-57ad526e-38a1-454d-abd8-49ea7cf60736 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.629269 Oct 19 01:53:21.882955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3336/6784] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:53:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:53:21.894513 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cce632b2-9a74-47bf-8ecb-c060f91abec8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:21.895280 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cce632b2-9a74-47bf-8ecb-c060f91abec8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:21.952556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cce632b2-9a74-47bf-8ecb-c060f91abec8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:21.959598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cce632b2-9a74-47bf-8ecb-c060f91abec8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1237 microversion: 2.1 time: 0.069165 Oct 19 01:53:21.972654 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3449/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:21 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:22.985948 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:22.986572 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:22.993581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:22.994079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:22.994526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:22.995230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:22.995692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:22.996132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:23.064970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:23.073543 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4541eabc-3cc8-4392-ad5a-db33d3213ade tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1289 microversion: 2.1 time: 0.092820 Oct 19 01:53:23.074129 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3337/6786] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:22 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:24.098680 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:24.099451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:24.107203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:24.107751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:24.108200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:24.109131 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:24.109602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:24.110043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:24.319676 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:24.327931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bcaf56a0-56c2-4fb6-aed1-c652c2949245 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.233431 Oct 19 01:53:24.328509 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3450/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:24 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:24.642673 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:24.654919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:24.656099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:24.656549 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:24.669816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] Creating event network-changed:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h1-master-1 Oct 19 01:53:24.674876 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-68112461-5752-4eb6-b730-39f989271478 req-f06e957b-4f50-4e91-ae02-ee4a018cfed7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037126 Oct 19 01:53:24.675675 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3338/6788] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:53:25.352353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:25.353009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:25.360257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:25.360782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:25.361229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:25.361929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:25.362393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:25.362828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:25.491627 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:25.500285 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-998cc54f-5878-4ba9-9e19-cb76667ee501 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.151790 Oct 19 01:53:25.500887 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3451/6789] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:25 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:26.524966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:26.525678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:26.533528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:26.534025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:26.534476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:26.535184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:26.535651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:26.536087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:26.697331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:26.705890 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ddf472ed-3ced-4a6b-aef4-fa2d2a1caa65 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.185252 Oct 19 01:53:26.706700 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3339/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:26 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:27.729639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:27.730270 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:27.737258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:27.737817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:27.738203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:27.738969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:27.739582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:27.739998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:27.871521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:27.879994 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-325b04ff-9b5b-410d-90c8-d1cf37b0efc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.154361 Oct 19 01:53:27.880586 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3452/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:27 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:28.903110 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:28.904802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:28.911637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:28.912129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:28.912571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:28.913293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:28.913754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:28.914186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:29.049264 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:29.057267 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5058e8b-8bde-4b21-b2e4-b5405b985f6b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.158094 Oct 19 01:53:29.057833 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3340/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:28 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:30.082498 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:30.083127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:30.090071 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:30.090569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:30.091640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:30.092360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:30.092862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:30.093305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:30.224140 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:30.231964 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f258de71-735b-4482-8057-f4e1168d158c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.153539 Oct 19 01:53:30.232531 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3453/6793] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:30 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:31.261230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:31.261855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:31.269384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:31.269907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:31.270358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:31.271138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:31.271606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:31.272045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:31.300963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "name": "network-vif-plugged", "status": "completed", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:31.313030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:31.313992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:31.314797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:31.327493 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] Creating event network-vif-plugged:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h1-master-1 Oct 19 01:53:31.332947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-757110f4-c80d-4c60-a2a7-73512e421ee4 req-f08b89fa-b8a7-40c7-814c-22a48f2cc2a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035720 Oct 19 01:53:31.333743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3454/6794] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:53:31.414532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:31.424370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-290da205-7b61-4103-838e-f0605e2db535 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.167049 Oct 19 01:53:31.425195 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3341/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:31 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:32.447017 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:32.452380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:32.453137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:32.459662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:32.460164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:32.460642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:32.461360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:32.461834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:32.462280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:32.591673 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:32.599323 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ac27b9f-5e0b-42e0-a503-a9c64165d397 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1362 microversion: 2.1 time: 0.153377 Oct 19 01:53:32.599904 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3455/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:32 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:33.623590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:33.624911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:33.626903 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:33.627582 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:53:33.634202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:33.634823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:33.635343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:33.635966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:33.636424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:33.636882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:33.769341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:53:33.777094 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8cfd6e61-b2a3-4529-84b4-3e0629c15e43 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1549 microversion: 2.1 time: 0.157637 Oct 19 01:53:33.777695 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3342/6797] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:53:33 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:53:33.801385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:53:33.801895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:53:33.808516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:33.809053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:33.809644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:33.810361 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:33.810832 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:33.811277 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:33.889099 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e2dd925b-762f-4eda-98c4-35612d0e1124 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092077 Oct 19 01:53:33.889713 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3456/6798] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:53:33 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:53:35.131442 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:53:35.141762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:53:35.142243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:53:35.142674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:53:35.155873 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] Creating event network-changed:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h1-master-1 Oct 19 01:53:35.161870 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8afd2ae3-9677-47e2-b504-4b73cbfc70b7 req-e5962082-c994-469b-aa05-392b9bf75947 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034066 Oct 19 01:53:35.162685 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3343/6799] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:10.255968 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=19 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:10.256773 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:10.260875 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:10.268525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:10.269056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:10.269514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:10.291798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Going to try to stop instance {{(pid=131449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 01:54:10.333859 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c7da071f-d0b4-45ee-9e43-0aeaec36868b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action" status: 202 len: 0 microversion: 2.1 time: 0.079775 Oct 19 01:54:10.334558 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3457/6800] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:54:10 2022] POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:54:10.343685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:10.344393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:10.346760 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:10.347624 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=50 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:10.354646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:10.355147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:10.355601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:10.356315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:10.356839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:10.357473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:10.496570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:10.504593 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6199bffa-f841-4165-9c9e-e2aade9df015 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.165613 Oct 19 01:54:10.505190 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3344/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:10 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:11.531234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:11.531955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:11.538182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:11.538696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:11.539137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:11.539845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:11.540324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:11.540810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:11.673279 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:11.681095 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e41bb42e-aa54-4758-b892-c3b4e73563a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.155689 Oct 19 01:54:11.681668 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3458/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:11 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:12.705978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:12.706596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:12.713829 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:12.714319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:12.714764 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:12.715460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:12.715930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:12.716925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:12.847897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:12.855533 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b3a7c8f8-8cd3-4aba-bf16-03401594e071 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.153519 Oct 19 01:54:12.856122 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3345/6803] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:12 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:13.879726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:13.880359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:13.887451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:13.887947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:13.889226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:13.889853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:13.890328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:13.890769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:14.030655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:14.038530 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3a5297a7-3453-4980-8750-7eec351c86b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.162745 Oct 19 01:54:14.039124 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3459/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:13 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:15.062534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:15.063449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:15.070326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:15.070809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:15.071251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:15.071936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:15.072393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:15.072860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:15.203147 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:15.211051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-80dd12f8-f80a-47a4-a70e-89e295c1deb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.153240 Oct 19 01:54:15.211633 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3346/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:15 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:16.235621 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:16.236264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:16.243245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:16.243751 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:16.244209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:16.244982 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:16.245459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:16.245906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:16.378605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:16.386435 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3aa5002a-f700-4b95-8195-b4428e528cce tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.155638 Oct 19 01:54:16.387013 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3460/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:16 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:17.410588 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:17.411199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:17.418227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:17.418771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:17.419209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:17.420438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:17.420900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:17.421327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:17.550786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:17.558528 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60790946-b641-42da-94b2-54580591e166 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.151872 Oct 19 01:54:17.559117 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3347/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:17 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:18.583143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:18.583786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:18.590718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:18.591427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:18.591710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:18.592431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:18.592931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:18.593378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:18.723966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:18.731789 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-977fcfd7-bfc5-42ac-94a6-9790082be1cc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.152653 Oct 19 01:54:18.732378 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3461/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:18 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:19.755837 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:19.756444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:19.763370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:19.763853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:19.764288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:19.765002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:19.765456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:19.765882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:19.898872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:19.906653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a04910e-68d0-41c3-94fc-18d0f0940de2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.154680 Oct 19 01:54:19.907242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3348/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:19 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:20.930189 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:20.930771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:20.938571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:20.939061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:20.939509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:20.940205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:20.940699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:20.941135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:21.071411 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:21.079217 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe4f7e84-ddab-41e6-8a31-2cc1fbc33c4d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1655 microversion: 2.1 time: 0.153072 Oct 19 01:54:21.079827 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3462/6810] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:20 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1655 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:21.102951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:21.105219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:21.113175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:21.113662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:21.114108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:21.114795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:21.115251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:21.115681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:21.147424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:21.153153 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Old instance type m1.heat2, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:54:21.160132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:54:21.160581 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:54:21.161092 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:54:21.161519 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:54:21.161940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:54:21.225558 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9090cdd-0838-4e14-932e-a5fc3fe5b3a7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action" status: 202 len: 0 microversion: 2.1 time: 0.126478 Oct 19 01:54:21.226192 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3349/6811] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:54:21 2022] POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:54:21.235113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:21.236006 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:21.242457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:21.242960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:21.243417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:21.244139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:21.244636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:21.245082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:21.389438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:21.397594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a9bbedde-c52c-4bab-b303-3c8566a22ee6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.167058 Oct 19 01:54:21.398184 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3463/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:21 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:22.423227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:22.423875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:22.430826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:22.431320 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:22.431766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:22.432465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:22.432955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:22.433392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:22.573443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:22.581372 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99cf371b-29ef-4d58-99aa-c24fab909a89 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1678 microversion: 2.1 time: 0.163056 Oct 19 01:54:22.581957 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3350/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:22 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:23.605735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:23.606373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:23.613049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:23.613557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:23.614020 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:23.614743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:23.615211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:23.615657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:23.750918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:23.758745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61fe1407-8a7c-46d8-a969-17c98a549a32 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1683 microversion: 2.1 time: 0.157172 Oct 19 01:54:23.759328 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3464/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:23 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:24.783428 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:24.784039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:24.790812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:24.791296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:24.791733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:24.792420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:24.792915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:24.793339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:24.923448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:24.931203 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-96ab5876-fa7b-443d-ac8d-c2644906764a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1683 microversion: 2.1 time: 0.151673 Oct 19 01:54:24.931776 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3351/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:24 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:25.809070 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "name": "network-vif-unplugged", "status": "completed", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:25.819883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:25.820457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:25.820962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:25.833722 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Creating event network-vif-unplugged:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h2-master-1 Oct 19 01:54:25.839217 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:54:25.851035 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4a1624fc-bc58-4874-b51b-cab3a6f4b15f req-74e72a11-902e-4816-907b-20eccf48d717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045634 Oct 19 01:54:25.851651 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3465/6816] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:25.956081 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:25.956794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:25.963605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:25.964096 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:25.964569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:25.965289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:25.965752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:25.966417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:26.107456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:26.116037 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-56898abe-bb9d-4e86-99b7-da97d881e455 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1682 microversion: 2.1 time: 0.163767 Oct 19 01:54:26.116900 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3352/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:25 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:27.143119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:27.143829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:27.150039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:27.150535 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:27.150986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:27.151748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:27.152397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:27.153138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:27.287433 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:27.295838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-29d3ff20-e452-4391-b4d4-3ec12f57203b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1682 microversion: 2.1 time: 0.158060 Oct 19 01:54:27.296416 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3466/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:27 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:27.889449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:27.899724 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:27.900205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:27.900662 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:27.913782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Creating event network-changed:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h2-master-1 Oct 19 01:54:27.919507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:54:27.930618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-bfe235fe-698f-479f-802c-085ee58ef3fc req-75ea6381-d4a0-4f58-b691-fa3412287b35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045533 Oct 19 01:54:27.931227 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3353/6819] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:28.319776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:28.320425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:28.342578 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:28.343105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:28.343570 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:28.344459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:28.344858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:28.345312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:28.566061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:28.574683 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a40e9da5-dd16-4109-b827-4a75e41638da tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1680 microversion: 2.1 time: 0.258899 Oct 19 01:54:28.576014 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3467/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:28 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1680 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:29.600794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:29.601534 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:29.607796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.608227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.608711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:29.609409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.609877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.610314 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:29.741493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:29.750489 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7195393-90be-4d7b-a1c0-c9d94e1105e6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1676 microversion: 2.1 time: 0.154848 Oct 19 01:54:29.751077 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3354/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:29 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:29.774266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:29.774814 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:29.781608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.782093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.782544 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:29.783252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.783720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.784155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:29.843728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f819feed-6576-4388-9fe7-941fe9da1265 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action" status: 204 len: 0 microversion: 2.1 time: 0.073185 Oct 19 01:54:29.844411 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3468/6822] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:54:29 2022] POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:54:29.852430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:29.853091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:29.860166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.860992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.861628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:29.862530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:29.863175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:29.863840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:30.097371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:30.105393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a22d94f5-7b68-4343-80d1-d1e23c0a2f53 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1676 microversion: 2.1 time: 0.256753 Oct 19 01:54:30.106061 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3355/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:29 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:54:31.130930 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:31.131739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:31.138733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:31.139302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:31.140006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:31.140977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:31.141676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:31.142325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:31.278179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:31.286145 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf789193-b18b-452f-9b85-caa5d668f406 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1676 microversion: 2.1 time: 0.160490 Oct 19 01:54:31.286716 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3469/6824] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:31 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:32.026326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "name": "network-vif-plugged", "status": "completed", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:32.038330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.038819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.039255 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.052813 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] Creating event network-vif-plugged:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h2-master-1 Oct 19 01:54:32.058110 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-a345ae4a-aa8c-40d0-aadf-505269081a7f req-1df35515-0b8c-419c-92a6-85d0b6b580b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110968 Oct 19 01:54:32.058728 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3356/6825] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:32.309993 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:32.310636 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:32.317761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.318263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.318717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.319426 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.319896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.320335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.455168 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:32.463030 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ae95c933-5312-4b56-9296-55fa8d424a72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1655 microversion: 2.1 time: 0.157079 Oct 19 01:54:32.463611 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3470/6826] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:32 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1655 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:32.486946 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:32.487661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:32.493896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.494389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.494859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.495545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.496010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.496448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.628227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:32.636011 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-312a7dfc-bdb5-4808-8dc4-a034d8b4463f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1655 microversion: 2.1 time: 0.153305 Oct 19 01:54:32.636593 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3357/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:32 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:32.659263 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:32.665317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.665820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.666270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.689581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Going to try to start instance {{(pid=131449) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 01:54:32.693936 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:32.733018 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e53f3b0-0782-42b5-9d0e-800f866be0e3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action" status: 202 len: 0 microversion: 2.1 time: 0.077214 Oct 19 01:54:32.733689 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3471/6828] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:54:32 2022] POST /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:54:32.742624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:32.743683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:32.750466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.750960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.751407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.752222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:32.752591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:32.753079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:32.889990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:32.897906 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-75cd96d2-d88c-4926-9423-b6af08922e15 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1664 microversion: 2.1 time: 0.159310 Oct 19 01:54:32.898581 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3358/6829] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:32 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:33.923119 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:33.923849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:33.930042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:33.930549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:33.931008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:33.931728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:33.932203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:33.932679 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:34.080109 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:34.088969 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2090a28-efbf-48f1-b5be-67d86c2630a2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1668 microversion: 2.1 time: 0.171062 Oct 19 01:54:34.090100 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3472/6830] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:33 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1668 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:34.112779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:34.113321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:34.119850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:34.120330 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:34.120797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:34.121472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:34.122629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:34.123057 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:34.150453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:54:34.164734 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:34.231105 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dbd31594-249b-4670-aebc-d252c4ebccc8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 204 len: 0 microversion: 2.1 time: 0.121939 Oct 19 01:54:34.232443 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3359/6831] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:54:34 2022] DELETE /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:54:34.240781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:34.241444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:34.247796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:34.248299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:34.248818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:34.249536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:34.250057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:34.250503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:34.380342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:34.389043 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00a9ee47-f965-4ec6-98a6-fc564597f87f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1674 microversion: 2.1 time: 0.152177 Oct 19 01:54:34.389628 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3473/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:34 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:35.413399 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:35.414114 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:35.421739 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:35.422235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:35.422692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:35.423546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:35.424019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:35.424456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:35.558674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:35.567057 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee980b04-147f-4c03-99ea-9e7690ec124d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1674 microversion: 2.1 time: 0.158039 Oct 19 01:54:35.567643 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3360/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:35 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:36.516799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72964f3e-efbb-4443-8a32-c54e26dc4dae", "name": "network-vif-deleted", "tag": "43761cc8-4f60-4516-b88b-868e58334114"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:36.532606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:36.533136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:36.533582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:36.545522 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] Creating event network-vif-deleted:43761cc8-4f60-4516-b88b-868e58334114 for instance 72964f3e-efbb-4443-8a32-c54e26dc4dae on n-h2-master-1 Oct 19 01:54:36.550647 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-10e462d9-c9e0-407f-abcf-516a714baa99 req-5e58ae8f-7365-48f2-8caf-85eeca306f00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038397 Oct 19 01:54:36.551566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3474/6834] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:36.593124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:36.593747 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:36.601052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:36.601781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:36.602219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:36.603294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:36.603815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:36.604474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:36.672745 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:36.681232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-810c8a9f-6039-4d60-ba1c-1046b4f6d389 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 200 len: 1322 microversion: 2.1 time: 0.092615 Oct 19 01:54:36.682239 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3361/6835] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:36 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 1322 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:37.706982 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:37.707700 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:37.713972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:37.714474 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:37.714970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:37.715703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:37.716175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:37.716633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:37.729759 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae HTTP/1.1 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '72964f3e-efbb-4443-8a32-c54e26dc4dae'} Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:54:37.731931 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a8b005a8-073c-451b-ab03-a2fea7a9f3f0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 404 len: 111 microversion: 2.1 time: 0.031573 Oct 19 01:54:37.736474 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3475/6836] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:37 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:54:37.751712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:37.752326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:37.759141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:37.759621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:37.760060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:37.760776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:37.761230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:37.761659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:38.036983 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae HTTP/1.1 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '72964f3e-efbb-4443-8a32-c54e26dc4dae'} Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:54:38.038570 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8797318a-3d60-445c-857f-30c429ee4604 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 404 len: 111 microversion: 2.1 time: 0.293053 Oct 19 01:54:38.043265 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3362/6837] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:37 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:54:38.089362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-631909810", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "36ba6ca3-54fd-4a5c-8d41-71cfc43609cb"}], "security_groups": [{"name": "tempest-securitygroup--368058306"}], "key_name": "tempest-keypair-815665172", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:38.193519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] validate_networks() for [('36ba6ca3-54fd-4a5c-8d41-71cfc43609cb', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:54:38.563408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:54:38.563844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:54:38.564329 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:54:38.564791 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:54:38.565250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:54:38.574705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:38.575312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:38.575792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:38.576536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:38.577035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:38.577472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:38.594131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:54:38.599271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:54:38.612160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:54:38.614506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:54:38.659256 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 01:54:39.666672 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40350. Oct 19 01:54:39.670781 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d27d6255-914d-4467-913c-1c65b276e2de tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.585434 Oct 19 01:54:39.671442 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3476/6838] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:54:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:54:39.682984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04aee42e-f770-4695-93b1-f7ea20c6209e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:39.683614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04aee42e-f770-4695-93b1-f7ea20c6209e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:39.740332 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04aee42e-f770-4695-93b1-f7ea20c6209e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:39.748184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04aee42e-f770-4695-93b1-f7ea20c6209e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1237 microversion: 2.1 time: 0.069220 Oct 19 01:54:39.748784 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3363/6839] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:39 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:40.772460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:40.773065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:40.775101 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:40.781458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:40.781971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:40.782428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:40.783151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:40.783628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:40.784105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:40.854956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:40.863480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-047821d1-616a-421d-9528-ac50ef2b8024 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1289 microversion: 2.1 time: 0.095974 Oct 19 01:54:40.864079 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3477/6840] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:40 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:41.888069 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:41.888703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:41.891809 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:41.897454 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:41.897942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:41.898409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:41.899101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:41.899555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:41.899980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:42.113252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:42.120900 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd01626d-fae1-4d03-9e42-494ee2a4342f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.236946 Oct 19 01:54:42.121564 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3364/6841] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:41 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:42.577675 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:42.587312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:42.587819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:42.588275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:42.599748 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] Creating event network-changed:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:54:42.604679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-642590fb-306d-4217-a218-64a657eba7dd req-9b541551-209e-478b-9a6d-22b5c3e4a930 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090648 Oct 19 01:54:42.605284 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3478/6842] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:43.145401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:43.146038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:43.154159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:43.154754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:43.155201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:43.155904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:43.156360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:43.156815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:43.287056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:43.295648 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-40a30c48-c896-46fa-9ebf-2d07da08659b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.154211 Oct 19 01:54:43.296209 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3365/6843] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:43 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:44.320179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:44.320935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:44.328148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:44.328674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:44.329137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:44.329857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:44.330334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:44.330781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:44.553715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:44.562564 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80eee5f2-f36e-4725-9fc7-b3e2efd8f447 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.246624 Oct 19 01:54:44.563504 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3479/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:44 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:45.587384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:45.588198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:45.595423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:45.595922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:45.596373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:45.597118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:45.597584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:45.598023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:45.728371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:45.736711 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-71da63fa-df0e-4078-91a3-d96a67d9f2ff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.153967 Oct 19 01:54:45.737278 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3366/6845] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:45 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:46.761225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:46.761767 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:46.768787 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:46.769289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:46.769744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:46.770454 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:46.770929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:46.771377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:46.903706 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:46.911509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ab02e2c7-0d62-42c3-b112-b319d309ebea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.154396 Oct 19 01:54:46.912107 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3480/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:46 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:47.563545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "name": "network-vif-plugged", "status": "completed", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:47.575693 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:47.576185 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:47.576649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:47.587996 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] Creating event network-vif-plugged:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:54:47.593560 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3e222282-bcc6-4140-bddf-e2a406a9e4c2 req-abe6e155-089d-4f36-a677-c529d3a1bb8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034291 Oct 19 01:54:47.594160 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3367/6847] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:54:47.935944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:47.936726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:47.943903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:47.944411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:47.944900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:47.945619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:47.946094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:47.946564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:48.089958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:48.099280 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-03fa890b-2125-4b33-b413-6f3cb29e2097 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1362 microversion: 2.1 time: 0.167536 Oct 19 01:54:48.111813 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3481/6848] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:47 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:49.124537 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:49.125294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:49.132267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:49.132796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:49.133246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:49.133935 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:49.134393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:49.134822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:49.267985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:54:49.275719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c83978a5-6221-4b57-b648-ad959b343a82 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1548 microversion: 2.1 time: 0.156121 Oct 19 01:54:49.276303 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3368/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:54:49 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:54:49.299299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:54:49.299811 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:54:49.301832 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:49.302626 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:49.310595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:49.311089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:49.311541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:49.312254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:49.313015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:49.313458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:49.389918 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e60b0188-91c9-4419-8720-7be0cf5abc3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094636 Oct 19 01:54:49.390539 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3482/6850] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:54:49 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:54:50.331483 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:54:50.336470 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:54:50.345054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:54:50.345546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:54:50.346432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:54:50.359215 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] Creating event network-changed:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:54:50.364395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1dfd7ae8-680c-4cde-b6e8-a35ee05ae4b9 req-e21a2055-a716-480f-88c2-0f9afb25dd2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036561 Oct 19 01:54:50.365046 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3369/6851] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:31.082926 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:55:31.083457 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 01:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/action (ip 10.222.0.27) !!! Oct 19 01:55:31.084842 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=11 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:31.085764 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:31.090979 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:31.093324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:31.103560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:31.104726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:31.105222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:31.105950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:31.106427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:31.106874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:31.136016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:31.141450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Old instance type m1.heat2, new instance type m1.heat {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:55:31.147913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:55:31.148354 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:55:31.148879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:55:31.149309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:55:31.149740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:55:31.216477 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-180408ae-0076-4506-ad73-7256cff8ee24 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/action" status: 202 len: 0 microversion: 2.1 time: 0.136293 Oct 19 01:55:31.217138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3483/6852] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:55:31 2022] POST /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:55:31.224051 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:55:31.224562 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e (ip 10.222.0.27) !!! Oct 19 01:55:31.225728 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=11 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:31.226536 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:31.232783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:31.233695 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:31.246328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:31.246822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:31.247259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:31.247962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:31.248423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:31.248878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:31.391457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:31.399735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8a43941e-de78-42e4-9d4b-d60405711d2d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1676 microversion: 2.1 time: 0.178127 Oct 19 01:55:31.400357 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3370/6853] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:31 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:32.424063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:32.424730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:32.431616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:32.432176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:32.432658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:32.433485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:32.433960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:32.434404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:32.562577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:32.570391 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12482022-3a62-4200-b593-138e0fafc74a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1676 microversion: 2.1 time: 0.151048 Oct 19 01:55:32.570969 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3484/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:32 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:33.596218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:33.597242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:33.604220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:33.604834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:33.605300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:33.605987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:33.606445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:33.606875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:33.755793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:33.766304 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78180e9f-4e7e-4858-8cc2-eefcb9992176 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.173994 Oct 19 01:55:33.766894 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3371/6855] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:33 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:34.793255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:34.793880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:34.800613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:34.801139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:34.801587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:34.802294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:34.802761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:34.803202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:34.933822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:34.941947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-87a713df-36b8-43eb-aa05-4c46292b8cfa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.153028 Oct 19 01:55:34.942516 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3485/6856] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:34 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:35.967218 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:35.967846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:35.974727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:35.975219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:35.975698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:35.976404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:35.976896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:35.977334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:36.112892 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:36.120770 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fd2c927-5369-42d8-9e85-b30a65153bea tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.158121 Oct 19 01:55:36.121341 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3372/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:35 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:37.143990 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:37.144640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:37.152053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:37.152540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:37.153011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:37.153714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:37.154179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:37.154617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:37.290314 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:37.298840 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b674b7d8-f318-4095-9bea-0b3dbc4e3972 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.158739 Oct 19 01:55:37.299411 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3486/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:37 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:38.323472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:38.324000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:38.330648 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:38.331143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:38.331592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:38.332290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:38.332781 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:38.333219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:38.461341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:38.469134 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-03098da8-238f-47e7-9e4b-bcb16501d1af tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.149801 Oct 19 01:55:38.469726 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3373/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:38 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:39.493687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:39.494853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:39.501931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:39.502440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:39.502897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:39.503613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:39.504094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:39.504539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:39.638835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:39.646874 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e65f2125-e4a4-4b98-ac3a-977025721730 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.157213 Oct 19 01:55:39.647454 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3487/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:39 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:40.671026 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:40.671624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:40.678627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:40.679115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:40.679563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:40.680268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:40.680759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:40.681196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:40.813920 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:40.821957 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f65ef784-217c-4f18-855e-72e8c62e8f68 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.154932 Oct 19 01:55:40.823124 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3374/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:40 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:41.846856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:41.847490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:41.855258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:41.855761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:41.856218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:41.857023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:41.857499 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:41.857944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:41.986729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:41.995031 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a4cd8cc9-bf75-4c3c-93f6-1a6d9dcbbbdb tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.151586 Oct 19 01:55:41.995611 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3488/6862] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:41 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:43.019559 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:43.020210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:43.027721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:43.028209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:43.028676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:43.029370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:43.029833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:43.030268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:43.164953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:43.173393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c080b4e6-53da-48af-bd4a-c6634b11b0dd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.157752 Oct 19 01:55:43.174007 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3375/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:43 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:44.197295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:44.198153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:44.205010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:44.205502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:44.205951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:44.206753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:44.207194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:44.207636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:44.350214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:44.359181 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc4dc15a-2dab-4498-b51b-428eb089a255 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.165886 Oct 19 01:55:44.359766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3489/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:44 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:45.382793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:45.383419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:45.390413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:45.390907 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:45.391353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:45.392046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:45.392509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:45.392974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:45.568169 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:45.576301 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aedc2138-3f2a-4ae3-9e8e-14194903ee35 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1681 microversion: 2.1 time: 0.197512 Oct 19 01:55:45.576929 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3376/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:45 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:46.119914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "name": "network-vif-unplugged", "status": "completed", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:46.130492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:46.131083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:46.131493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:46.144378 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Creating event network-vif-unplugged:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h2-master-1 Oct 19 01:55:46.149843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] Instance cdee4128-3689-4fb9-9c8d-09647257770e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:55:46.161746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-db663298-dd0d-4368-ac84-992949f93a44 req-de4125b6-3a69-4c7b-88f6-f318c7469a68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046184 Oct 19 01:55:46.162373 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3490/6866] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:46.601020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:46.602284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:46.609858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:46.610348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:46.611003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:46.611709 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:46.612173 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:46.612610 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:46.745126 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:46.753171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81914376-f134-4be7-b982-1a294c5a1247 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1680 microversion: 2.1 time: 0.156139 Oct 19 01:55:46.753774 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3377/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:46 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:47.779483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:47.780199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:47.786446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:47.786951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:47.787407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:47.788115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:47.788587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:47.789058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:47.924034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:47.932718 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-280713fd-458d-4c58-9038-d1a727c540be tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1678 microversion: 2.1 time: 0.158434 Oct 19 01:55:47.933390 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3491/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:47 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:48.201300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:48.211135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:48.211617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:48.212052 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:48.224970 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Creating event network-changed:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h2-master-1 Oct 19 01:55:48.230856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] Instance cdee4128-3689-4fb9-9c8d-09647257770e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:55:48.241583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ec78a9e2-2207-4517-a50f-bf705b4393f7 req-3c02f31f-1b28-4cce-8206-cb4660d8207d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044546 Oct 19 01:55:48.242181 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3378/6869] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:48.957659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:48.958904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:48.966543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:48.967044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:48.967493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:48.968245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:48.968746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:48.969188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.121060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:49.128843 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3e2d50bf-8a79-4ab0-8a24-0ae95cd9f851 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1675 microversion: 2.1 time: 0.175189 Oct 19 01:55:49.129435 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3492/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:48 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:49.152761 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:49.153547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:49.159738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.160235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.160725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.161426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.161891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.162328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.199771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.200191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.200668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.201412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.201955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.202299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.223502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:55:49.229836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:55:49.328420 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ebeeba5-0a5b-4472-a736-bbca385c3695 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/action" status: 202 len: 0 microversion: 2.1 time: 0.180446 Oct 19 01:55:49.329126 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3379/6871] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:55:49 2022] POST /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:55:49.337416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:49.338835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:49.344939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.345430 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.345882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.346615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:49.347300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:49.347841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:49.486587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:49.494605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4353069-a62d-4be1-9e16-3a9f96e31ee9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.161262 Oct 19 01:55:49.495194 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3493/6872] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:49 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:50.520773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:50.521489 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:50.529071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:50.529593 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:50.530043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:50.530747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:50.531212 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:50.531647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:50.664949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:50.673051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7d070a62-9c01-400d-ae04-d568b8ae8ede tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.157380 Oct 19 01:55:50.674077 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3380/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:50 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:51.699351 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:51.699985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:51.706858 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:51.707357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:51.707812 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:51.708518 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:51.709016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:51.709460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:51.843430 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:51.851277 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e5bb3c3f-779c-476a-81ba-0b4ba50156d2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.155864 Oct 19 01:55:51.851862 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3494/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:51 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:52.317198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "name": "network-vif-plugged", "status": "completed", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:52.334606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:52.335095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:52.335726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:52.352517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Creating event network-vif-plugged:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h2-master-1 Oct 19 01:55:52.360113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] Instance cdee4128-3689-4fb9-9c8d-09647257770e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:55:52.375562 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-bcec831a-436a-4fb9-b624-0c5a96cf1b4a req-50386695-4ce3-4f4f-873c-9fd518d421c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066450 Oct 19 01:55:52.376910 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3381/6875] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:52.876025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:52.876730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:52.884002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:52.884726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:52.885198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:52.885921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:52.886398 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:52.886847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:53.081801 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:53.090620 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17cf8770-73e1-4f07-a9e5-e14e60acf2e9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.218545 Oct 19 01:55:53.104671 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3495/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:52 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:53.303744 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "name": "network-vif-unplugged", "status": "completed", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:53.314573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:53.315117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:53.315660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:53.328441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Creating event network-vif-unplugged:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:55:53.334783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] Instance cdee4128-3689-4fb9-9c8d-09647257770e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:55:53.345381 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-07413dde-a7b6-4916-8c14-a425dd304d6d req-51eea258-a978-4668-b222-698e02b7ff3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046163 Oct 19 01:55:53.346347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3382/6877] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:54.114678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:54.115313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:54.122024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:54.122529 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:54.122991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:54.123710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:54.124185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:54.124650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:54.334153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:54.343025 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd9d4b7f-2151-4e19-9528-96c9848d7c93 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.232182 Oct 19 01:55:54.343615 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3496/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:54 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:55.368150 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:55.368922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:55.374084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:55.375337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:55.375836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:55.376281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:55.377030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:55.377497 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:55.377934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:55.384322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:55.384855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:55.385305 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:55.397017 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Creating event network-changed:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:55:55.403276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] Instance cdee4128-3689-4fb9-9c8d-09647257770e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:55:55.414358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-96b971e8-e10d-44c6-8e51-fb4c811163d8 req-e299c9b3-edca-4690-b8d1-b379ebd19b48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043887 Oct 19 01:55:55.414974 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3497/6879] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:55.517390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:55.526085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-64ff2136-904a-45a6-bd0f-d065afb27ff1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1674 microversion: 2.1 time: 0.163033 Oct 19 01:55:55.526793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3383/6880] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:55 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:56.550808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:56.551530 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:56.557880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.558384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.558844 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:56.559556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.560030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.560481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:56.690334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:56.693917 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:56.700151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a5028ef-8720-47b9-9e82-c218a13f8570 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1667 microversion: 2.1 time: 0.154457 Oct 19 01:55:56.700749 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3498/6881] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:56 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:56.723390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:56.724019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:56.731432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.731927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.732378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:56.733143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.733609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.734046 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:56.752991 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:56.863237 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:56.871937 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-410aa962-0623-4d59-9b79-a82e1b730792 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1667 microversion: 2.1 time: 0.152438 Oct 19 01:55:56.872526 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3384/6882] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:56 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:55:56.896203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:56.896870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:56.904377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.904905 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.905355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:56.906059 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:56.906526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:56.906962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:57.036832 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:57.045196 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3f27f436-bc2d-41dd-8a57-dfadb28b28ef tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1667 microversion: 2.1 time: 0.153814 Oct 19 01:55:57.045973 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3499/6883] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:56 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:57.068877 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:57.069349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:57.076090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:57.076578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:57.077049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:57.077742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:57.078226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:57.078659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:57.104713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:55:57.181883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af883c72-29c0-47d7-ae62-890c8f5dff97 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 204 len: 0 microversion: 2.1 time: 0.116489 Oct 19 01:55:57.183120 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3385/6884] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:55:57 2022] DELETE /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:55:57.192974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:57.193649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:57.200103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:57.200608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:57.201094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:57.201809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:57.202287 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:57.202734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:57.333719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:57.341807 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-669c5563-fb87-413d-bdcf-e0a7388d9e42 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1673 microversion: 2.1 time: 0.154292 Oct 19 01:55:57.342390 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3500/6885] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:57 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:58.366308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:58.367609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:58.374827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:58.375548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:58.376005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:58.376819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:58.377302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:58.377854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:58.513104 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:58.520779 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52c264cd-c0f2-4da5-89da-c4a6cd76890d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1673 microversion: 2.1 time: 0.158845 Oct 19 01:55:58.521369 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3386/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:58 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:55:59.477719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdee4128-3689-4fb9-9c8d-09647257770e", "name": "network-vif-deleted", "tag": "db351f83-783a-4391-8d5b-dea26d1ff0ca"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:55:59.491448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:59.491931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:59.492376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:59.506811 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] Creating event network-vif-deleted:db351f83-783a-4391-8d5b-dea26d1ff0ca for instance cdee4128-3689-4fb9-9c8d-09647257770e on n-h1-master-1 Oct 19 01:55:59.512856 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8f55b3d5-6914-44d7-bf20-f0b0835aca07 req-14f90306-4a16-4f68-8633-b272429a15d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038717 Oct 19 01:55:59.513694 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3501/6887] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:55:59.546819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:55:59.547776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:55:59.550875 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:55:59.557445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:59.557806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:59.558260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:59.559011 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:55:59.559478 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:55:59.559913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:55:59.632024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:55:59.640583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ec0ab9b3-f3f1-43fb-b68b-a0b7256d2f70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 200 len: 1322 microversion: 2.1 time: 0.099325 Oct 19 01:55:59.641197 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3387/6888] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:55:59 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:00.667096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:00.667823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:00.674024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:00.674522 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:00.674973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:00.675677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:00.676147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:00.676584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:00.690268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e HTTP/1.1 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: exception: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'cdee4128-3689-4fb9-9c8d-09647257770e'} Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:56:00.691895 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb40a41b-b80d-4136-bc78-d9d26c7c0daa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 404 len: 111 microversion: 2.1 time: 0.032249 Oct 19 01:56:00.697243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3502/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:00 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:56:00.709055 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:00.709681 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:00.717254 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:00.717744 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:00.718193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:00.718896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:00.719359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:00.719797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:00.733704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e HTTP/1.1 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: exception: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'cdee4128-3689-4fb9-9c8d-09647257770e'} Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:56:00.735357 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6dff04b2-8d7d-4ce6-a979-76a31ca3013d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 404 len: 111 microversion: 2.1 time: 0.031646 Oct 19 01:56:00.739822 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3388/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:00 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:56:00.787851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-79173494", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "36ba6ca3-54fd-4a5c-8d41-71cfc43609cb"}], "security_groups": [{"name": "tempest-securitygroup--368058306"}], "key_name": "tempest-keypair-815665172", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:56:01.225584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] validate_networks() for [('36ba6ca3-54fd-4a5c-8d41-71cfc43609cb', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:56:01.401548 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=47 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:01.593618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:56:01.594071 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:56:01.594572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:56:01.595039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:56:01.595472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:56:01.604943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:01.605448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:01.605904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:01.606662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:01.607159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:01.607594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:01.624916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:56:01.630185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:56:01.642880 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:56:01.645211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:56:01.692310 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-092f9199-ce48-499e-98fb-f2dd18e22422 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.908342 Oct 19 01:56:01.693323 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3503/6891] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:56:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:56:01.704778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7772eda6-eb75-4193-9ec8-ef2f9527a904 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:01.705405 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7772eda6-eb75-4193-9ec8-ef2f9527a904 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:01.707257 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:01.765541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7772eda6-eb75-4193-9ec8-ef2f9527a904 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:01.776452 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7772eda6-eb75-4193-9ec8-ef2f9527a904 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1236 microversion: 2.1 time: 0.075613 Oct 19 01:56:01.777084 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3389/6892] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:01 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1236 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:02.801040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:02.801612 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:02.810997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:02.811509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:02.811955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:02.812960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:02.813435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:02.813906 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:02.898928 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:02.910015 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-60848954-0ace-4d59-b233-c5db4ed154bd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1296 microversion: 2.1 time: 0.112532 Oct 19 01:56:02.911409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3504/6893] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:02 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1296 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:03.938093 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:03.939362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:03.946211 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:03.946885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:03.947448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:03.948236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:03.948730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:03.949174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:04.161839 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:04.170464 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1dcc398b-dc7d-4796-a191-89c1e6da002e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.236614 Oct 19 01:56:04.171073 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3390/6894] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:03 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:04.463047 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:56:04.473341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:04.473785 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:04.474221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:04.487126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] Creating event network-changed:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:56:04.491998 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-bdcb6aaf-5273-4c21-a8c9-02960fdc5895 req-a7a9ba81-7936-4f0b-8089-c1c3fddb8750 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033549 Oct 19 01:56:04.492612 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3505/6895] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:56:05.195334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:05.196017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:05.203163 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:05.203655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:05.204094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:05.204811 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:05.205269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:05.205704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:05.341098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:05.348849 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8488b0f8-6533-4ef8-a1e4-e02de6f50d3d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.157426 Oct 19 01:56:05.349435 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3391/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:05 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:06.375017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:06.375748 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:06.381974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:06.382479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:06.382936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:06.383657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:06.384189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:06.384645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:06.553340 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:06.561714 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd2db46d-f6b5-4cda-93d1-38eebf6ddd56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.191948 Oct 19 01:56:06.562637 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3506/6897] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:06 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:07.585293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:07.585911 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:07.593247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:07.593736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:07.594184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:07.594888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:07.595351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:07.595788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:07.725473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:07.733672 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8258bfc-67b6-4988-92d6-1576517b8aff tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.152357 Oct 19 01:56:07.734256 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3392/6898] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:07 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:08.758502 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:08.759141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:08.766121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:08.766626 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:08.767085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:08.767804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:08.768278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:08.768754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:08.902221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:08.910240 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f566af1c-4a5c-4e93-80d9-fca5f1f96d29 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.155751 Oct 19 01:56:08.910818 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3507/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:08 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:09.935414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:09.936036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:09.943003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:09.943488 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:09.943928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:09.944644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:09.945112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:09.945540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:10.001180 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-plugged", "status": "completed", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:56:10.012579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:10.014302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:10.014936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:10.028853 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] Creating event network-vif-plugged:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:56:10.033917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-6bc005fd-c574-4f95-b1a5-ec33b1f6e933 req-37517708-9cc0-441b-938d-949d6adfb6f5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036515 Oct 19 01:56:10.035732 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3508/6900] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:56:10.087139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:10.096184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2f63193c-5be2-42d1-8a8c-92203d563eba tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.165391 Oct 19 01:56:10.097080 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3393/6901] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:09 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:11.123241 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:11.123963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:11.130174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:11.130674 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:11.131129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:11.131829 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:11.132300 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:11.132805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:11.266155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:11.273983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1facfdae-80b1-4b3d-8396-ddcaa7165afa tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1361 microversion: 2.1 time: 0.156452 Oct 19 01:56:11.274571 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3509/6902] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:11 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:12.299466 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:12.300085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:12.302741 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:12.309146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:12.309635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:12.310078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:12.310771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:12.311226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:12.311653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:12.439696 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:12.452373 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef68087c-04f8-43ea-9c62-2ccca5df1b9f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1547 microversion: 2.1 time: 0.156756 Oct 19 01:56:12.453374 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3394/6903] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:12 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:12.477318 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:12.478105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:12.480596 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:12.481461 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:12.488572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:12.489107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:12.489567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:12.490284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:12.490761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:12.491210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:12.573239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d48e65b-c175-40db-99af-08a16ae93517 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099889 Oct 19 01:56:12.573853 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3510/6904] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 01:56:12 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:56:13.500122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:56:13.511186 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:13.511675 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:13.512147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:13.523497 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] Creating event network-changed:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:56:13.529326 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d1bd582e-fc3f-418f-8916-2872540a8f24 req-f553ae07-1245-4f01-bff1-6c923d9e13bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032990 Oct 19 01:56:13.529942 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3395/6905] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:56:55.650100 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:55.650904 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=50 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:55.655833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:56:55.656503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:55.664252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:55.664793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:55.665255 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:55.665974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:55.666449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:55.666900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:55.800614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:56:55.808421 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9659a363-640d-4638-80a2-dabeec00e32d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1666 microversion: 2.1 time: 0.160808 Oct 19 01:56:55.809035 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3511/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:56:55 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:56:55.831253 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=15 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:55.832007 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:56:55.836787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc7adb84-2622-4769-93e8-b1a6a7ac4102"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:56:55.839227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:56:55.847344 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:55.847830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:55.848273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:55.849009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:56:55.849465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:56:55.849896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:56:56.128348 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e60e7e6-68e9-4763-9de3-df086b5a76f7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299101 Oct 19 01:56:56.129179 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3396/6907] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:56:55 2022] POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:57:06.965248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:06.968143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:06.971223 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:06.972250 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:06.978129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:06.978638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:06.979096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:06.979820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:06.980294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:06.980772 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:07.009766 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:07.015516 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Old instance type m1.heat2, new instance type m1.heat {{(pid=131449) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 01:57:07.022734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:57:07.023174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:57:07.023667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:57:07.024092 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:57:07.024521 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:57:07.090154 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e1cebeee-8307-45c9-9039-8343aa32e1b6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/action" status: 202 len: 0 microversion: 2.1 time: 0.128853 Oct 19 01:57:07.093984 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3512/6908] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:57:06 2022] POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:57:07.099793 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:07.100539 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:07.103264 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:07.104128 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:07.110683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:07.111304 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:07.111748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:07.112462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:07.112948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:07.113381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:07.258356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:07.267122 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-472f2e54-6b71-4431-a391-a630394e16d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1721 microversion: 2.1 time: 0.171616 Oct 19 01:57:07.267713 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3397/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:07 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:08.291641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:08.292301 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:08.300537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:08.301079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:08.301537 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:08.302272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:08.302747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:08.303194 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:08.848313 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:08.857151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16a2ac64-2691-4b8f-a019-928b1c04e05f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1721 microversion: 2.1 time: 0.569215 Oct 19 01:57:08.858150 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3513/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:08 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1721 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:57:09.881788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:09.882417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:09.890021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:09.890513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:09.890960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:09.891663 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:09.892127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:09.892565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:10.032833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:10.041184 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-45039d83-1b80-4edb-a5a4-2c75ea77a22e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.163410 Oct 19 01:57:10.041768 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3398/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:09 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:11.066663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:11.067304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:11.074199 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:11.074698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:11.075154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:11.076380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:11.076890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:11.077335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:11.212345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:11.221290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ac17acb-ffdc-4e53-9277-6c7e657f2429 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.158901 Oct 19 01:57:11.221873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3514/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:11 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:12.245058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:12.245685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:12.253815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:12.254306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:12.254751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:12.255448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:12.255909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:12.256373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:12.388096 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:12.398699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9be42ba1-1d5f-48aa-9add-415efa9bce04 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.157447 Oct 19 01:57:12.399428 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3399/6913] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:12 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:13.424113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:13.424783 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:13.431652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:13.432145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:13.432638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:13.433359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:13.433867 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:13.434330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:13.573487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:13.581966 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6384ed12-db5e-4bde-ad7f-7274bf6aa2a4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.162390 Oct 19 01:57:13.582562 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3515/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:13 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:14.607460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:14.608139 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:14.615058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:14.615556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:14.616002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:14.616730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:14.617202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:14.617645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:14.747604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:14.756150 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d510d057-536d-42dd-878a-48a40a92729d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.152627 Oct 19 01:57:14.757031 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3400/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:14 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:15.781137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:15.781765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:15.788563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:15.789085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:15.789534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:15.790240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:15.790706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:15.791144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:15.924478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:15.932706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-24b5c55b-b07e-4fb5-9c3d-a1e4001ef467 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.155575 Oct 19 01:57:15.933277 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3516/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:15 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:16.957168 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:16.957800 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:16.964711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:16.965210 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:16.965685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:16.966392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:16.966862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:16.967959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:17.098219 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:17.106673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-baec20e1-99b6-4dd8-a637-9f0404568e0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.153468 Oct 19 01:57:17.107249 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3401/6917] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:16 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:18.130467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:18.131118 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:18.138441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:18.139663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:18.140135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:18.140894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:18.141382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:18.141835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:18.271981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:18.280365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fd5bf3e4-42c9-4371-a2ed-e518b6358120 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.153862 Oct 19 01:57:18.280908 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3517/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:18 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:19.304715 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:19.305261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:19.312381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:19.312910 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:19.313366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:19.314068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:19.314535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:19.314974 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:19.454479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:19.462765 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5db019bc-0be8-4154-9843-83523b49861f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.162098 Oct 19 01:57:19.463365 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3402/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:19 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:20.486657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:20.487303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:20.494231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:20.494733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:20.495192 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:20.495907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:20.496380 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:20.496857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:20.626211 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:20.634810 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f56b86b5-8708-4a2e-b699-0afbc7d0f85b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.152389 Oct 19 01:57:20.635396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3518/6920] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:20 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:57:21.660609 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:21.661194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:21.668194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:21.668727 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:21.669171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:21.669878 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:21.671059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:21.671587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:21.808135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:21.816949 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-403740c0-72a9-4dfd-8887-7344f4d91e26 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.160315 Oct 19 01:57:21.817601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3403/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:21 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:22.841319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:22.842591 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:22.849633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:22.850141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:22.850601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:22.851325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:22.851802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:22.852252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:22.988504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:22.997094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1cdcb145-980a-4e4a-9202-73b2c2c11cc6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1726 microversion: 2.1 time: 0.159724 Oct 19 01:57:22.997680 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3519/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:22 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:24.021834 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:24.022411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:24.030166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:24.030836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:24.031325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:24.032048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:24.032518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:24.033103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:24.179685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:24.188500 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-94824ff7-d788-494c-a2fe-e0bbfaa29f77 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1725 microversion: 2.1 time: 0.170684 Oct 19 01:57:24.189140 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3404/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:24 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:24.533668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-unplugged", "status": "completed", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:24.543642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:24.544139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:24.545845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:24.558183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Creating event network-vif-unplugged:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h2-master-1 Oct 19 01:57:24.564160 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:57:24.575004 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-9cb858a8-ef6d-4e9e-9dc6-c7c7cc9035c4 req-d2af2eaf-b4d9-47f6-9902-e4ecbb9145d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046060 Oct 19 01:57:24.575829 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3520/6924] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:57:25.213847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:25.214464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:25.221980 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:25.222471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:25.222920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:25.223622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:25.224082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:25.224522 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:25.355106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:25.363679 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-279cbd73-371f-4fde-9364-fed9393c5418 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1725 microversion: 2.1 time: 0.153803 Oct 19 01:57:25.376841 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3405/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:25 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:26.390014 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:26.390772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:26.397221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:26.397726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:26.398213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:26.398929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:26.399402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:26.399847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:26.541992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:26.550827 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7e4254a1-ba74-4d57-97b2-0ca930142862 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.166238 Oct 19 01:57:26.551441 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3521/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:26 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:26.593833 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:26.604287 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:26.604894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:26.605395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:26.617762 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Creating event network-changed:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h2-master-1 Oct 19 01:57:26.623446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:57:26.634823 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1833adc7-d336-4a77-a98f-ad2ae8f26ae5 req-81b8e821-e6b9-4b6b-8e02-579f5cb26f34 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045506 Oct 19 01:57:26.635448 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3406/6927] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:57:27.574722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:27.575332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:27.583038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:27.583542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:27.584001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:27.584743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:27.585219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:27.585665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:27.719810 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:27.728324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a443620e-deec-456d-a2ad-4ad58614a40b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.157675 Oct 19 01:57:27.728946 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3522/6928] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:27 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:28.753320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:28.754028 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:28.762706 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:28.763260 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:28.763748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:28.764590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:28.765074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:28.765506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:28.903242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:28.911916 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a4c59dcb-bacb-4de4-ae3a-3534db6ef721 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.163773 Oct 19 01:57:28.912502 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3407/6929] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:28 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:29.936581 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:29.937260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:29.944458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:29.944992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:29.945449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:29.946183 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:29.946675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:29.947151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:30.080572 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:30.089116 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8fdcbe7f-dbf1-47a9-97bc-584ffd7b1a4e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.156717 Oct 19 01:57:30.090045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3523/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:29 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:31.114393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:31.115194 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:31.122158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:31.122624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:31.123711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:31.124408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:31.124894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:31.125332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:31.262708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:31.271576 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f3eeff5e-4de9-4fa2-91df-36fe599e29c4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.161120 Oct 19 01:57:31.272270 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3408/6931] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:31 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:32.296054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:32.296713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:32.304073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:32.304511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:32.304991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:32.305713 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:32.306179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:32.306618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:32.439296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:32.447480 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-155f2143-c865-411b-8233-ef2abd3b9dad tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.156030 Oct 19 01:57:32.448055 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3524/6932] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:32 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:33.471787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:33.472410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:33.478971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:33.479463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:33.479911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:33.480637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:33.481104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:33.481536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:33.615054 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:33.623342 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33fba1ec-4571-46bb-9b65-4be319fe4058 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.155692 Oct 19 01:57:33.623953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3409/6933] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:33 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:34.647422 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:34.647954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:34.655102 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:34.655597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:34.656040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:34.656798 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:34.657262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:34.657706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:34.792361 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:34.801757 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-18f042cc-796b-449a-8ad5-0ec45bc23e5f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.158301 Oct 19 01:57:34.802337 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3525/6934] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:34 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:35.827995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:35.828966 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:35.836124 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:35.836615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:35.837113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:35.837860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:35.838342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:35.838840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:35.975536 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:35.985044 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9ebfbbd6-fbe4-4825-a6d9-e7329af34c0f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.161772 Oct 19 01:57:35.985904 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3410/6935] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:35 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:37.009064 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:37.010404 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:37.013343 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=33 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:37.020055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:37.020558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:37.021037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:37.021762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:37.022297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:37.022928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:37.025866 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:37.169207 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:37.177879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f0d18443-ac06-4e23-ae2e-cb662fdd0b5c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1723 microversion: 2.1 time: 0.172979 Oct 19 01:57:37.178523 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3526/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:37 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:38.204210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:38.204882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:38.207307 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=29 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:38.212850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.213341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.213785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.214479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.214936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.215366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.220081 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=83 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:38.351590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:38.360026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-78be7cd6-c8dd-4d25-b496-be203aa25df2 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1720 microversion: 2.1 time: 0.160635 Oct 19 01:57:38.360614 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3411/6937] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:38 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:38.383273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:38.383822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:38.391402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.391921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.392384 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.393166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.393641 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.394087 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.434493 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.434985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.435439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.436190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.437437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.437973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.458674 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:57:38.463789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Getting quotas for user dd9317ca3ff04c259208b5b70b53383d and project 34f3d54d905646719fc1e7470e7dd959. Resources: {'cores', 'ram'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:57:38.565801 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-45d423eb-5c8b-4a75-bbdc-b1e8073827cd tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/action" status: 202 len: 0 microversion: 2.1 time: 0.186291 Oct 19 01:57:38.566420 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3527/6938] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:57:38 2022] POST /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:57:38.574716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:38.575276 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:38.582027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.582691 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.582983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.583705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:38.584159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:38.584600 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:38.724575 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:38.733248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c9fb8f37-b574-480f-8f47-4eb0c72fec07 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162577 Oct 19 01:57:38.735145 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3412/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:38 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:39.761029 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:39.761747 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:39.769031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:39.769534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:39.770021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:39.770732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:39.771207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:39.771649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:39.910084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:39.918382 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6403483-7228-495f-a81f-54377bf65769 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162798 Oct 19 01:57:39.918958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3528/6940] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:39 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:57:40.841341 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-plugged", "status": "completed", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:40.853442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:40.853992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:40.854491 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:40.868648 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Creating event network-vif-plugged:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h2-master-1 Oct 19 01:57:40.874064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:57:40.885238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f699b263-af89-4f6e-adeb-69c3ae734850 req-ddba0840-7960-4946-8283-ea21f3f84ba4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047590 Oct 19 01:57:40.885902 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3413/6941] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:57:40.942474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:40.943036 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:40.949983 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:40.950477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:40.950929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:40.951629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:40.952954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:40.953827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:41.090942 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:41.100931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0f660d5-9765-491f-83ab-39dc44d55fb0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162257 Oct 19 01:57:41.101521 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3529/6942] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:40 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:42.127784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:42.128523 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:42.134849 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:42.135343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:42.135793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:42.136507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:42.136996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:42.137435 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:42.276767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:42.285419 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5f2f9905-d5dd-4696-a39f-2c0805c8c778 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162733 Oct 19 01:57:42.286014 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3414/6943] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:42 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:57:43.311964 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:43.312963 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:43.319307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:43.319806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:43.320257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:43.320987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:43.321455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:43.321891 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:43.464800 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:43.474126 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bc4990fe-221d-4186-af86-5e9f2ba17d7a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.166670 Oct 19 01:57:43.474713 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3530/6944] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:43 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:43.976212 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-unplugged", "status": "completed", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:43.988520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:43.989064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:43.989489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:44.019701 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Creating event network-vif-unplugged:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:57:44.027577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:57:44.041461 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f91c3951-ab72-4480-8ab9-d7b3e784c016 req-4df0e37a-9765-4d51-b24c-af53a55c7d56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069190 Oct 19 01:57:44.042296 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3415/6945] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:57:44.498443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:44.499002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:44.506009 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:44.506516 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:44.507468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:44.507694 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:44.508170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:44.508640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:44.731481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:44.741225 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2e520e8a-756c-4668-af6e-039f9a17d560 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.246969 Oct 19 01:57:44.741821 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3531/6946] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:44 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:45.766872 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:45.767644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:45.775004 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:45.775507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:45.775961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:45.776861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:45.777339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:45.777928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:45.914206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:45.924001 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f87f45de-86d1-4b7d-8944-7cd536c113b1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162056 Oct 19 01:57:45.924605 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3416/6947] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:45 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:46.062845 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:57:46.076451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:46.077026 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:46.077468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:46.092351 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Creating event network-changed:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:57:46.099657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-master-1', 'n-h2-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 01:57:46.111823 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e3719869-798f-464c-8606-3ea77713e2e7 req-3e4ffc18-2fe2-4045-aaaf-bfb3b5ff74eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053243 Oct 19 01:57:46.112607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3532/6948] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:57:46.948863 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:46.949409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:46.956486 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:46.957008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:46.957455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:46.958154 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:46.958611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:46.959039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:47.099835 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:47.108408 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb177320-7f22-4a82-bcde-81048f9a607c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.163681 Oct 19 01:57:47.109106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3417/6949] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:46 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:48.139926 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:48.141894 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:48.153709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:48.154653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:48.155433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:48.157890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:48.158699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:48.159365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:48.313729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:48.322259 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d37c624b-0807-4a5b-8f68-4285e961d8d7 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.191761 Oct 19 01:57:48.322886 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3533/6950] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:48 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:49.349532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:49.350167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:49.356855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:49.357412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:49.357870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:49.358639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:49.359134 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:49.359629 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:49.499161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:49.507852 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a800a4c-28e8-41cd-a916-8fe1a84a0c3f tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.164479 Oct 19 01:57:49.508450 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3418/6951] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:49 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:50.532564 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:50.533235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:50.535229 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:57:50.541457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:50.541952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:50.542436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:50.543117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:50.543581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:50.544018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:50.682020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:50.691509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c607781e-fa49-4b7c-813f-da8a4c1d1e56 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.162876 Oct 19 01:57:50.692087 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3534/6952] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:50 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:51.715524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:51.716156 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:51.724174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:51.724701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:51.725152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:51.725856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:51.726322 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:51.726760 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:51.856528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:51.865358 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d233d8b-b669-4046-972a-24acacf7d814 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.153901 Oct 19 01:57:51.865938 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3419/6953] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:51 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:52.946322 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:52.946955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:52.954052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:52.954543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:52.954994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:52.955706 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:52.956173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:52.956636 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:53.094106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:53.102524 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d3f73d5e-f9dd-4bb0-a65a-1052201ac21b tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.160114 Oct 19 01:57:53.103127 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3535/6954] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:52 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:54.126965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:54.127590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:54.134501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:54.135000 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:54.135456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:54.136162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:54.136652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:54.137102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:54.269106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:54.277468 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1263834e-f927-4579-8cc2-53c67b26c1cf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.155257 Oct 19 01:57:54.278074 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3420/6955] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:54 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:55.304475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:55.305042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:55.312103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:55.313327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:55.313819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:55.314543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:55.315017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:55.315467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:55.451185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:55.459464 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4fba53f0-7f58-4aec-ac63-eb0b7d528561 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.159606 Oct 19 01:57:55.460042 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3536/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:55 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:56.483100 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:56.483729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:56.490795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:56.491281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:56.491719 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:56.492413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:56.492896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:56.493326 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:56.628683 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:56.637112 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5574fb49-5ca3-44e3-a078-bab432850bd8 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1719 microversion: 2.1 time: 0.157989 Oct 19 01:57:56.637721 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3421/6957] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:56 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:57.662996 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:57.663577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:57.672049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:57.672608 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:57.673135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:57.675049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:57.675049 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:57.675433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:57.814609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:57.825710 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-252df619-e59f-4f6c-b23e-d3448d2db0d6 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1712 microversion: 2.1 time: 0.167463 Oct 19 01:57:57.826311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3537/6958] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:57 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1712 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:57.850955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:57.851612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:57.858555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:57.859050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:57.859501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:57.860208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:57.860705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:57.861149 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.032613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:58.041291 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7e4a0948-a2f6-43de-9dbf-7b5c6572e726 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1712 microversion: 2.1 time: 0.195124 Oct 19 01:57:58.041897 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3422/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:57 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1712 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:58.064253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:58.065562 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:58.071686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.072193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.072668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.073392 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.073877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.074322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.289618 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:58.298083 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4bd5e983-d987-4b48-a206-20a49d9ad938 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1712 microversion: 2.1 time: 0.238052 Oct 19 01:57:58.298677 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3538/6960] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:58 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1712 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:58.322522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:58.323037 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:58.329026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.329526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.330003 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.330699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.331171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.331613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.358350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:57:58.448754 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ceddcca2-1ff0-4194-8257-f0d2ac9aac3c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 204 len: 0 microversion: 2.1 time: 0.129561 Oct 19 01:57:58.455601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3423/6961] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:57:58 2022] DELETE /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:57:58.459830 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:58.460822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:58.468573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.469495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.470158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.471731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:58.472438 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:58.473281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:58.619229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:57:58.628020 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4ee57581-4976-480d-aedc-618eeedc303d tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1718 microversion: 2.1 time: 0.173357 Oct 19 01:57:58.628607 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3539/6962] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:58 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:57:59.652312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:57:59.653058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:57:59.659933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:59.660608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:59.661090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:57:59.661800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:57:59.662270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:57:59.662710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:00.187297 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:00.196391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-31036ed9-cd8a-4572-b90c-7d68a52075dc tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1718 microversion: 2.1 time: 0.548369 Oct 19 01:58:00.197005 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3424/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:57:59 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1718 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:00.534311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-plugged", "status": "completed", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:00.547116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:00.548512 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:00.549005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:00.555083 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:00.564234 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] Creating event network-vif-plugged:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:58:00.570075 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5ecb9a52-4145-414b-a724-b0f87ac6c220 req-61ae4b85-0b3b-48b5-9c2b-ef3282156aa4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039742 Oct 19 01:58:00.570919 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3540/6964] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:01.220786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:01.221407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:01.229087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:01.229577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:01.230226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:01.230996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:01.231459 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:01.231888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:01.263642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a78e70-ee86-436e-85bc-29ff6dc85061", "name": "network-vif-deleted", "tag": "4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:01.280024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:01.281521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:01.283095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:01.297314 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] Creating event network-vif-deleted:4151c4b7-e7fe-4ee9-bdd2-fda682ce1ad2 for instance 37a78e70-ee86-436e-85bc-29ff6dc85061 on n-h1-master-1 Oct 19 01:58:01.305314 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-73214f6e-c92b-4701-ac43-8ed0e5b630a6 req-d00ad3d6-d036-4a05-87d7-c628488c0ec3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046930 Oct 19 01:58:01.305937 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3541/6965] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:01.317574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:01.326591 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e15214d-bbde-4314-9df9-d2a4691230c9 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1651 microversion: 2.1 time: 0.109708 Oct 19 01:58:01.327408 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3425/6966] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:01 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1651 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:02.353034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:02.353843 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:02.360971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:02.361556 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:02.362093 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:02.363603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:02.364151 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:02.364599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:02.434586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:02.444442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fbf54453-f553-42e8-a7b7-c1fa9293f0b4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1367 microversion: 2.1 time: 0.097027 Oct 19 01:58:02.444980 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3542/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:02 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:03.468836 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:03.469472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:03.477623 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:03.478165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:03.478640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:03.479448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:03.479899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:03.480384 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:03.546390 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:03.548802 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:03.556755 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6d7e932e-89eb-4a65-8102-d79ca3b8d4c0 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1367 microversion: 2.1 time: 0.092054 Oct 19 01:58:03.557722 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3426/6968] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:03 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1367 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:04.580656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:04.581286 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:04.589340 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:04.589868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:04.590327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:04.591045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:04.591515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:04.591963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:04.655623 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:04.664473 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06275f7b-bd50-4688-a996-6088a5d91371 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1367 microversion: 2.1 time: 0.087868 Oct 19 01:58:04.665089 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3543/6969] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:04 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:05.690180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:05.690817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:05.699367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:05.699856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:05.700294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:05.701009 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:05.701464 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:05.701897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:05.735387 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:05.735865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:05.736303 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:05.736781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lazy-loading 'fault' on Instance uuid 37a78e70-ee86-436e-85bc-29ff6dc85061 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:58:05.779085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd9317ca3ff04c259208b5b70b53383d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f3d54d905646719fc1e7470e7dd959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:05.787285 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4d0dc98f-d314-4f8c-a63f-9519f0d9dab4 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 200 len: 1372 microversion: 2.1 time: 0.101736 Oct 19 01:58:05.787871 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3427/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:05 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:58:06.812421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:06.813129 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:06.821006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:06.821525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:06.821977 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:06.822688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:06.823163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:06.823605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:06.838318 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 HTTP/1.1 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '37a78e70-ee86-436e-85bc-29ff6dc85061'} Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:06.840066 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-301b102b-3448-4749-b090-978f299ceaa5 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 404 len: 111 microversion: 2.1 time: 0.033586 Oct 19 01:58:06.845496 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3544/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:06 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:06.906255 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:06.908823 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:06.916390 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:06.916986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:06.917453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:06.918148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:06.918604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:06.919036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:06.931918 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-volume_attachments HTTP/1.1 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '37a78e70-ee86-436e-85bc-29ff6dc85061'} Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:06.933629 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dea1b0bb-17ff-4a74-976c-dd18372377bf tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032971 Oct 19 01:58:06.939473 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3428/6972] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:58:06 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.262981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.263504 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.266619 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:10.272864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.273369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.273825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.274538 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.275016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.275450 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.290940 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 HTTP/1.1 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '37a78e70-ee86-436e-85bc-29ff6dc85061'} Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.292507 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa4d6bb5-b213-440b-a63e-a17d8e095eb1 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 404 len: 111 microversion: 2.1 time: 0.034923 Oct 19 01:58:10.297451 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3545/6973] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:10 2022] DELETE /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.303307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.303951 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 37a78e70-ee86-436e-85bc-29ff6dc85061] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.306752 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:10.314130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.314688 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.315145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.315869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.316339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.316881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.332647 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 HTTP/1.1 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '37a78e70-ee86-436e-85bc-29ff6dc85061'} Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.334741 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 37a78e70-ee86-436e-85bc-29ff6dc85061 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bfb2d2d7-4f7d-4014-b06a-01add259476a tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061" status: 404 len: 111 microversion: 2.1 time: 0.037471 Oct 19 01:58:10.342816 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3429/6974] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:10 2022] GET /compute/v2.1/servers/37a78e70-ee86-436e-85bc-29ff6dc85061 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.346068 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.346717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.354428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.355042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.355506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.356290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.356791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.357245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.372537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e HTTP/1.1 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: exception: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'cdee4128-3689-4fb9-9c8d-09647257770e'} Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.374388 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32d44275-dfc2-4799-aca8-f6059f62181e tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 404 len: 111 microversion: 2.1 time: 0.034202 Oct 19 01:58:10.381634 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3546/6975] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:10 2022] DELETE /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.384692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.385476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: cdee4128-3689-4fb9-9c8d-09647257770e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.391893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.392398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.392883 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.393611 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.394080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.394519 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.409651 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e HTTP/1.1 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: exception: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'cdee4128-3689-4fb9-9c8d-09647257770e'} Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.411200 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance cdee4128-3689-4fb9-9c8d-09647257770e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4affd51a-522d-46f5-8887-794bfa37ed72 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e" status: 404 len: 111 microversion: 2.1 time: 0.032168 Oct 19 01:58:10.416964 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3430/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:10 2022] GET /compute/v2.1/servers/cdee4128-3689-4fb9-9c8d-09647257770e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.422878 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.423514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.429973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.430540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.431064 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.431802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.432279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.432805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.447653 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae HTTP/1.1 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '72964f3e-efbb-4443-8a32-c54e26dc4dae'} Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.449379 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-12696a67-7c26-4b23-9a39-d6a24212942c tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 404 len: 111 microversion: 2.1 time: 0.032218 Oct 19 01:58:10.454134 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3547/6977] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:10 2022] DELETE /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.459672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.461085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 72964f3e-efbb-4443-8a32-c54e26dc4dae] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.467632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.468137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.468591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.469335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.469859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.470309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.486987 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae HTTP/1.1 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '72964f3e-efbb-4443-8a32-c54e26dc4dae'} Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.488558 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 72964f3e-efbb-4443-8a32-c54e26dc4dae could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-65711695-f95d-4c39-bdce-84c9341447a3 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae" status: 404 len: 111 microversion: 2.1 time: 0.034585 Oct 19 01:58:10.494001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3431/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:10 2022] GET /compute/v2.1/servers/72964f3e-efbb-4443-8a32-c54e26dc4dae => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 01:58:10.501276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.501798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.508929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.509439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.509953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.510710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.511189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.511658 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.526928 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc HTTP/1.1 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '16e9233a-097d-472c-aba6-9260c04bcacc'} Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.528584 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bff6ea3e-b1c0-4613-80a4-4f7a318ab277 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 404 len: 111 microversion: 2.1 time: 0.033118 Oct 19 01:58:10.532659 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3548/6979] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:10 2022] DELETE /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.539315 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.539939 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] [instance: 16e9233a-097d-472c-aba6-9260c04bcacc] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:10.546205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.546704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.547213 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.547934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:10.548402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:10.548867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:10.563675 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] HTTP exception thrown: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Request method failure captured: Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc HTTP/1.1 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1hBH-44UOuHw3jlPUXZNnTqd5CvquIfBHFx8fLldb9a7lRqBFIDg_9JMmlC9V2rO2DOI3y3nlpQAKfv_STVYRn-WvMyXcd5IWw9AiOP4BtMhLLwS1iyE82sbM0MD_5B0nal6sF-v7YkL9Kgm4cGOXkz1aC0gbFR_6NDEPlIIPYTzHM Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34f3d54d905646719fc1e7470e7dd959", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34f3d54d905646719fc1e7470e7dd959"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34f3d54d905646719fc1e7470e7dd959"}]}] Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 34f3d54d905646719fc1e7470e7dd959 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServerActionsTestJSON-1684988898 Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: dd9317ca3ff04c259208b5b70b53383d Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServerActionsTestJSON-1684988898-project Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '16e9233a-097d-472c-aba6-9260c04bcacc'} Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:10.565214 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Returning 404 to user: Instance 16e9233a-097d-472c-aba6-9260c04bcacc could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c66b3b2-0285-4b8f-be25-1ab08e197b70 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc" status: 404 len: 111 microversion: 2.1 time: 0.031591 Oct 19 01:58:10.571129 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3432/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:10 2022] GET /compute/v2.1/servers/16e9233a-097d-472c-aba6-9260c04bcacc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:10.577342 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-be58cda2-5a66-4b04-bd46-7efaeb16ee25 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] Calling method '.version_select at 0x7f2aefd54e50>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:10.604867 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-be58cda2-5a66-4b04-bd46-7efaeb16ee25 tempest-ServerActionsTestJSON-1684988898 tempest-ServerActionsTestJSON-1684988898-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815665172" status: 202 len: 0 microversion: 2.1 time: 0.031191 Oct 19 01:58:10.605768 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3549/6981] 10.222.0.27 () {58 vars in 1218 bytes} [Wed Oct 19 01:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815665172 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:58:20.162636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1791971200", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "3df27350-e493-4913-8d99-c0061763b80b"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:20.365480 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] validate_networks() for [('3df27350-e493-4913-8d99-c0061763b80b', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:58:20.553691 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=19 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:20.773801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:58:20.774234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:58:20.774848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:58:20.775270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:58:20.775703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:58:20.785239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:20.785743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:20.786193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:20.786939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:20.787406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:20.787884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:20.805811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Getting quotas for project 14759ca153c7401f809cc795bbbaf519. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:58:20.811582 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Getting quotas for user 387445132a5d4fb88c7a0e08d0840d13 and project 14759ca153c7401f809cc795bbbaf519. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:58:20.824564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:58:20.826945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:58:20.872792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-68719585-c8b5-4d2b-b9b9-8dd778e4beaa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.860019 Oct 19 01:58:20.873461 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3433/6982] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:58:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:58:20.883311 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=25 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:20.884138 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:20.888243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d1f713d-aba2-49e1-aada-57d63fa57bb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:20.888916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d1f713d-aba2-49e1-aada-57d63fa57bb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:21.011966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d1f713d-aba2-49e1-aada-57d63fa57bb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:21.019147 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d1f713d-aba2-49e1-aada-57d63fa57bb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1217 microversion: 2.1 time: 0.138290 Oct 19 01:58:21.019743 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3550/6983] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:20 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:58:22.051622 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41912372-2e5a-4c2f-8792-bcdb144ab793 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:22.052326 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41912372-2e5a-4c2f-8792-bcdb144ab793 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:22.113456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41912372-2e5a-4c2f-8792-bcdb144ab793 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:22.122194 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41912372-2e5a-4c2f-8792-bcdb144ab793 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1217 microversion: 2.1 time: 0.083097 Oct 19 01:58:22.122719 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3434/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:22 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:23.145632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6cd4802-681d-4b6a-9b21-fb26c660fc99 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:23.146261 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6cd4802-681d-4b6a-9b21-fb26c660fc99 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:23.206708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e6cd4802-681d-4b6a-9b21-fb26c660fc99 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:23.215283 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6cd4802-681d-4b6a-9b21-fb26c660fc99 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1217 microversion: 2.1 time: 0.073518 Oct 19 01:58:23.216123 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3551/6985] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:23 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:24.239700 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8db2908-573d-4dad-bec4-908f6df9fe70 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:24.240293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8db2908-573d-4dad-bec4-908f6df9fe70 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:24.296385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8db2908-573d-4dad-bec4-908f6df9fe70 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:24.303517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8db2908-573d-4dad-bec4-908f6df9fe70 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1217 microversion: 2.1 time: 0.068092 Oct 19 01:58:24.304153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3435/6986] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:24 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:25.327294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:25.327865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:25.335489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:25.336001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:25.336492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:25.337247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:25.337723 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:25.338177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:25.403110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:25.410870 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4cb0e206-70d0-47d6-b6c8-9237eca32f23 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1221 microversion: 2.1 time: 0.087826 Oct 19 01:58:25.411462 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3552/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:25 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1221 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:26.435717 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:26.436578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:26.443884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:26.444407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:26.445800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:26.446148 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:26.446604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:26.447038 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:26.516720 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:26.525169 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9079410a-6dfd-490c-96c7-57a6425ca828 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1275 microversion: 2.1 time: 0.093502 Oct 19 01:58:26.525761 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3436/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:26 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:27.549229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:27.550527 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:27.560365 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:27.561500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:27.562094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:27.562916 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:27.563621 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:27.564132 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:27.775277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:27.784153 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-78a04003-c2d8-49c4-ab29-d27e272e00c7 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.238875 Oct 19 01:58:27.784774 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3553/6989] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:27 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:27.857249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b95a3195-d4f9-4039-a3d7-cda7198aed9e", "tag": "eb969e7c-1678-413b-8492-7e530de216b3"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:27.868130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:27.868670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:27.869105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:27.880831 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] Creating event network-changed:eb969e7c-1678-413b-8492-7e530de216b3 for instance b95a3195-d4f9-4039-a3d7-cda7198aed9e on n-h1-master-1 Oct 19 01:58:27.886199 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-573100f0-9d16-4c87-80cc-4c1bf044798b req-41435f7c-0267-494e-b311-5e9e14416734 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032669 Oct 19 01:58:27.886959 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3437/6990] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:28.809201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:28.809829 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:28.817083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:28.817585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:28.818039 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:28.818756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:28.819230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:28.819677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:28.949443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:28.957326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e3fc20b0-f79d-434a-be4e-862251108eb5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.153039 Oct 19 01:58:28.957899 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3554/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:28 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:29.982015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:29.982612 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:29.988783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:29.989271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:29.989721 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:29.990420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:29.990884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:29.991319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:30.129107 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:30.137943 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-16c735a9-6777-4b59-8dd0-c29c5c556fba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.161608 Oct 19 01:58:30.138544 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3438/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:29 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:31.162593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:31.163226 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:31.170655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:31.171155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:31.171607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:31.172318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:31.172823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:31.173265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:31.306719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:31.314735 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9fd097d9-51f0-4a45-9c8d-ee335b7b0644 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.156125 Oct 19 01:58:31.315327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3555/6993] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:31 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:32.339711 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:32.340479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:32.342341 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:32.348841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:32.349342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:32.349776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:32.350494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:32.350927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:32.351365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:32.482259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:32.489938 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-db3fa47d-4cda-4b7c-b110-294b255d73bb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.154660 Oct 19 01:58:32.490513 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3439/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:32 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:32.684601 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95a3195-d4f9-4039-a3d7-cda7198aed9e", "name": "network-vif-plugged", "status": "completed", "tag": "eb969e7c-1678-413b-8492-7e530de216b3"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:32.695887 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:32.696373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:32.696976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:32.708735 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] Creating event network-vif-plugged:eb969e7c-1678-413b-8492-7e530de216b3 for instance b95a3195-d4f9-4039-a3d7-cda7198aed9e on n-h1-master-1 Oct 19 01:58:32.713785 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-13479203-0afd-4cba-aa02-4b8694f4a70c req-91c59ef6-168d-4371-b03c-77cff8efbe80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032969 Oct 19 01:58:32.714426 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3556/6995] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:58:33.513243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:33.513931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:33.521368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:33.521863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:33.522312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:33.523024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:33.523492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:33.523930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:33.656033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:33.664411 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e79eeee4-eccf-4990-8c17-e46422bc0450 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1317 microversion: 2.1 time: 0.155197 Oct 19 01:58:33.665085 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3440/6996] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:33 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:34.685286 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:34.690994 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:34.691726 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:34.698281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:34.698791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:34.699251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:34.699963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:34.701476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:34.701625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:34.840105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:34.848582 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b2e7a26-f70d-4724-b482-826dbe3dd541 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.164871 Oct 19 01:58:34.849231 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3557/6997] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:34 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:34.916280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-733399489", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "3df27350-e493-4913-8d99-c0061763b80b"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:34.925432 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:34.972988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] validate_networks() for [('3df27350-e493-4913-8d99-c0061763b80b', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:58:35.380586 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:58:35.381068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:58:35.381557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:58:35.382015 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:58:35.382470 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:58:35.391485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:35.391975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:35.392425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:35.393236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:35.393705 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:35.394145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:35.411410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Getting quotas for project 14759ca153c7401f809cc795bbbaf519. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:58:35.416826 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Getting quotas for user 387445132a5d4fb88c7a0e08d0840d13 and project 14759ca153c7401f809cc795bbbaf519. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:58:35.429706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:58:35.431999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:58:35.478932 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ed99556f-af26-4115-82b1-e2ceb60b964c tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566635 Oct 19 01:58:35.479518 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3441/6998] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:58:35.490764 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d64a280-813f-41f8-ae23-0aad631f80fe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:35.491394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d64a280-813f-41f8-ae23-0aad631f80fe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:35.547980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d64a280-813f-41f8-ae23-0aad631f80fe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:35.554949 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d64a280-813f-41f8-ae23-0aad631f80fe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1216 microversion: 2.1 time: 0.068250 Oct 19 01:58:35.555532 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3558/6999] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:35 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:36.579538 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:36.580491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:36.593021 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:36.593969 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:36.594469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:36.595306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:36.595813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:36.596444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:36.670551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:36.678950 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d2dfc088-111c-4633-a842-0c9411ef5cb4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1286 microversion: 2.1 time: 0.103817 Oct 19 01:58:36.679553 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3442/7000] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:36 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:37.704467 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:37.705228 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:37.716389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:37.716934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:37.717394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:37.718121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:37.718600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:37.719043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:37.856794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:37.865243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3107c5a-0ce1-412f-8edb-a2f73fca090e tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.165554 Oct 19 01:58:37.865925 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3559/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:37 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:38.022809 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94379292-26aa-44cc-8b22-67eec4daa95a", "tag": "4bc5950a-f2b1-4081-890b-a28314db3b65"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:38.032847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:38.033343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:38.033790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:38.047006 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] Creating event network-changed:4bc5950a-f2b1-4081-890b-a28314db3b65 for instance 94379292-26aa-44cc-8b22-67eec4daa95a on n-h2-master-1 Oct 19 01:58:38.052917 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b4f944ba-61bc-48cd-92b2-5394da6008b9 req-e4f75b59-5d87-4128-aea3-fad2301d1a0e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095738 Oct 19 01:58:38.053546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3443/7002] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:38.890324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:38.891020 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:38.897986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:38.898477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:38.898944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:38.899624 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:38.900088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:38.900524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:39.032218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:39.040449 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bea372fb-fca5-416d-a42c-ca3e433b33fa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.154329 Oct 19 01:58:39.041066 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3560/7003] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:38 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:40.065130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:40.065870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:40.072928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:40.073432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:40.073887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:40.074592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:40.075783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:40.076228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:40.206630 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:40.214335 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ab86e92-399e-4ecc-af17-acea39809da5 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.153874 Oct 19 01:58:40.214909 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3444/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:40 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:41.238745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:41.239385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:41.246373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:41.246932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:41.247455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:41.248165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:41.248648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:41.249097 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:41.383121 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:41.391601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2c0c87f-1d6f-4df2-ac3f-290e19a0a9a4 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.156766 Oct 19 01:58:41.392189 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3561/7005] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:41 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:42.415508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:42.416133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:42.419225 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:42.424790 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:42.425284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:42.425730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:42.426427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:42.426890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:42.427325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:42.560171 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:42.569386 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-906bf123-acc9-4beb-ac80-a1bc10ff9d06 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.157783 Oct 19 01:58:42.569990 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3445/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:42 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:43.124902 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94379292-26aa-44cc-8b22-67eec4daa95a", "name": "network-vif-plugged", "status": "completed", "tag": "4bc5950a-f2b1-4081-890b-a28314db3b65"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:43.136213 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:43.136743 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:43.137193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:43.149643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] Creating event network-vif-plugged:4bc5950a-f2b1-4081-890b-a28314db3b65 for instance 94379292-26aa-44cc-8b22-67eec4daa95a on n-h2-master-1 Oct 19 01:58:43.155439 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-46440b6b-d38b-4376-b115-00bb82d91b4a req-78aec8e9-321a-48e7-a34f-da2a843e0038 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034536 Oct 19 01:58:43.156091 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3562/7007] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:43.592676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:43.593299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:43.600172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:43.600685 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:43.601132 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:43.601832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:43.602292 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:43.602725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:43.735084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:43.742840 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-409f7674-48c0-453b-8645-8c5c4f31facb tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1316 microversion: 2.1 time: 0.154123 Oct 19 01:58:43.743425 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3446/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:43 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:44.769588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:44.770364 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:44.776524 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:44.777046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:44.777491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:44.778815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:44.779280 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:44.779716 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:44.912780 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:44.921055 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-64be567b-00df-4a13-bdc3-5c1c3153364d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1505 microversion: 2.1 time: 0.157001 Oct 19 01:58:44.921631 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3563/7009] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:44 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:44.944971 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:44.945513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:44.953107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:44.953595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:44.954044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:44.954994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:44.955209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:44.955651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:44.980847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:58:45.055848 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bacd2c16-a0d9-458a-b266-0e4752412f9a tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 204 len: 0 microversion: 2.1 time: 0.114494 Oct 19 01:58:45.056483 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3447/7010] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:44 2022] DELETE /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:58:45.065763 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:45.066401 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:45.072521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:45.073057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:45.073511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:45.074217 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:45.074711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:45.076226 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:45.210815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:45.219597 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7657edc4-29a3-41e4-a5bd-b0792f70f2e0 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1511 microversion: 2.1 time: 0.157729 Oct 19 01:58:45.220169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3564/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:45 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:46.242479 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:46.243178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:46.245181 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:46.245945 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:46.254226 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:46.254713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:46.255157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:46.255852 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:46.256324 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:46.256794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:46.385427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:46.393387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-62baa585-5b20-413b-aca3-8e1cbaeec6ba tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1511 microversion: 2.1 time: 0.155167 Oct 19 01:58:46.393980 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3448/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:46 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:47.168331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94379292-26aa-44cc-8b22-67eec4daa95a", "name": "network-vif-deleted", "tag": "4bc5950a-f2b1-4081-890b-a28314db3b65"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:47.174912 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:47.186329 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:47.187129 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:47.187825 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:47.202726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] Creating event network-vif-deleted:4bc5950a-f2b1-4081-890b-a28314db3b65 for instance 94379292-26aa-44cc-8b22-67eec4daa95a on n-h2-master-1 Oct 19 01:58:47.208540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f6a0ad01-4d16-456f-91ef-011dc4fd4c3c req-efb786a2-f08d-4c32-af3b-d3d3463d99e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043888 Oct 19 01:58:47.209507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3565/7013] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:47.417371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:47.417989 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:47.424908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:47.425392 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:47.425833 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:47.426527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:47.426984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:47.427413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:47.458963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:47.459438 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:47.459872 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:47.460316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lazy-loading 'fault' on Instance uuid 94379292-26aa-44cc-8b22-67eec4daa95a {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:58:47.501385 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:47.509052 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0ecdb3b3-69a9-4a30-b75d-9bf8d7876113 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 200 len: 1306 microversion: 2.1 time: 0.095529 Oct 19 01:58:47.509637 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3449/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:47 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 1306 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:48.533592 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:48.534219 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:48.540442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.540966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.541420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.542128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.542587 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.543025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.557197 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a HTTP/1.1 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '94379292-26aa-44cc-8b22-67eec4daa95a'} Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:48.559067 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 404 to user: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f5a7d36-9ca5-4a16-91b8-5fcb442b2606 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 404 len: 111 microversion: 2.1 time: 0.032876 Oct 19 01:58:48.566688 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3566/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:48 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:48.572952 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:48.573585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:48.581714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.582220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.582702 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.583420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.583889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.584332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.718529 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:48.726475 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ebfbb1e3-0755-4651-93fb-2bba409c3640 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.157917 Oct 19 01:58:48.727315 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3450/7016] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:48 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:48.749947 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:48.752321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: f5061e9c-7509-4041-9274-2d18d6ca0b42] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:48.757822 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/f5061e9c-7509-4041-9274-2d18d6ca0b42/action HTTP/1.1 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 32 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: {"resize": {"flavorRef": "452"}} Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: exception: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'f5061e9c-7509-4041-9274-2d18d6ca0b42', 'body': {'resize': {'flavorRef': '452'}}} Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:48.759367 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 404 to user: Instance f5061e9c-7509-4041-9274-2d18d6ca0b42 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4248a1a-13cc-4085-b602-461a6e7c3d15 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "POST /compute/v2.1/servers/f5061e9c-7509-4041-9274-2d18d6ca0b42/action" status: 404 len: 111 microversion: 2.1 time: 0.015499 Oct 19 01:58:48.765032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3567/7017] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:58:48 2022] POST /compute/v2.1/servers/f5061e9c-7509-4041-9274-2d18d6ca0b42/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:48.770556 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:48.771210 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:48.777351 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.778482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.778937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.779634 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.780090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.780520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.917051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:48.924971 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d57ff414-05e5-45a0-a9d3-c1fe9a88c908 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.158561 Oct 19 01:58:48.925556 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3451/7018] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:48 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:48.950188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:48.950886 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:48.960853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.961367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.961823 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:48.962539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:48.963013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:48.963459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.101062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:49.109516 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-35d09598-c54c-493b-acd1-1aa696af6e8d tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.163796 Oct 19 01:58:49.110100 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3568/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:48 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:49.132417 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "8997ce3b-5acf-48cc-b899-8d4b10a86fa6"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:49.134767 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.140880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.141369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.141808 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.142498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.142954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.143381 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.147361 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:49.174005 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:49.178909 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: request: POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action HTTP/1.1 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 65 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: {"resize": {"flavorRef": "8997ce3b-5acf-48cc-b899-8d4b10a86fa6"}} Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: exception: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b95a3195-d4f9-4039-a3d7-cda7198aed9e', 'body': {'resize': {'flavorRef': '8997ce3b-5acf-48cc-b899-8d4b10a86fa6'}}} Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:49.188372 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 400 to user: Flavor 8997ce3b-5acf-48cc-b899-8d4b10a86fa6 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a092a03-d492-4940-96d2-14c922255446 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action" status: 400 len: 107 microversion: 2.1 time: 0.061494 Oct 19 01:58:49.193164 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3452/7020] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:58:49 2022] POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:58:49.198525 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.199158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.205331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.205824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.206271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.206970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.207433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.207869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.337213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:49.345466 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-027b9a05-bf67-428e-862e-73c26138e5aa tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.150777 Oct 19 01:58:49.346042 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3569/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:49 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:49.369522 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.370134 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.376452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.376982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.377434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.378205 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.378729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.379373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.510773 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:49.518728 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-419a5c36-40ff-47b4-b4ac-183ec05f9f75 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.153126 Oct 19 01:58:49.519312 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3453/7022] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:49 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:49.542090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c086277b-ef59-4c5c-b4ac-f7c2a77c2662 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c086277b-ef59-4c5c-b4ac-f7c2a77c2662 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: request: POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action HTTP/1.1 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 29 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: {"resize": {"flavorRef": ""}} Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'b95a3195-d4f9-4039-a3d7-cda7198aed9e', 'body': {'resize': {'flavorRef': ''}}} Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise error Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi '' Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.546316 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c086277b-ef59-4c5c-b4ac-f7c2a77c2662 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c086277b-ef59-4c5c-b4ac-f7c2a77c2662 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action" status: 400 len: 113 microversion: 2.1 time: 0.009758 Oct 19 01:58:49.550983 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3570/7023] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 01:58:49 2022] POST /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 19 01:58:49.555912 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.556532 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.563804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.564296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.564772 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.565485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.565950 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.566388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.700988 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:49.708734 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-df30d672-cfe3-4d99-b400-c0392c4a6cfe tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1506 microversion: 2.1 time: 0.156484 Oct 19 01:58:49.709250 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3454/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:49 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 01:58:49.735712 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.736223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.742976 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.743476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.743931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.744662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.745142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.745586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.759110 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a HTTP/1.1 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '94379292-26aa-44cc-8b22-67eec4daa95a'} Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:49.760730 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 404 to user: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f04e55f1-e1f9-4f05-9958-88d2c824c128 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "DELETE /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 404 len: 111 microversion: 2.1 time: 0.031610 Oct 19 01:58:49.765945 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3571/7025] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:49 2022] DELETE /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:49.772759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.773387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: 94379292-26aa-44cc-8b22-67eec4daa95a] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.779544 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.780074 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.780535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.781267 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.781733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.782171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.796082 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a HTTP/1.1 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '94379292-26aa-44cc-8b22-67eec4daa95a'} Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:49.797652 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 404 to user: Instance 94379292-26aa-44cc-8b22-67eec4daa95a could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d717632f-4c5c-4086-9c8a-53807dabaef6 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a" status: 404 len: 111 microversion: 2.1 time: 0.030285 Oct 19 01:58:49.803228 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3455/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:49 2022] GET /compute/v2.1/servers/94379292-26aa-44cc-8b22-67eec4daa95a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:58:49.807556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.808102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.814929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.815427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.815882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.816589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.817084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.817533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.842358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:58:49.915384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f9262fad-e9dc-4578-823c-2f540750f9b2 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 204 len: 0 microversion: 2.1 time: 0.111416 Oct 19 01:58:49.916010 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3572/7027] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:58:49 2022] DELETE /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:58:49.924596 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:49.925347 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:49.931431 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.931929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.932380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:49.933110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:49.933579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:49.934682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:50.064084 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:50.071871 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c908b792-70e1-43e4-8a90-c63f0eab1605 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1512 microversion: 2.1 time: 0.151142 Oct 19 01:58:50.072446 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3456/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:49 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:51.097297 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:51.098022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:51.101385 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:51.108731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:51.109298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:51.109754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:51.110472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:51.110953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:51.111393 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:51.116188 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:58:51.250084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:51.257946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b2f1bba-4bb2-412b-a943-c6f97562615f tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1512 microversion: 2.1 time: 0.165070 Oct 19 01:58:51.258775 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3573/7029] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:51 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:52.018258 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95a3195-d4f9-4039-a3d7-cda7198aed9e", "name": "network-vif-deleted", "tag": "eb969e7c-1678-413b-8492-7e530de216b3"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:58:52.029102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:52.029590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:52.030027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:52.041802 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] Creating event network-vif-deleted:eb969e7c-1678-413b-8492-7e530de216b3 for instance b95a3195-d4f9-4039-a3d7-cda7198aed9e on n-h1-master-1 Oct 19 01:58:52.048713 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0963a394-fd06-4475-b538-d85c346fce91 req-f8bba68a-be3e-4b62-8a13-89e85db835c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033882 Oct 19 01:58:52.052721 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3457/7030] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:58:52.282600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:52.283242 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:52.290067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:52.290563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:52.291017 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:52.291724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:52.292195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:52.292662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:52.327509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:52.328004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:52.328461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:52.328961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lazy-loading 'fault' on Instance uuid b95a3195-d4f9-4039-a3d7-cda7198aed9e {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:58:52.370158 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '387445132a5d4fb88c7a0e08d0840d13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14759ca153c7401f809cc795bbbaf519', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:58:52.378317 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8a513033-1ded-40f2-8442-36b96ead9369 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 200 len: 1307 microversion: 2.1 time: 0.099846 Oct 19 01:58:52.378935 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3574/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:52 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 1307 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:58:53.399687 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 01:58:53.400294 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 01:58:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e (ip 10.222.0.27) !!! Oct 19 01:58:53.405886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:58:53.406593 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] [instance: b95a3195-d4f9-4039-a3d7-cda7198aed9e] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:58:53.414032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:53.414518 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:53.414963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:53.415659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:58:53.416120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:58:53.416551 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:58:53.431328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] HTTP exception thrown: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Request method failure captured: Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e HTTP/1.1 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1m7o1sWBz1AFx9UTlsiGl9Si895sO41CZ1D0SGYPQdCH3CLUaMct83Y8cFx3nEskoytkNDvwAEqhFfOdnVYTHweLE5TMkvskKN-gKhpDvoHa9o09xyOVXWM7U-Xo3Bionj7_7AOiCXAZMzVHqdy4ohS0iJAEwLWmF2Lq_siA8O-VxY Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_14759ca153c7401f809cc795bbbaf519", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/14759ca153c7401f809cc795bbbaf519"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/14759ca153c7401f809cc795bbbaf519"}]}] Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 14759ca153c7401f809cc795bbbaf519 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2120905934 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 387445132a5d4fb88c7a0e08d0840d13 Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-ServersNegativeTestJSON-2120905934-project Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: exception: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': 'b95a3195-d4f9-4039-a3d7-cda7198aed9e'} Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:58:53.432972 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] Returning 404 to user: Instance b95a3195-d4f9-4039-a3d7-cda7198aed9e could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5a11df0-4725-49a1-9d53-91d7fafb1f33 tempest-ServersNegativeTestJSON-2120905934 tempest-ServersNegativeTestJSON-2120905934-project] 10.222.0.27 "GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e" status: 404 len: 111 microversion: 2.1 time: 0.036211 Oct 19 01:58:53.438068 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3458/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:58:53 2022] GET /compute/v2.1/servers/b95a3195-d4f9-4039-a3d7-cda7198aed9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:59:26.494595 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.495894 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=13 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.666765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-40544d80-d38b-45f3-966e-30c3e4383f0b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: .version_select at 0x7f2aefb1f9d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1618296695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkIektp+nd9Kmiqug++YHH92j4XaHKS0PfSobSxpDXpkNmfVMMTsx4q3pr4eqlu/XRUBldxllBbwho9Ajdqnr4wtJcYY8Dh+HiNISXk9fERodwdpwQnaWC21V3W56pVZQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:59:26.684921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-40544d80-d38b-45f3-966e-30c3e4383f0b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:59:26.691099 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-40544d80-d38b-45f3-966e-30c3e4383f0b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:59:26.717409 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-40544d80-d38b-45f3-966e-30c3e4383f0b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.227993 Oct 19 01:59:26.718032 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3575/7033] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 01:59:26 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:26.774827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-658231376", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1618296695", "networks": [{"uuid": "9c6eafae-2f05-4dc2-90d2-268807994760"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:59:26.785323 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.786318 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=26 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:26.838180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] validate_networks() for [('9c6eafae-2f05-4dc2-90d2-268807994760', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 01:59:27.249444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 01:59:27.249882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 01:59:27.250393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 01:59:27.250840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 01:59:27.251207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 01:59:27.270681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:27.270681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:27.270681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:27.271150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:27.271822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:27.272468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:27.310195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 01:59:27.316196 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 01:59:27.330970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 01:59:27.333439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 01:59:27.388196 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b7bcaadf-7055-4484-a37d-2e8ebed7cc88 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617482 Oct 19 01:59:27.389287 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3459/7034] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 01:59:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 01:59:27.402782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a9ca7514-3431-404e-967d-96644d319cc4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:27.403476 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a9ca7514-3431-404e-967d-96644d319cc4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:27.476090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a9ca7514-3431-404e-967d-96644d319cc4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:27.483728 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a9ca7514-3431-404e-967d-96644d319cc4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1262 microversion: 2.1 time: 0.085368 Oct 19 01:59:27.484412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3576/7035] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:27 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:28.508058 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:28.509293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:28.519577 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:28.520087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:28.520541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:28.521295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:28.521954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:28.522850 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:28.599329 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:28.608264 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9915cde-8515-4004-977c-fc868261051c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1314 microversion: 2.1 time: 0.104149 Oct 19 01:59:28.609023 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3460/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:28 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:29.632974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:29.633608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:29.642853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:29.643362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:29.643817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:29.644541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:29.645037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:29.645485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:29.887552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:29.897592 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-34e3e084-66a8-498f-baba-98a24c2b9f7d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.268564 Oct 19 01:59:29.898581 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3577/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:29 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:30.648392 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9630ecfc-152c-4ce5-932b-065676d033e3", "tag": "1013d1c1-fbff-4d8c-adef-e9d720096de6"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:59:30.663516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:30.664002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:30.664658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:30.680102 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] Creating event network-changed:1013d1c1-fbff-4d8c-adef-e9d720096de6 for instance 9630ecfc-152c-4ce5-932b-065676d033e3 on n-h1-master-1 Oct 19 01:59:30.686695 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-3e62f89b-f72d-4723-88e9-e5083772d891 req-008fc52b-a2bc-4f8f-aa7a-4368802d09cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042192 Oct 19 01:59:30.687309 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3461/7038] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:30.922721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:30.923772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:30.930890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:30.931683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:30.932362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:30.933153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:30.933979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:30.934437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:31.150740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:31.159778 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2aca97b-b660-4345-9287-108b24a7ed8c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.241756 Oct 19 01:59:31.160658 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3578/7039] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:30 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:32.184601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:32.185587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:32.192700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:32.193196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:32.193646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:32.194345 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:32.194809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:32.195247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:32.415848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:32.427286 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c1835fb4-464a-4502-819b-540475be94ce tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.247095 Oct 19 01:59:32.427983 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3462/7040] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:32 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:33.451583 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:33.452244 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:33.458874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:33.459374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:33.459826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:33.460536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:33.461038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:33.461482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:33.594995 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:33.602736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bbad0583-2556-432e-b06d-6f22bc3092d2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.155900 Oct 19 01:59:33.603310 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3579/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:33 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:34.627045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:34.627698 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:34.634332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:34.634825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:34.635276 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:34.635986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:34.636453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:34.636940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:34.776885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:34.786158 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-396505e5-e5e8-49d7-80a2-a947e9a9675e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.163212 Oct 19 01:59:34.786750 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3463/7042] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:34 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:34.956249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9630ecfc-152c-4ce5-932b-065676d033e3", "name": "network-vif-plugged", "status": "completed", "tag": "1013d1c1-fbff-4d8c-adef-e9d720096de6"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:59:34.966764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:34.967359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:34.967937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:34.979506 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] Creating event network-vif-plugged:1013d1c1-fbff-4d8c-adef-e9d720096de6 for instance 9630ecfc-152c-4ce5-932b-065676d033e3 on n-h1-master-1 Oct 19 01:59:34.985259 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-d843c28a-493f-447d-b3c9-a6bbf69cf910 req-e1d2e565-02e3-44d4-916e-15acddc8b4f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112229 Oct 19 01:59:34.986045 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3580/7043] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 01:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:35.809987 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:35.811034 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:35.817957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:35.818449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:35.818898 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:35.819603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:35.820068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:35.820509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:35.954557 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:35.962248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8c4a2f1e-5dba-4cf9-88cc-20f6eaf471be tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1362 microversion: 2.1 time: 0.156891 Oct 19 01:59:35.962825 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3464/7044] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:35 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:36.987754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:36.988466 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:36.994707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:36.995138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:36.995602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:36.996283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:36.997462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:36.998000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:37.129486 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:37.137239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6b98bdce-c65f-46bd-b462-3e8afedaa9a8 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1554 microversion: 2.1 time: 0.154819 Oct 19 01:59:37.137863 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3581/7045] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:36 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:37.160137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:37.160785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:37.167595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:37.168091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:37.168534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:37.169843 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:37.170307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:37.170741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:37.293214 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:37.299025 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:37.307043 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-71cf1314-c169-45dc-b934-9f16a5305d69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1554 microversion: 2.1 time: 0.150815 Oct 19 01:59:37.307619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3465/7046] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:37 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 01:59:38.930833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c8bdc03-e29c-4c5c-8bdf-66491823e7d2"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 01:59:38.933753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:38.936717 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:38.943485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:38.943995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:38.944560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:38.945651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:38.946326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:38.946963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:39.223094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c3b6bcf-c0f6-4818-ba4f-bac693b06bcc tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296190 Oct 19 01:59:39.223764 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3582/7047] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 01:59:38 2022] POST /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:49.939583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:49.940106 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:49.942230 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:49.943570 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:49.944387 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:49.954614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:49.955114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:49.955568 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:49.956280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:49.956780 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:49.957218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:50.039284 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lazy-loading 'services' on Instance uuid 9630ecfc-152c-4ce5-932b-065676d033e3 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 01:59:50.115827 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ea6e183d-a518-4a94-9596-0383c3752b95 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments/9c8bdc03-e29c-4c5c-8bdf-66491823e7d2" status: 202 len: 0 microversion: 2.1 time: 0.180883 Oct 19 01:59:50.116452 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3466/7048] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:59:49 2022] DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments/9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 01:59:50.124442 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:50.125805 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 01:59:50.130474 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:50.132884 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:50.141387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:50.141904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:50.142368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:50.143092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:50.143568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:50.144016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:50.175947 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-54457536-4a4a-472e-ac86-c25af56ee65a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054726 Oct 19 01:59:50.176538 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3583/7049] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:50 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:51.190918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:51.193475 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:51.199823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:51.200810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:51.201275 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:51.201987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:51.202451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:51.202888 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:51.235445 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e53a860-2872-494b-a32f-d61905ada0ca tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050568 Oct 19 01:59:51.236033 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3467/7050] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:51 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:52.249410 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:52.251825 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:52.259036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:52.259549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:52.260005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:52.260767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:52.261251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:52.261735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:52.296798 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7c1ee2d2-f459-4ba4-ab49-44babdefa12d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052440 Oct 19 01:59:52.297387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3584/7051] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:52 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 01:59:53.309021 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:53.311583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:53.318393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:53.318875 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:53.319341 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:53.320034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:53.320493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:53.320944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:53.352517 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-35649629-148f-40ce-9fd8-e37a22422720 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Oct 19 01:59:53.353162 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3468/7052] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:53 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:54.364458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:54.366690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:54.373781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:54.374289 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:54.374754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:54.375553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:54.376029 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:54.376477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:54.407632 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5e76e348-6117-4832-ab4a-15300c17ecdf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047154 Oct 19 01:59:54.412294 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3585/7053] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:54 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 01:59:55.420567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:55.422808 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:55.431737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:55.432223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:55.432697 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:55.433426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:55.433915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:55.434393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:55.464506 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0bd9951b-8bab-4361-932e-5de41b2ba445 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048503 Oct 19 01:59:55.465112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3469/7054] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 01:59:55 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 01:59:55.476218 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:55.476771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:55.484335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:55.484863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:55.485328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:55.486041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:55.486514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:55.486960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:55.562760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 is not attached to volume 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments/9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 HTTP/1.1 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 is not attached to volume 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': '9630ecfc-152c-4ce5-932b-065676d033e3', 'id': '9c8bdc03-e29c-4c5c-8bdf-66491823e7d2'} Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2. Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 is not attached to volume 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 01:59:55.573506 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 is not attached to volume 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 is not attached to volume 9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3ccce59b-96fd-4f43-9db1-54b84c2238e2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments/9c8bdc03-e29c-4c5c-8bdf-66491823e7d2" status: 404 len: 154 microversion: 2.1 time: 0.102775 Oct 19 01:59:55.579183 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3586/7055] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 01:59:55 2022] DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3/os-volume_attachments/9c8bdc03-e29c-4c5c-8bdf-66491823e7d2 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 01:59:58.923759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:58.924363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:58.932259 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:58.932795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:58.933245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:58.933964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:58.934458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:58.935474 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:58.962953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 01:59:59.052393 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8faf676f-602f-42a2-99a4-02469ab20707 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 204 len: 0 microversion: 2.1 time: 0.134036 Oct 19 01:59:59.053630 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3470/7056] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 01:59:58 2022] DELETE /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 01:59:59.062955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 01:59:59.063611 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 01:59:59.071747 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:59.072260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:59.072749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:59.073480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 01:59:59.073954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 01:59:59.074405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 01:59:59.215153 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 01:59:59.223836 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9e8ac381-8b2e-493c-b2df-91adb35750e9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1560 microversion: 2.1 time: 0.165785 Oct 19 01:59:59.224460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3587/7057] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 01:59:59 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:00.248215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:00.249029 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:00.255956 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:00.256444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:00.256933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:00.257639 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:00.258106 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:00.258546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:00.393960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:00.401740 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f1d85ae-bfcc-4219-b02a-e79b79ef5614 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1560 microversion: 2.1 time: 0.157834 Oct 19 02:00:00.402322 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3471/7058] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:00 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:01.426725 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:01.427691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:01.435907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:01.436509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:01.437055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:01.437859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:01.438416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:01.438866 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:01.715339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:01.724353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f4c6ad92-54a9-47da-ae50-5311589a1c1b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 200 len: 1560 microversion: 2.1 time: 0.301525 Oct 19 02:00:01.737356 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3588/7059] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:01 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 1560 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:01.801541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9630ecfc-152c-4ce5-932b-065676d033e3", "name": "network-vif-deleted", "tag": "1013d1c1-fbff-4d8c-adef-e9d720096de6"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:01.812409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:01.812545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:01.813020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:01.824545 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] Creating event network-vif-deleted:1013d1c1-fbff-4d8c-adef-e9d720096de6 for instance 9630ecfc-152c-4ce5-932b-065676d033e3 on n-h1-master-1 Oct 19 02:00:01.830479 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f83ce2ab-aed8-4d74-808a-c74b7458475d req-0cbb50c8-89ce-4318-89c6-0eebb9afffcf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121173 Oct 19 02:00:01.831443 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3472/7060] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:02.749485 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:02.750148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 9630ecfc-152c-4ce5-932b-065676d033e3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:02.756969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:02.757473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:02.757929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:02.758643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:02.759116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:02.759564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:02.776649 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 HTTP/1.1 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '9630ecfc-152c-4ce5-932b-065676d033e3'} Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:02.778236 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 9630ecfc-152c-4ce5-932b-065676d033e3 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1efd917-e0ba-4630-bbb1-c8f1457c89a6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3" status: 404 len: 111 microversion: 2.1 time: 0.034849 Oct 19 02:00:02.783338 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3589/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:02 2022] GET /compute/v2.1/servers/9630ecfc-152c-4ce5-932b-065676d033e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:00:02.790087 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9134554f-dce4-4922-bcba-46ba132a0a05 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '.version_select at 0x7f2af4629280>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:02.815139 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9134554f-dce4-4922-bcba-46ba132a0a05 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1618296695" status: 202 len: 0 microversion: 2.1 time: 0.030227 Oct 19 02:00:02.815887 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3473/7062] 10.222.0.27 () {58 vars in 1278 bytes} [Wed Oct 19 02:00:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1618296695 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:00:02.832692 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-00094cf1-5efd-483c-be44-516e642ab705 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: .version_select at 0x7f2af42718b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-917479809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkA+YiKd3I7AaJX0Ri7NzoRRcP6+PpwszA4jIe0OOJlcGu6MX4kiY4/p2KFTSG6qE56Lp34RjytOT2UYiBK3t6D/WKdp+JR4+YySMrxDMj/t2lw7PAw0V7o3TOpg0a9sQ=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:02.848035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-00094cf1-5efd-483c-be44-516e642ab705 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:00:02.853417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-00094cf1-5efd-483c-be44-516e642ab705 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:00:02.878285 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-00094cf1-5efd-483c-be44-516e642ab705 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049586 Oct 19 02:00:02.878894 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3590/7063] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:00:02 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:02.929307 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1161880026", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-917479809", "networks": [{"uuid": "9c6eafae-2f05-4dc2-90d2-268807994760"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:02.983657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] validate_networks() for [('9c6eafae-2f05-4dc2-90d2-268807994760', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:00:03.359080 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:00:03.359518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:00:03.360007 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:00:03.360430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:00:03.360955 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:00:03.369749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:03.370246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:03.370699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:03.371445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:03.371996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:03.372442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:03.389913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:00:03.395287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:00:03.408108 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:00:03.410600 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:00:03.458155 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f67adfe-9876-41ee-a4cc-206b99eda3d3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532820 Oct 19 02:00:03.458811 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3474/7064] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:00:03.470547 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b785b516-4a8b-4f2e-937d-792ce3357895 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:03.471177 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b785b516-4a8b-4f2e-937d-792ce3357895 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:03.527234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b785b516-4a8b-4f2e-937d-792ce3357895 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:03.536217 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b785b516-4a8b-4f2e-937d-792ce3357895 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1262 microversion: 2.1 time: 0.069556 Oct 19 02:00:03.537263 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3591/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:03 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:04.562364 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:04.562938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:04.569893 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:04.570380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:04.570825 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:04.571528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:04.571983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:04.572411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:04.637098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:04.645412 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ef003652-95a7-4ce0-8e57-7a3f7e9ef759 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1314 microversion: 2.1 time: 0.088931 Oct 19 02:00:04.646039 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3475/7066] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:04 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:05.670254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:05.670873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:05.677492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:05.677997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:05.678457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:05.679180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:05.679657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:05.680114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:05.911514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:05.919881 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-892ad281-3897-451f-98e8-d971ff18bb4b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.253969 Oct 19 02:00:05.920468 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3592/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:05 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:00:06.137496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4194bcd0-830e-4c84-bf75-4fa329c8a848", "tag": "6bcf76da-fe57-477a-a91c-8de3c198a765"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:06.148546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:06.149158 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:06.149679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:06.162713 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] Creating event network-changed:6bcf76da-fe57-477a-a91c-8de3c198a765 for instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 on n-h1-master-1 Oct 19 02:00:06.167883 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-be9ae216-cbc5-4084-a1ac-31fb641372ed req-cc3ca353-e6f5-41af-bc6a-f0b6a80d2bdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034397 Oct 19 02:00:06.169152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3476/7068] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:00:06.944709 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:06.945339 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:06.952184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:06.952704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:06.953154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:06.953864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:06.954326 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:06.954759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:07.085277 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:07.093746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5379ffe0-24ee-45c4-a330-647e28bfd7c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.152930 Oct 19 02:00:07.094334 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3593/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:06 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:08.119119 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:08.119828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:08.126606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:08.127079 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:08.127523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:08.128222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:08.128771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:08.129208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:08.264802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:08.273025 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-66283ac9-391f-48a1-90cd-1629a9c14143 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.159033 Oct 19 02:00:08.273610 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3477/7070] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:08 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:09.297091 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:09.297723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:09.304649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:09.305200 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:09.305653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:09.306357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:09.306820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:09.307257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:09.439761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:09.447497 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9243c0c2-c259-4d04-8266-f76817ea03b3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.154930 Oct 19 02:00:09.448086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3594/7071] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:09 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:10.470592 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:10.471215 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:10.478588 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:10.479090 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:10.479543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:10.480250 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:10.481386 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:10.481828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:10.614330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:10.622771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6a6355f1-a325-4d94-8b7e-4edd7ba425b5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.156166 Oct 19 02:00:10.623349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3478/7072] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:10 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:11.076643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4194bcd0-830e-4c84-bf75-4fa329c8a848", "name": "network-vif-plugged", "status": "completed", "tag": "6bcf76da-fe57-477a-a91c-8de3c198a765"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:11.091711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:11.091711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:11.091711 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:11.100577 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] Creating event network-vif-plugged:6bcf76da-fe57-477a-a91c-8de3c198a765 for instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 on n-h1-master-1 Oct 19 02:00:11.105631 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-aa55f3b0-87e6-4046-ace9-04a216ffa07c req-4dadffd6-c0e9-46f1-b5cd-502f8f450fb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033404 Oct 19 02:00:11.106718 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3595/7073] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:11.646086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:11.646694 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:11.653831 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:11.654325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:11.654770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:11.655490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:11.655942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:11.656371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:11.793861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:11.801618 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-73517f7e-2e4a-4c10-89f4-c8482396d5c5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1362 microversion: 2.1 time: 0.159566 Oct 19 02:00:11.802225 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3479/7074] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:11 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:12.827761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:12.828400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:12.834664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:12.835160 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:12.835616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:12.836321 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:12.836824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:12.837266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:12.966460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:12.974259 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0aa80b19-dde6-4550-bdff-0bdca4df0669 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1553 microversion: 2.1 time: 0.152734 Oct 19 02:00:12.974843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3596/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:12 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:12.997829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:12.998453 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:13.005302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:13.005783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:13.006245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:13.006949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:13.007417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:13.007857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:13.136896 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:13.144583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-496f997a-d15b-4b02-b4a7-b3bf941ed16d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1553 microversion: 2.1 time: 0.151467 Oct 19 02:00:13.145195 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3480/7076] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:12 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:14.635417 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff99a236-43be-4b96-b001-dc59642c421c"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:14.637789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:14.639766 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:14.645705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:14.646197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:14.646643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:14.647341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:14.647800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:14.648229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:14.913825 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c885aa4e-f3ab-486c-b4f4-9292698dd926 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282201 Oct 19 02:00:14.914498 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3597/7077] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 02:00:14 2022] POST /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:25.631386 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:25.631878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:25.633887 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.634576 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.636148 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.637277 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.644342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:25.644881 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:25.645332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:25.646044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:25.646540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:25.646985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:25.730846 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lazy-loading 'services' on Instance uuid 4194bcd0-830e-4c84-bf75-4fa329c8a848 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:00:25.801369 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e69dfb88-2377-4094-a494-ff3e541ad8c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments/ff99a236-43be-4b96-b001-dc59642c421c" status: 202 len: 0 microversion: 2.1 time: 0.173688 Oct 19 02:00:25.802179 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3481/7078] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:00:25 2022] DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments/ff99a236-43be-4b96-b001-dc59642c421c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:00:25.812012 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:25.814425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:25.818593 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.819411 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:25.824925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:25.825433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:25.825890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:25.826612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:25.827082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:25.827526 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:25.859855 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f3e3fc2d-bb95-42ad-ae30-de8660219824 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052953 Oct 19 02:00:25.860438 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3598/7079] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:25 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:26.873722 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:26.876170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:26.883393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:26.883919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:26.884369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:26.885103 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:26.885570 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:26.886010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:26.918398 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-800aeac7-b610-4360-9249-46dea7ce6e8b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049489 Oct 19 02:00:26.919185 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3482/7080] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:26 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:27.931171 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:27.933933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:27.941533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:27.942043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:27.942504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:27.943233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:27.943709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:27.944156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:27.980782 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4409d585-ef7b-40e4-882f-df8169eccccf tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053526 Oct 19 02:00:27.981500 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3599/7081] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:27 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:28.993759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:28.997049 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:29.003917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:29.004408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:29.004890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:29.005601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:29.006064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:29.006500 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:29.038214 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fc8090fc-9275-4de4-b803-dfe7b8f047b9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048392 Oct 19 02:00:29.038927 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3483/7082] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:28 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:30.051197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:30.053475 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:30.061325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:30.061827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:30.062281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:30.062994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:30.063467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:30.063908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:30.096895 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6c14568d-3f27-499c-bc85-c51130bf7873 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049622 Oct 19 02:00:30.097603 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3600/7083] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:30 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:31.109493 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:31.111735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:31.118866 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:31.119360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:31.119820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:31.120526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:31.121029 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:31.121638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:31.150704 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-870bfbe8-51ca-40dc-ae1b-2bec5dcc9eb2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046007 Oct 19 02:00:31.151273 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3484/7084] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:00:31 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 02:00:31.162779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:31.163296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:31.171651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:31.172152 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:31.172610 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:31.173362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:31.173835 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:31.174283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:31.248500 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 is not attached to volume ff99a236-43be-4b96-b001-dc59642c421c Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments/ff99a236-43be-4b96-b001-dc59642c421c HTTP/1.1 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 is not attached to volume ff99a236-43be-4b96-b001-dc59642c421c Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': '4194bcd0-830e-4c84-bf75-4fa329c8a848', 'id': 'ff99a236-43be-4b96-b001-dc59642c421c'} Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff99a236-43be-4b96-b001-dc59642c421c. Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 is not attached to volume ff99a236-43be-4b96-b001-dc59642c421c Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:31.250220 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 is not attached to volume ff99a236-43be-4b96-b001-dc59642c421c Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 is not attached to volume ff99a236-43be-4b96-b001-dc59642c421c {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b37b39e1-bc23-4792-a88c-b171b5a1c6d5 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments/ff99a236-43be-4b96-b001-dc59642c421c" status: 404 len: 154 microversion: 2.1 time: 0.093062 Oct 19 02:00:31.255616 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3601/7085] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:00:31 2022] DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848/os-volume_attachments/ff99a236-43be-4b96-b001-dc59642c421c => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:00:34.603750 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:34.604336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:34.612315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:34.612933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:34.613477 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:34.614265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:34.614802 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:34.615308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:34.645073 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:00:34.726729 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f75d8ea9-b9bc-4c91-8121-aaee039fea92 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 204 len: 0 microversion: 2.1 time: 0.126812 Oct 19 02:00:34.731759 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3485/7086] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:00:34 2022] DELETE /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:00:34.736444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:34.737106 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:34.743288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:34.743781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:34.744230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:34.744978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:34.745446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:34.746014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:34.883042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:34.892348 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-27f2d357-c2d6-4d16-9d81-6af10903979f tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1559 microversion: 2.1 time: 0.159830 Oct 19 02:00:34.892990 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3602/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:34 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:35.918457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:35.919188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:35.926111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:35.926597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:35.927043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:35.927742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:35.928203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:35.928666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:36.060661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:36.068442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d62b1e76-9070-4965-a263-1798078f504b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1559 microversion: 2.1 time: 0.155169 Oct 19 02:00:36.069060 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3486/7088] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:35 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:37.091908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:37.092557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:37.100227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:37.100783 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:37.101246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:37.102015 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:37.102492 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:37.102943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:37.294448 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:37.302253 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5582abbe-ead7-481a-ae29-c202641b0038 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 200 len: 1559 microversion: 2.1 time: 0.214569 Oct 19 02:00:37.302845 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3603/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:37 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:37.438978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4194bcd0-830e-4c84-bf75-4fa329c8a848", "name": "network-vif-deleted", "tag": "6bcf76da-fe57-477a-a91c-8de3c198a765"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:37.458951 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:37.459442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:37.459880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:37.474371 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] Creating event network-vif-deleted:6bcf76da-fe57-477a-a91c-8de3c198a765 for instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 on n-h1-master-1 Oct 19 02:00:37.481789 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ca226ddf-c31d-4e08-b928-2de0d135c4e5 req-a759140e-75e0-4599-ba02-bde5124cb4af service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046793 Oct 19 02:00:37.482534 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3487/7090] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:38.327678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:38.328246 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 4194bcd0-830e-4c84-bf75-4fa329c8a848] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:38.335179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:38.335682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:38.336141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:38.336892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:38.337371 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:38.337817 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:38.351736 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 HTTP/1.1 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '4194bcd0-830e-4c84-bf75-4fa329c8a848'} Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:38.353290 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 4194bcd0-830e-4c84-bf75-4fa329c8a848 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e8a27dda-6498-4ecf-9b73-6f46a8486402 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848" status: 404 len: 111 microversion: 2.1 time: 0.031890 Oct 19 02:00:38.358256 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3604/7091] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:38 2022] GET /compute/v2.1/servers/4194bcd0-830e-4c84-bf75-4fa329c8a848 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:00:38.364464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-da62ce32-75e3-4f39-ab60-b0ba85cf0b7a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '.version_select at 0x7f2af4d39dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:38.384761 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-da62ce32-75e3-4f39-ab60-b0ba85cf0b7a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-917479809" status: 202 len: 0 microversion: 2.1 time: 0.024589 Oct 19 02:00:38.385342 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3488/7092] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 02:00:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-917479809 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:00:38.403321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b2105a9-d4b3-4632-8f83-a9b4b114e5f2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: .version_select at 0x7f2aefbec5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-370511428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbM8Ce0bIJGWXlh42n8AApiNl9kdCmUaWUkL3nRaqCzflVX8y4XQmzvyGTBdxpMesG3SpaqWYrkE0Qo5jm/TmJeSfQ9ab/OqtEYqlkN+SGLMiHNaeZzmCwLVmjWcehWug=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:38.424761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0b2105a9-d4b3-4632-8f83-a9b4b114e5f2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:00:38.430105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-0b2105a9-d4b3-4632-8f83-a9b4b114e5f2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:00:38.456533 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b2105a9-d4b3-4632-8f83-a9b4b114e5f2 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.057173 Oct 19 02:00:38.457162 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3605/7093] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:00:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:38.507457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1104097105", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-370511428", "networks": [{"uuid": "9c6eafae-2f05-4dc2-90d2-268807994760"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:38.561068 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] validate_networks() for [('9c6eafae-2f05-4dc2-90d2-268807994760', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:00:38.932101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:00:38.932540 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:00:38.933060 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:00:38.933507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:00:38.933973 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:00:38.944075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:38.944569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:38.945054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:38.945799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:38.946268 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:38.946708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:38.963755 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:00:38.969373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Getting quotas for user d12ec1f0259e4b3787efc086ce6721ac and project 5e3f24038436423db470356123e5e0e5. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:00:38.982075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:00:38.984543 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:00:39.031376 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d33c2766-51ac-464a-b09a-ea8b51f56058 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528396 Oct 19 02:00:39.032037 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3489/7094] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:00:39.043311 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4fe17546-4522-4586-af45-f6d6a82cc3d4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:39.044444 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4fe17546-4522-4586-af45-f6d6a82cc3d4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:39.100954 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4fe17546-4522-4586-af45-f6d6a82cc3d4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:39.111073 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4fe17546-4522-4586-af45-f6d6a82cc3d4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1262 microversion: 2.1 time: 0.071580 Oct 19 02:00:39.112731 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3606/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:39 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:40.135374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:40.135974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:40.144868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:40.145356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:40.145794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:40.146495 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:40.146952 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:40.147405 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:40.211377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:40.220164 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ccaaa265-ac6f-45f8-9b2b-2b12b726e898 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1314 microversion: 2.1 time: 0.088715 Oct 19 02:00:40.220795 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3490/7096] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:40 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:41.244710 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:41.245222 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:41.251815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:41.252373 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:41.252877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:41.253604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:41.254270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:41.254852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:41.457761 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:41.465557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1ac3a5af-2199-4d3d-9a22-db680c86a82c tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.225956 Oct 19 02:00:41.466519 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3607/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:41 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:41.804353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2115e89f-2ea9-4893-b115-a5ec7db39933", "tag": "f049bdfc-81b1-40f9-aac4-1b702df689ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:41.815936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:41.816417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:41.817082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:41.829723 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] Creating event network-changed:f049bdfc-81b1-40f9-aac4-1b702df689ca for instance 2115e89f-2ea9-4893-b115-a5ec7db39933 on n-h1-master-1 Oct 19 02:00:41.834875 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-d7275823-0e5c-4516-a2d8-43973c2ff26a req-a29c9433-d4f6-4228-b79f-eba8fed2a582 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034356 Oct 19 02:00:41.835520 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3491/7098] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:42.489237 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:42.489870 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:42.497266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:42.497774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:42.498231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:42.498964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:42.499419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:42.499864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:42.635054 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:42.643795 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8dbe542b-26ed-4f39-9c0b-1ed2ef922739 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.158533 Oct 19 02:00:42.644378 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3608/7099] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:42 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:43.669568 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:43.670414 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:43.676944 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:43.677181 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:43.677813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:43.678532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:43.678987 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:43.679619 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:43.885367 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:43.893761 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e5ed963d-765a-4a37-b2c3-f4db8cac7106 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.230109 Oct 19 02:00:43.894347 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3492/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:43 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:44.917586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:44.918345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:44.925617 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:44.926126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:44.926582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:44.927307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:44.927778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:44.928221 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:45.062567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:45.070325 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-623f23eb-8ba6-4e83-895d-a0b735dfa6a9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.157002 Oct 19 02:00:45.070901 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3609/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:44 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:46.095140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:46.095764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:46.102886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:46.103378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:46.103830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:46.104546 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:46.105050 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:46.105493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:46.241885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:46.250058 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2d81fe0-4f8a-440c-b018-47af0f19f1d6 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.159571 Oct 19 02:00:46.250656 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3493/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:46 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:47.243102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2115e89f-2ea9-4893-b115-a5ec7db39933", "name": "network-vif-plugged", "status": "completed", "tag": "f049bdfc-81b1-40f9-aac4-1b702df689ca"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:47.254530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:47.255025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:47.255473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:47.266534 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] Creating event network-vif-plugged:f049bdfc-81b1-40f9-aac4-1b702df689ca for instance 2115e89f-2ea9-4893-b115-a5ec7db39933 on n-h1-master-1 Oct 19 02:00:47.271467 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-27df1ed9-aac0-43b6-a9a1-87b64d744fae req-650b2890-2ac9-4cf3-9fe3-2d860dccbfe8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Oct 19 02:00:47.272199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3610/7103] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:00:47.274115 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:47.275624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:47.282718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:47.283215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:47.283661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:47.284372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:47.284870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:47.285308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:47.426799 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:47.435779 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1f05a813-6fe5-457c-b40e-2be4a501e01d tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.165521 Oct 19 02:00:47.436377 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3494/7104] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:47 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:48.461085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:48.461917 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:48.468286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:48.468904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:48.469367 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:48.470086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:48.470561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:48.471011 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:48.613292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:48.620982 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dae0d725-d31d-4066-b987-19296c239a97 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1362 microversion: 2.1 time: 0.165319 Oct 19 02:00:48.622311 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3611/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:48 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:49.645498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:49.646051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:49.648867 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:49.649629 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:49.656083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:49.656573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:49.657047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:49.657747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:49.658217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:49.658652 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:49.793310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:49.801096 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-53c6979a-33b5-432c-b8c0-4f89eaa85f58 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1553 microversion: 2.1 time: 0.159621 Oct 19 02:00:49.801679 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3495/7106] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:49 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:49.824334 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:00:49.825608 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:49.828241 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:49.835158 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:49.835662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:49.836121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:49.836877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:49.837356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:49.838509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:49.972093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:00:49.980136 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6061c453-948d-4989-b1d5-a87003637ba9 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1553 microversion: 2.1 time: 0.159729 Oct 19 02:00:49.980792 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3612/7107] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:00:49 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:00:51.478047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8a0c40d-2a16-4a42-98f6-a2917115d198"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:00:51.480558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:00:51.488065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:51.488554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:51.489030 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:51.489734 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:00:51.490192 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:00:51.490628 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:00:51.740147 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:00:51.751859 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4535b6ba-d1f3-4721-b031-28ae2f15fc3b tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "POST /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277839 Oct 19 02:00:51.752474 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3496/7108] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 02:00:51 2022] POST /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:02.477968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:02.478491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:02.481729 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:02.482524 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=70 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:02.489242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:02.489754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:02.490211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:02.490934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:02.491405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:02.491851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:02.576977 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lazy-loading 'services' on Instance uuid 2115e89f-2ea9-4893-b115-a5ec7db39933 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:01:02.649512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-518ce8b8-9464-4a80-8e9b-66dac69eba69 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments/b8a0c40d-2a16-4a42-98f6-a2917115d198" status: 202 len: 0 microversion: 2.1 time: 0.175028 Oct 19 02:01:02.650333 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3613/7109] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:01:02 2022] DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments/b8a0c40d-2a16-4a42-98f6-a2917115d198 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:01:02.660484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:02.663649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:02.669066 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:02.675082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:02.675579 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:02.676024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:02.676766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:02.677233 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:02.677670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:02.718234 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b50d93a0-6bfa-41dd-ad86-9cf6dcea4cc1 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062483 Oct 19 02:01:02.718820 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3497/7110] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:02 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:03.732004 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:03.734427 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:03.741253 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:03.741755 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:03.742212 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:03.742958 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:03.743437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:03.743882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:03.775096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-898fd32f-d4ca-4b44-b8ef-ef24cbe26bea tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047758 Oct 19 02:01:03.775997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3614/7111] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:03 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:04.789157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:04.791331 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:04.798920 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:04.799413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:04.799900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:04.800647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:04.801114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:04.801545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:04.833929 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3afbbc2-d831-4dad-b169-d81eb235e983 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Oct 19 02:01:04.834573 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3498/7112] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:04 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:05.846472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:05.848553 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:05.855332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:05.856466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:05.857024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:05.857725 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:05.858191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:05.858630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:05.888724 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d19ca737-ab96-4d31-a093-66ffedc4d0c3 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046266 Oct 19 02:01:05.889301 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3615/7113] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:05 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:06.900585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:06.903316 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:06.910183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:06.910674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:06.911121 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:06.911832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:06.912291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:06.912758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:06.946316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-12311505-2d00-4f79-afe3-7fc54d9a7d32 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049675 Oct 19 02:01:06.946896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3499/7114] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:06 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:07.958907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:07.961138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:07.969117 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:07.969634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:07.970127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:07.970855 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:07.971330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:07.971781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:08.001784 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5cfb2b5a-0048-44c6-a3a7-bcefd5d6b4d0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046955 Oct 19 02:01:08.002348 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3616/7115] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:01:07 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 02:01:08.013844 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:08.014335 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:08.021112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:08.021601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:08.022041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:08.022731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:08.023188 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:08.023616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:08.099620 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 is not attached to volume b8a0c40d-2a16-4a42-98f6-a2917115d198 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: request: DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments/b8a0c40d-2a16-4a42-98f6-a2917115d198 HTTP/1.1 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 is not attached to volume b8a0c40d-2a16-4a42-98f6-a2917115d198 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: action_args: {'server_id': '2115e89f-2ea9-4893-b115-a5ec7db39933', 'id': 'b8a0c40d-2a16-4a42-98f6-a2917115d198'} Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b8a0c40d-2a16-4a42-98f6-a2917115d198. Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 is not attached to volume b8a0c40d-2a16-4a42-98f6-a2917115d198 Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:01:08.101619 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 is not attached to volume b8a0c40d-2a16-4a42-98f6-a2917115d198 Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 is not attached to volume b8a0c40d-2a16-4a42-98f6-a2917115d198 {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d61c71f-1601-4eb0-b3cf-325d9233d257 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments/b8a0c40d-2a16-4a42-98f6-a2917115d198" status: 404 len: 154 microversion: 2.1 time: 0.094015 Oct 19 02:01:08.106387 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3500/7116] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:01:08 2022] DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933/os-volume_attachments/b8a0c40d-2a16-4a42-98f6-a2917115d198 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:01:11.452512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:11.453148 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:11.459848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:11.460357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:11.461060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:11.461806 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:11.462292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:11.462742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:11.488403 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:01:11.570504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-43b024af-40f9-4a71-83af-0b736db5ec62 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 204 len: 0 microversion: 2.1 time: 0.122277 Oct 19 02:01:11.571212 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3617/7117] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:01:11 2022] DELETE /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:01:11.581432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:11.582664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:11.590708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:11.591202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:11.591656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:11.592370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:11.592876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:11.593318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:11.731748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:11.740164 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d86d4227-9d9d-496e-a54d-4a22c533a4f4 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1559 microversion: 2.1 time: 0.163100 Oct 19 02:01:11.740918 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3501/7118] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:11 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:12.766225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:12.766865 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:12.773878 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:12.774294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:12.774800 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:12.775648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:12.776169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:12.776683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:12.906079 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:12.913885 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1d186894-eb50-49dc-88af-945e83bae9c0 tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1559 microversion: 2.1 time: 0.152869 Oct 19 02:01:12.914467 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3618/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:12 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:13.901357 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2115e89f-2ea9-4893-b115-a5ec7db39933", "name": "network-vif-deleted", "tag": "f049bdfc-81b1-40f9-aac4-1b702df689ca"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:01:13.912647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:13.913142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:13.913590 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:13.926059 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] Creating event network-vif-deleted:f049bdfc-81b1-40f9-aac4-1b702df689ca for instance 2115e89f-2ea9-4893-b115-a5ec7db39933 on n-h1-master-1 Oct 19 02:01:13.938328 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-92058910-6e70-48de-abbc-fbd91dc28ab8 req-2f951201-21e4-4ab4-b6fd-48eb68690278 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040692 Oct 19 02:01:13.938588 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:13.939293 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3502/7120] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:13.939949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:13.947460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:13.947974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:13.948434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:13.949359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:13.949864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:13.950325 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:14.024435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd12ec1f0259e4b3787efc086ce6721ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e3f24038436423db470356123e5e0e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:14.033920 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-527062d9-9360-434b-9e01-3c91e215e81a tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 200 len: 1347 microversion: 2.1 time: 0.100448 Oct 19 02:01:14.034896 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3619/7121] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:13 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 1347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:15.061926 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:15.062784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] [instance: 2115e89f-2ea9-4893-b115-a5ec7db39933] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:15.069081 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:15.069571 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:15.070104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:15.070863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:15.071328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:15.071767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:15.085298 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] HTTP exception thrown: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Request method failure captured: Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 HTTP/1.1 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1n5ZqKk9jeGDfZOzLeXMbdx5g7HIIZxBvIWbPE6nnhWZ_wWcTANyFOLPllODj-E3sCGHoH9sCUbeXlzqOIdtxSf6W3j0YwYx33LPeghEeliGJKuzjBfd4KN1NczU79xLr_nZaNG5b4OCeRFRVDuOc6AvO8g3nuTC-iVQRkfDYTCZe0 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5e3f24038436423db470356123e5e0e5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5e3f24038436423db470356123e5e0e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5e3f24038436423db470356123e5e0e5"}]}] Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 5e3f24038436423db470356123e5e0e5 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1907841591 Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: d12ec1f0259e4b3787efc086ce6721ac Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestEncryptedCinderVolumes-1907841591-project Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '2115e89f-2ea9-4893-b115-a5ec7db39933'} Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:15.086962 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Returning 404 to user: Instance 2115e89f-2ea9-4893-b115-a5ec7db39933 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7bb6e079-528b-4273-a507-66386652b58e tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933" status: 404 len: 111 microversion: 2.1 time: 0.032799 Oct 19 02:01:15.092613 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3503/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:15 2022] GET /compute/v2.1/servers/2115e89f-2ea9-4893-b115-a5ec7db39933 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:01:15.097497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57efc601-ca55-436d-85f0-fec2345400af tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] Calling method '.version_select at 0x7f2aefc4c1f0>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:15.117416 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57efc601-ca55-436d-85f0-fec2345400af tempest-TestEncryptedCinderVolumes-1907841591 tempest-TestEncryptedCinderVolumes-1907841591-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-370511428" status: 202 len: 0 microversion: 2.1 time: 0.023781 Oct 19 02:01:15.118016 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3620/7123] 10.222.0.27 () {58 vars in 1275 bytes} [Wed Oct 19 02:01:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-370511428 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:01:42.265675 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-93005ed4-daf7-4cac-992d-92f5553a401c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: .version_select at 0x7f2af4e17d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1019456263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqTc06lJQtLiUaGCLsTwRrOUDbr451plonyZxU0DteHzmPnLKcgYiG+fFIvc1as5YGtiAeJsjSlLOv3ju78gCPnCVDrcEz2tOqi/3XQehPpNzQcCCYumReHHHAmfqwI/w=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:01:42.271516 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=14 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:42.272186 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:42.284321 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-93005ed4-daf7-4cac-992d-92f5553a401c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for project adc2ee3a031b400d90c14e8b06caa191. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:01:42.289627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-93005ed4-daf7-4cac-992d-92f5553a401c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for user 145362d3a96243b28db39a61a49c9292 and project adc2ee3a031b400d90c14e8b06caa191. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:01:42.312930 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-93005ed4-daf7-4cac-992d-92f5553a401c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051795 Oct 19 02:01:42.313787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3504/7124] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:01:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:42.364214 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:42.365109 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:42.369499 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1640072716", "imageRef": "935e0b7f-7793-4401-b946-f48e95ef4363", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1019456263", "networks": [{"uuid": "9a3ffbfa-0b0b-418f-95dc-a53114e06fc4"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:01:42.425372 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] validate_networks() for [('9a3ffbfa-0b0b-418f-95dc-a53114e06fc4', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:01:42.911295 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:01:42.911739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:01:42.912235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:01:42.912695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:01:42.913131 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:01:42.921849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:42.922349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:42.922805 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:42.923548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:42.924025 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:42.924494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:42.942837 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for project adc2ee3a031b400d90c14e8b06caa191. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:01:42.950154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for user 145362d3a96243b28db39a61a49c9292 and project adc2ee3a031b400d90c14e8b06caa191. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:01:42.962359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:01:42.964657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='935e0b7f-7793-4401-b946-f48e95ef4363',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:01:43.008489 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:01:44.016996 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [c3fa7f26-ec4c-4aaf-8731-fd3c1e704c58] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41904. Oct 19 02:01:44.021346 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d9fef23b-4a3e-4a36-8e63-78c0f81a96e4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659271 Oct 19 02:01:44.022005 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3621/7125] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:01:44.035293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b81167ac-f5da-4d17-8c85-aa53830dd9d3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:44.036878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b81167ac-f5da-4d17-8c85-aa53830dd9d3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:44.111897 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b81167ac-f5da-4d17-8c85-aa53830dd9d3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:44.119072 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b81167ac-f5da-4d17-8c85-aa53830dd9d3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1259 microversion: 2.1 time: 0.088955 Oct 19 02:01:44.119665 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3505/7126] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:44 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1259 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:01:45.143992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:45.144566 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:45.151442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:45.151938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:45.152385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:45.153153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:45.153859 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:45.154299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:45.217273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:45.225403 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-06b01141-2c0d-468d-b35f-285927505195 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1311 microversion: 2.1 time: 0.086227 Oct 19 02:01:45.225987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3622/7127] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:45 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:46.253685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:46.256131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:46.268356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:46.269216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:46.269903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:46.270887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:46.271805 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:46.272520 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:46.470130 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:46.478693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-81d7c92a-30dd-4d04-a189-e0d14c3953f4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.232774 Oct 19 02:01:46.479880 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3506/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:46 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:47.506958 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:47.507586 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:47.515271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:47.516055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:47.516707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:47.517603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:47.518385 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:47.518818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:47.666136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:47.675094 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3dc3a361-e907-4038-b6a7-560c5f72e956 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.172086 Oct 19 02:01:47.678546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3623/7129] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:47 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:48.701650 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:48.702421 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:48.710270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:48.710778 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:48.711359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:48.712122 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:48.712589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:48.713318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:48.867464 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:48.876646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4dd05214-ed26-49e6-a7a7-8127fd05b35c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.179266 Oct 19 02:01:48.877255 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3507/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:48 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:49.902111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:49.902922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:49.910306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:49.910815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:49.911273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:49.912040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:49.912514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:49.912997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:50.069840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:50.078594 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0d0491c-45bf-445a-a7cd-b46c00a49ac1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.181100 Oct 19 02:01:50.079387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3624/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:49 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:51.102490 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:51.103188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:51.110527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:51.111002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:51.111444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:51.112155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:51.112638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:51.113070 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:51.260149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:51.270018 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c0c0329-390e-40cb-afe9-ea4fff7710c4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.171338 Oct 19 02:01:51.274531 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3508/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:51 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:52.294526 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:52.295276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:52.302307 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:52.302749 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:52.303203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:52.303925 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:52.304403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:52.304881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:52.447003 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:52.455231 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9c96e3d7-c0dc-493a-87db-f02faa1e1718 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.165679 Oct 19 02:01:52.461563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3625/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:52 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:53.479500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:53.480229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:53.487924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:53.488414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:53.488894 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:53.489604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:53.490053 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:53.490476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:53.719113 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:53.726886 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d6bcfc8-a74f-495a-b2ea-62f16fcc47c1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.252184 Oct 19 02:01:53.727486 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3509/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:53 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:54.522221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:01:54.527555 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:54.528357 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:54.535753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:54.536304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:54.536796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:54.549246 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] Creating event network-changed:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:01:54.554324 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-64c09854-0ea6-464f-a5f1-3444314c793c req-77679d4e-894b-4a92-9ceb-95a431f4045e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035932 Oct 19 02:01:54.554950 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3626/7135] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:01:54.751949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:54.752573 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:54.754536 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:01:54.760968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:54.761463 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:54.761911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:54.763145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:54.763614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:54.764065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:54.976125 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:54.984654 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d38fbc6e-11be-4a25-9d1c-b9d64487ea2a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.237789 Oct 19 02:01:54.985467 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3510/7136] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:54 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:56.008597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:56.009348 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:56.015956 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:56.016457 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:56.016939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:56.017651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:56.018121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:56.018567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:56.186316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:56.194450 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c5a48de-e38c-4224-864a-7c893342893c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.190931 Oct 19 02:01:56.195036 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3627/7137] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:56 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:57.218024 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:57.218585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:57.225333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:57.225819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:57.226270 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:57.226962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:57.227420 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:57.227851 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:57.359440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:57.367204 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ca487660-d42c-40f1-b36e-77b606c35e83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.153350 Oct 19 02:01:57.367834 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3511/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:57 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:58.391234 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:58.391872 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:58.398778 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:58.399284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:58.399744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:58.400458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:58.400955 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:58.401404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:58.530759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:58.538410 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a6c60f8e-c1b6-477a-b918-9ab938bb7368 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.151750 Oct 19 02:01:58.538990 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3628/7139] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:58 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:01:59.562395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:01:59.563020 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:01:59.569827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:59.570325 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:59.570775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:59.571471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:01:59.571922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:01:59.572356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:01:59.706371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:01:59.714150 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d193ce0c-0b70-405e-8856-fb8e5ffdbf1f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.156476 Oct 19 02:01:59.714743 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3512/7140] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:01:59 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:00.738018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:00.738648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:00.745517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:00.746013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:00.746462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:00.748248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:00.748756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:00.749201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:00.881660 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:00.889707 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ab2ce387-d084-4c37-b1c7-70a88991ba49 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.155633 Oct 19 02:02:00.890293 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3629/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:00 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:01.564542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "name": "network-vif-plugged", "status": "completed", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:02:01.576297 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:01.576859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:01.577309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:01.588548 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] Creating event network-vif-plugged:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:02:01.594243 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-037a294c-0b32-420b-8a71-1144dadf1cec req-1aea5baf-0120-4182-bc49-f9eae557a2dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035145 Oct 19 02:02:01.595225 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3513/7142] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:02:01.913683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:01.914325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:01.921938 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:01.922442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:01.922900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:01.923619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:01.924094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:01.924543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:02.055900 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:02.064068 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0d86fd3c-57cd-4f42-ad72-e19a16d5b6b8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.154332 Oct 19 02:02:02.064672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3630/7143] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:01 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:03.089133 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:03.089858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:03.096673 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:03.097239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:03.097712 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:03.098413 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:03.098874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:03.099313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:03.239208 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:03.247051 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8fe420ad-e10a-43e7-bfe4-af2b22cb3ca7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1359 microversion: 2.1 time: 0.163149 Oct 19 02:02:03.247724 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3514/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:03 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:04.270523 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:04.271155 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:04.278007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.278503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.278961 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.279676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.280163 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.280592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.413752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:04.422052 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e039ed02-a488-4e03-abcc-1e9201cdd91a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1549 microversion: 2.1 time: 0.155522 Oct 19 02:02:04.422643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3631/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:04 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:04.445359 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:04.445975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:04.452889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.453375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.453820 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.454511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.454968 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.455402 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.586858 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:04.595522 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7f278005-8fe1-485b-b493-7d76543cd4de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1549 microversion: 2.1 time: 0.154034 Oct 19 02:02:04.596106 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3515/7146] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:04 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:04.618693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:04.623953 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:04.624775 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Searching by: {'deleted': False, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 02:02:04.630286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.630779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.631227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.631965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.632432 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.632903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.657514 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 02:02:04.685358 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0523426d-b452-4bb0-8951-bd87314317fb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070071 Oct 19 02:02:04.685947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3632/7147] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 02:02:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:02:04.697991 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:04.698617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:04.705130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.705617 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.706145 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.706759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:04.707219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:04.707651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:04.836933 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:04.845699 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ebd24d4-a8af-40d6-9a55-30dc77d66890 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1549 microversion: 2.1 time: 0.151544 Oct 19 02:02:04.846285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3516/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:04 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:06.394019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2954c40c-349d-4980-a9b8-45121cc45e5d"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:02:06.396489 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:06.403284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:06.404779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:06.405242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:06.405962 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:06.406434 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:06.406877 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:06.669540 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8cbe8fbc-fb7c-46b1-bc61-6a2b88c5b957 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279053 Oct 19 02:02:06.670236 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3633/7149] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 02:02:06 2022] POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:02:19.705819 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:19.706435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:19.709566 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:19.710290 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=62 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:19.716526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:19.717039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:19.717483 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:19.718175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:19.718631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:19.719059 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:19.851200 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:19.859518 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d30f23a2-c212-4a91-a689-139aef6e7a01 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1595 microversion: 2.1 time: 0.157673 Oct 19 02:02:19.860112 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3517/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:19 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1595 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:02:21.528681 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:02:21.537273 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:21.538339 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:21.539303 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:02:21.546308 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:21.547005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:21.547646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:21.562605 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] Creating event network-changed:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:02:21.567879 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5ab76de0-4f66-417d-a838-c932be7093d8 req-8d98162a-6ab3-48f2-9aad-a193565829b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043858 Oct 19 02:02:21.568888 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3634/7151] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:02:22.561496 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-525860442"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:02:22.562310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:22.569462 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:22.569967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:22.570424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:22.571146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:22.571616 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:22.572058 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:22.712782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Adding security group f8e82a04-afd2-4aad-b31b-a79d9330c3c0 to port 0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b Oct 19 02:02:23.032422 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aa8c3efe-263b-4342-9050-9b96d4698237 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action" status: 202 len: 0 microversion: 2.1 time: 0.475486 Oct 19 02:02:23.033086 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3518/7152] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:02:22 2022] POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:02:23.040983 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:02:23.041561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:02:23.042158 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:02:23.048220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:23.048756 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:23.049195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:23.050189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:23.050640 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:23.051246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:23.069911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:02:23.071083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:02:23.071541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:02:23.093692 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] Creating event network-changed:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:02:23.107205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-8c1edbf1-d6b5-46ca-9759-cf655cc87ebb req-85f40a17-3443-4beb-bc75-12e98df935cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069802 Oct 19 02:02:23.107843 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3635/7153] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:02:23.306008 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:02:23.315433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb8a44e3-0d30-4b17-afc4-27b9d17125a9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1760 microversion: 2.1 time: 0.278085 Oct 19 02:02:23.324455 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3519/7154] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:02:23 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1760 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:04:04.087648 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:04:04.089427 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:04:04.089592 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action (ip 10.222.0.27) !!! Oct 19 02:04:04.097536 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:04:04.099858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:04:04.109996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:04.110506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:04.110960 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:04.111684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:04.112156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:04.112599 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:04.185028 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-32ccc5bd-edcd-4ba4-9037-9f014924bf5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action" status: 202 len: 0 microversion: 2.1 time: 0.099553 Oct 19 02:04:04.188928 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3636/7155] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:04:04 2022] POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:04:04.192258 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:04:04.193069 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:04:04.194057 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:04:04.194215 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd (ip 10.222.0.27) !!! Oct 19 02:04:04.197860 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:04:04.197999 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:04:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd (ip 10.222.0.27) !!! Oct 19 02:04:04.220954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:04:04.221678 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:04:04.228738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:04.229308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:04.229826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:04.230603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:04.232319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:04.232867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:04.561937 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:04:04.570698 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-95ab55d4-5c2f-45fd-8c84-81d65302ad99 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1762 microversion: 2.1 time: 0.380512 Oct 19 02:04:04.571285 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3520/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:04:04 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1762 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:04:05.597367 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:04:05.598090 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:04:05.604299 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:05.604842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:05.605302 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:05.606721 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:05.607196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:05.607639 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:05.818778 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:04:05.827694 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0dd1f514-07f2-40ce-87e5-376220a8933f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1767 microversion: 2.1 time: 0.235484 Oct 19 02:04:05.828301 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3637/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:04:05 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1767 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:04:06.852462 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:04:06.853086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:04:06.860714 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:06.861204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:06.861649 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:06.862339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:04:06.862793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:04:06.863223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:04:07.004167 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:04:07.012752 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b5f14c7-fbad-486e-82f5-cd3ae207bfd8 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1760 microversion: 2.1 time: 0.163880 Oct 19 02:04:07.013327 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3521/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:04:06 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:21.228273 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:21.229087 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:21.233727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-525860442"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:21.234287 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:21.241514 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:21.242019 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:21.242471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:21.243182 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:21.243655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:21.244101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:21.389765 n-d-master-1 devstack@n-api.service[131449]: INFO nova.network.security_group_api [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Removing security group f8e82a04-afd2-4aad-b31b-a79d9330c3c0 from port 0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b Oct 19 02:05:21.709396 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d4f8134-c821-43bc-894a-2b669422311d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action" status: 202 len: 0 microversion: 2.1 time: 0.481424 Oct 19 02:05:21.709396 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3638/7159] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:05:21 2022] POST /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:05:21.723513 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:21.724345 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:21.806036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:21.816061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:21.816560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:21.817037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:21.828722 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] Creating event network-changed:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:05:21.834399 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff1692ce-15f9-4822-9d1a-95d15a62c800 req-471d9718-b4ab-4db4-8c5c-a3da0009ea83 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121653 Oct 19 02:05:21.835187 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3522/7160] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:23.252783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:23.254366 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:23.260859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:23.261365 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:23.261821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:23.263129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:23.263537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:23.263981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:23.272788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:23.284256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:23.284870 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:23.285590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:23.297938 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] Creating event network-changed:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:05:23.303745 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-1e40be3a-9839-43b1-a613-161785bb60e9 req-b4c6d9df-3b33-4ca0-b85f-75d358c339cd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098612 Oct 19 02:05:23.304439 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3639/7161] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:23.352876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lazy-loading 'services' on Instance uuid 8b1418ce-0572-4bde-9191-5be8a3b113dd {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:05:23.430205 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ce8be4c5-2339-433f-9c6c-a1ca626bd03d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments/2954c40c-349d-4980-a9b8-45121cc45e5d" status: 202 len: 0 microversion: 2.1 time: 0.182452 Oct 19 02:05:23.435362 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3523/7162] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:05:23 2022] DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments/2954c40c-349d-4980-a9b8-45121cc45e5d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 02:05:23.441176 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:23.444062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:23.452288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:23.453113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:23.453562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:23.454504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:23.455133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:23.455731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:23.505066 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9924c7ac-f7a6-49b2-902f-99af2bd322f5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068848 Oct 19 02:05:23.505958 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3640/7163] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:23 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:24.519566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:24.521856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:24.530110 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:24.530601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:24.531048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:24.531754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:24.532217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:24.532681 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:24.564035 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-20f6abc2-544b-4391-a8c2-afdfc281c1b3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048897 Oct 19 02:05:24.564615 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3524/7164] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:24 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:25.577774 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:25.580345 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:25.586854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:25.587348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:25.587803 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:25.588509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:25.589000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:25.589442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:25.620102 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7a87c86d-8c4e-4cc6-affe-898b20610e1a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047067 Oct 19 02:05:25.620680 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3641/7165] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:25 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:26.632961 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:26.635152 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:26.642657 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:26.643143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:26.643592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:26.644295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:26.644776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:26.645206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:26.675444 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-dcb02e99-0731-4531-85d9-aab00ac8df4b tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 Oct 19 02:05:26.676012 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3525/7166] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:26 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:27.689044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:27.691253 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:27.698082 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:27.698579 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:27.699033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:27.699851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:27.700795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:27.701244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:27.730572 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5d6b7d8e-949b-4d51-828b-6cf604882de3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Oct 19 02:05:27.732090 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3642/7167] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:27 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:28.745349 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:28.747768 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:28.754671 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:28.755151 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:28.755603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:28.756311 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:28.756809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:28.757252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:28.786189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b9cbbffd-589a-41db-bc57-95aafe08fe5a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044906 Oct 19 02:05:28.786776 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3526/7168] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:05:28 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 02:05:28.798138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:28.798683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:28.805407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:28.805899 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:28.806346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:28.807051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:28.807515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:28.807951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:28.883042 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] HTTP exception thrown: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd is not attached to volume 2954c40c-349d-4980-a9b8-45121cc45e5d Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Request method failure captured: Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments/2954c40c-349d-4980-a9b8-45121cc45e5d HTTP/1.1 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1p3g731VXPK7ZoCvKtjSxK8S66eM4BeRE2zzmxuWfbnQosxFuYqQ_H9fful03gmnObEMHl0yBCRSqV9M-WNKp_eaUo4nhVHnUGoOoBEYq7HV14JgW7ZmhiCuaO2el65ghsumlXJfLjllzzY_vjyNk_KUzbf0dXJRd6hbJSqoBccohQ Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc2ee3a031b400d90c14e8b06caa191", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}] Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 145362d3a96243b28db39a61a49c9292 Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd is not attached to volume 2954c40c-349d-4980-a9b8-45121cc45e5d Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': '8b1418ce-0572-4bde-9191-5be8a3b113dd', 'id': '2954c40c-349d-4980-a9b8-45121cc45e5d'} Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2954c40c-349d-4980-a9b8-45121cc45e5d. Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd is not attached to volume 2954c40c-349d-4980-a9b8-45121cc45e5d Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:05:28.884668 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd is not attached to volume 2954c40c-349d-4980-a9b8-45121cc45e5d Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Returning 404 to user: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd is not attached to volume 2954c40c-349d-4980-a9b8-45121cc45e5d {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0f116e63-4649-4988-9663-d79ec11a4a9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments/2954c40c-349d-4980-a9b8-45121cc45e5d" status: 404 len: 154 microversion: 2.1 time: 0.092783 Oct 19 02:05:28.889904 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3643/7169] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:05:28 2022] DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd/os-volume_attachments/2954c40c-349d-4980-a9b8-45121cc45e5d => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:05:32.141679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:32.142183 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:32.149019 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:32.149504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:32.149946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:32.150637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:32.151094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:32.151552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:32.176647 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:05:32.259336 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-55a4e86b-e0e1-4fe2-bc2d-f44587126a97 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 204 len: 0 microversion: 2.1 time: 0.121289 Oct 19 02:05:32.260233 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3527/7170] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:05:32 2022] DELETE /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:05:32.269393 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:32.270015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:32.279360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:32.279868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:32.280334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:32.281128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:32.281597 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:32.282061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:32.417632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:32.428374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4cdde70f-591b-4e3a-824f-f8e469159acc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1555 microversion: 2.1 time: 0.163476 Oct 19 02:05:32.429196 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3644/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:32 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:33.455634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:33.456259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:33.462787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:33.463269 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:33.463711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:33.464406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:33.464890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:33.466114 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:33.599922 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:33.607628 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f46945e0-fe42-4327-8afe-9a477649e1f0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1555 microversion: 2.1 time: 0.156611 Oct 19 02:05:33.608208 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3528/7172] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:33 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:34.633252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:34.633891 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:34.641193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:34.641698 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:34.642156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:34.642874 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:34.643343 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:34.643784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:34.720086 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:34.727926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d51f804e-82a1-4e25-ac33-7f6d901e1f9a tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 200 len: 1513 microversion: 2.1 time: 0.098943 Oct 19 02:05:34.728494 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3645/7173] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:34 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:34.811375 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b1418ce-0572-4bde-9191-5be8a3b113dd", "name": "network-vif-deleted", "tag": "0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:34.821937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:34.822425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:34.822861 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:34.839504 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] Creating event network-vif-deleted:0ed4ec41-eb72-46e9-8d55-ddeb8b19c51b for instance 8b1418ce-0572-4bde-9191-5be8a3b113dd on n-h1-master-1 Oct 19 02:05:34.845091 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-944f1ff3-7705-416d-a6a5-003a45002c7c req-ebd82945-3118-4e8e-b746-8bf5931baac1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038587 Oct 19 02:05:34.845701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3529/7174] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:35.752001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:35.752634 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: 8b1418ce-0572-4bde-9191-5be8a3b113dd] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:35.759468 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:35.759969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:35.760428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:35.761174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:35.761650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:35.762130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:35.777281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] HTTP exception thrown: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Request method failure captured: Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd HTTP/1.1 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1p3g731VXPK7ZoCvKtjSxK8S66eM4BeRE2zzmxuWfbnQosxFuYqQ_H9fful03gmnObEMHl0yBCRSqV9M-WNKp_eaUo4nhVHnUGoOoBEYq7HV14JgW7ZmhiCuaO2el65ghsumlXJfLjllzzY_vjyNk_KUzbf0dXJRd6hbJSqoBccohQ Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc2ee3a031b400d90c14e8b06caa191", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}] Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 145362d3a96243b28db39a61a49c9292 Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8b1418ce-0572-4bde-9191-5be8a3b113dd'} Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:05:35.778933 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Returning 404 to user: Instance 8b1418ce-0572-4bde-9191-5be8a3b113dd could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-68217438-7f60-4bcb-9b27-06c661081adb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd" status: 404 len: 111 microversion: 2.1 time: 0.032364 Oct 19 02:05:35.783868 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3646/7175] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:35 2022] GET /compute/v2.1/servers/8b1418ce-0572-4bde-9191-5be8a3b113dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 19 02:05:35.789610 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a42681cd-304b-4cf2-b0c8-5ad2c4b75af6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '.version_select at 0x7f2af49dbb80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:35.814605 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a42681cd-304b-4cf2-b0c8-5ad2c4b75af6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1019456263" status: 202 len: 0 microversion: 2.1 time: 0.029007 Oct 19 02:05:35.815298 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3530/7176] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 02:05:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1019456263 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 02:05:45.204065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-17190b40-7dd2-411c-b2c2-8dce072e65a0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: .version_select at 0x7f2aefb8e8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1260549759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwtvcV4h9ZJ2l+i55mVkxlYdNeO2wwaOkpQZN602Yo/4cRzOX8gtJ5QX5KKm6MYNT/eowYs+0IaBuodg9vnNtK4rla3bNIM2fvnP1EGOyI+QjLzm6YDYMlQWhnvFH/ZHA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:45.221423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-17190b40-7dd2-411c-b2c2-8dce072e65a0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for project adc2ee3a031b400d90c14e8b06caa191. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:05:45.227453 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-17190b40-7dd2-411c-b2c2-8dce072e65a0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for user 145362d3a96243b28db39a61a49c9292 and project adc2ee3a031b400d90c14e8b06caa191. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:05:45.254428 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-17190b40-7dd2-411c-b2c2-8dce072e65a0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054823 Oct 19 02:05:45.254961 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3647/7177] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:05:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:05:45.303201 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:45.307758 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-324950984", "imageRef": "b50d4134-87b9-46ce-899e-c3338c5f8f3d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1260549759", "networks": [{"uuid": "9a3ffbfa-0b0b-418f-95dc-a53114e06fc4"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:05:45.362848 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] validate_networks() for [('9a3ffbfa-0b0b-418f-95dc-a53114e06fc4', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:05:45.833416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:05:45.833854 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:05:45.834378 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:05:45.834794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:05:45.835217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:05:45.844783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:45.845284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:45.845735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:45.846484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:45.846949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:45.847391 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:45.867574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for project adc2ee3a031b400d90c14e8b06caa191. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:05:45.873627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Getting quotas for user 145362d3a96243b28db39a61a49c9292 and project adc2ee3a031b400d90c14e8b06caa191. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:05:45.886527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:05:45.889074 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b50d4134-87b9-46ce-899e-c3338c5f8f3d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:05:45.942992 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-572d9a3b-5afd-44ec-a8a5-3f73ec97fb51 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642164 Oct 19 02:05:45.943655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3531/7178] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:05:45.954442 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=44 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:45.959370 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a748a106-5496-4acf-8226-faf8d7ed8ecb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:45.960545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a748a106-5496-4acf-8226-faf8d7ed8ecb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:46.022450 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a748a106-5496-4acf-8226-faf8d7ed8ecb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:46.030929 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a748a106-5496-4acf-8226-faf8d7ed8ecb tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1258 microversion: 2.1 time: 0.078556 Oct 19 02:05:46.031895 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3648/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:45 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:47.058330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4ed097e2-61f6-4c61-9452-a270366228cd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:47.059685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4ed097e2-61f6-4c61-9452-a270366228cd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:47.114693 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4ed097e2-61f6-4c61-9452-a270366228cd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:47.122469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4ed097e2-61f6-4c61-9452-a270366228cd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1258 microversion: 2.1 time: 0.068686 Oct 19 02:05:47.123053 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3532/7180] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:47 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:48.145062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8f5779aa-ae66-4655-a3cd-5dae0c322976 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:48.146341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8f5779aa-ae66-4655-a3cd-5dae0c322976 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:48.202644 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8f5779aa-ae66-4655-a3cd-5dae0c322976 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:48.211218 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8f5779aa-ae66-4655-a3cd-5dae0c322976 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1258 microversion: 2.1 time: 0.070367 Oct 19 02:05:48.211793 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3649/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:48 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:49.234882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f2fd2051-9a70-4196-9c1c-0e69f42d83c0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:49.235503 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f2fd2051-9a70-4196-9c1c-0e69f42d83c0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:49.293608 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f2fd2051-9a70-4196-9c1c-0e69f42d83c0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:49.300913 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f2fd2051-9a70-4196-9c1c-0e69f42d83c0 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1258 microversion: 2.1 time: 0.069969 Oct 19 02:05:49.301500 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3533/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:49 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:50.325779 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:50.326374 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:50.333259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:50.333754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:50.334205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:50.334908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:50.335376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:50.335815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:50.397390 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:50.405150 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-08d202d6-e1f5-4305-812c-096daf9f03fe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1262 microversion: 2.1 time: 0.084084 Oct 19 02:05:50.405720 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3650/7183] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:50 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:51.428526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:51.429188 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:51.436531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:51.437511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:51.437961 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:51.438928 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:51.439572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:51.440012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:51.535639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:51.548193 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-28507ed1-7b58-49af-ab0d-2d58ba11cf8d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1316 microversion: 2.1 time: 0.123146 Oct 19 02:05:51.549331 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3534/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:51 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:52.576770 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:52.578145 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:52.580969 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:52.586105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:52.586830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:52.587458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:52.588476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:52.589169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:52.589618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:52.731602 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:52.740509 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52267bc4-25f1-4be4-9342-91ab21401d46 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.171385 Oct 19 02:05:52.741187 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3651/7185] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:52 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:53.766398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:53.767197 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:53.770038 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:53.775994 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:53.776509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:53.777010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:53.778444 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:53.778924 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:53.779369 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:53.922358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:53.930431 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bcbbad2a-8000-4cef-8bd1-fd17623008ee tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.168719 Oct 19 02:05:53.932701 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3535/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:53 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:54.956333 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:54.956998 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:54.963478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:54.964012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:54.972103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:54.983440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:54.984475 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:54.985611 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:55.192715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:55.202294 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-57d79414-bd67-49ae-915f-2ff5f93ad041 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.250049 Oct 19 02:05:55.203076 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3652/7187] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:54 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:56.227847 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:56.228579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:56.235352 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:56.237166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:56.237667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:56.238117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:56.238840 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:56.239308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:56.239751 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:56.399300 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:56.408926 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-33182d06-53f4-4dc1-a0b3-d6eab930e615 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.185126 Oct 19 02:05:56.409528 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3536/7188] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:56 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:57.434446 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:57.435078 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:57.444317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:57.444883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:57.445349 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:57.446297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:57.446923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:57.447376 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:57.592507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:57.600758 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ee109abc-aa48-4183-b6fe-40a700884053 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.171439 Oct 19 02:05:57.601577 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3653/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:57 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:58.625910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:58.626712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:58.633732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:58.634224 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:58.634789 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:58.635517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:58.636091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:58.636903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:58.778248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:05:58.786502 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1003b6cd-192e-4edc-b8be-7f69a320ccbc tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.164799 Oct 19 02:05:58.787615 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3537/7190] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:58 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:05:59.814741 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:05:59.815659 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:05:59.817645 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:05:59.823966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:59.824467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:59.824949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:05:59.825697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:05:59.826197 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:05:59.826630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:00.048916 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:00.056896 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-81cdaa58-38dd-4600-874b-95e606e52c21 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.246355 Oct 19 02:06:00.057491 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3654/7191] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:05:59 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:00.427437 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:00.433416 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=10 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:00.442424 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:00.443119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:00.443735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:00.463111 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] Creating event network-changed:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:06:00.470238 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0535701a-c1e1-42fc-87c8-a76223df501e req-39802745-432b-43e5-9cb4-26c060c26450 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046769 Oct 19 02:06:00.471126 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3538/7192] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:06:01.081808 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:01.082409 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:01.089359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:01.090002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:01.090484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:01.091209 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:01.091686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:01.092138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:01.219695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:01.227460 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7ce27f49-21d7-4ddc-87b2-b538beaed513 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.149871 Oct 19 02:06:01.228039 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3655/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:01 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:02.253424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:02.254135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:02.260301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:02.260867 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:02.261343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:02.262137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:02.262601 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:02.263037 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:02.469708 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:02.477470 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c6d35f22-f970-4b08-99c9-9017fd3c57c7 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.229305 Oct 19 02:06:02.478056 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3539/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:02 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:03.502380 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:03.503007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:03.509552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:03.510047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:03.510498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:03.511717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:03.512191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:03.512758 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:03.644812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:03.653771 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7406acd5-1de6-49c1-b14f-e4dc0523c833 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.155447 Oct 19 02:06:03.654364 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3656/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:03 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:04.677336 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:04.677964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:04.684605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:04.685123 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:04.685572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:04.686290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:04.686761 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:04.687203 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:04.826916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:04.834601 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0e0b6ea4-7e37-40c7-8954-5756fc4058d1 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.161562 Oct 19 02:06:04.835131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3540/7196] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:04 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:05.858548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:05.859196 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:05.866096 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:05.866601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:05.867055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:05.867765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:05.868235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:05.868741 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:06.001490 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:06.009077 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-16e40418-b14c-4980-aa9c-86a753254d83 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.155495 Oct 19 02:06:06.009653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3657/7197] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:05 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:06.812712 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "name": "network-vif-plugged", "status": "completed", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:06.823242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:06.823832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:06.824921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:06.836125 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] Creating event network-vif-plugged:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:06:06.842097 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-1d4e2138-f9f8-4182-a9be-e8f22eb9d57a req-d8b0431e-150e-4acc-9c66-2df426f0d268 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090985 Oct 19 02:06:06.842697 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3541/7198] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:06:07.032981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:07.033719 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:07.040765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:07.041265 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:07.041718 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:07.047819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:07.047819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:07.047819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:07.176550 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:07.184377 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6e28521b-15b3-4629-b2c8-3d72c034566c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.155423 Oct 19 02:06:07.184993 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3658/7199] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:07 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:08.210136 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:08.210843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:08.218175 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:08.218664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:08.219112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:08.219841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:08.220302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:08.220767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:08.354083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:08.362953 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04417816-38e2-4070-b7d6-ef74c6cf8d19 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1358 microversion: 2.1 time: 0.157647 Oct 19 02:06:08.363758 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3542/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:08 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:09.388738 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:09.389376 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:09.396254 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.396831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.397288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.398000 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.398471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.398917 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.527632 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:09.535808 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aed48a66-a768-43e2-8b26-745817f4dd5f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1548 microversion: 2.1 time: 0.151762 Oct 19 02:06:09.536384 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3659/7201] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:09 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:09.558457 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:09.559091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:09.566258 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.566754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.567215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.567919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.568388 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.568858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.701099 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:09.710126 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2a68f5a8-0083-45f3-b59d-93df8abe9dd6 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1548 microversion: 2.1 time: 0.155699 Oct 19 02:06:09.710713 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3543/7202] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:09 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:09.733059 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:09.737905 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:09.738575 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Searching by: {'deleted': False, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191'} {{(pid=131449) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 19 02:06:09.743853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.744344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.745164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.745730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.746178 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.746697 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.770570 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.multi_cell_list [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131449) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 19 02:06:09.800643 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aa36f5b9-87e0-4f61-8165-7184149b75dd tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071853 Oct 19 02:06:09.801226 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3660/7203] 10.222.0.27 () {58 vars in 1125 bytes} [Wed Oct 19 02:06:09 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:06:09.814270 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:09.814895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:09.820919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.821408 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.821880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.822575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:09.823036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:09.823472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:09.952597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:09.960427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d1b323c-009e-4131-9c99-d4a338508f36 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1548 microversion: 2.1 time: 0.150429 Oct 19 02:06:09.961037 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3544/7204] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:09 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:06:11.470197 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10d43846-0263-4e45-af26-181b9dcc3350"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:11.472555 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:11.479478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:11.480010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:11.480470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:11.481216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:11.481689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:11.482134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:11.739067 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0bd9438c-b625-497c-bbe6-22f87d636b94 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272729 Oct 19 02:06:11.740138 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3661/7205] 10.222.0.27 () {60 vars in 1323 bytes} [Wed Oct 19 02:06:11 2022] POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:06:22.523741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:22.524398 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:22.528072 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=19 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:22.528769 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=60 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:22.534641 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:22.535137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:22.535583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:22.536293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:22.536791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:22.537225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:22.671541 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:22.679864 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fd3890b7-d00d-48f0-8e22-7e071059905e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1594 microversion: 2.1 time: 0.159974 Oct 19 02:06:22.680454 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3545/7206] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:22 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:24.277766 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:24.278760 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=21 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:24.279468 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:24.284269 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:24.296247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:24.296873 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:24.297412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:24.310914 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] Creating event network-changed:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:06:24.316335 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a9330c42-1e79-4081-9f82-30ed3725a829 req-b32f3f44-6271-45f6-93c3-96fc6398b549 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040706 Oct 19 02:06:24.317046 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3662/7207] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:06:25.718781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1872920199"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:25.719317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:25.726278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:25.726763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:25.727201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:25.727891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:25.728355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:25.728826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:25.866514 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Adding security group a55063cf-024f-4486-b6e3-16a0a3d7571f to port 52e648fa-2e8d-4001-a1c7-d7284815766e Oct 19 02:06:26.194455 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-349e1412-b7ec-4a2c-a06f-b271d836d4b4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action" status: 202 len: 0 microversion: 2.1 time: 0.479718 Oct 19 02:06:26.195143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3546/7208] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:06:25 2022] POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:06:26.205180 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:26.207033 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:26.207771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:26.216113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:26.216797 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:26.217283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:26.231439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:26.232014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:26.232327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] Creating event network-changed:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:06:26.232683 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:26.233431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:26.233959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:26.234405 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:26.238887 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9018b965-c5f1-447b-ae69-00cadefbe12c req-605eec07-42ef-42b6-8b40-03d8fa448be1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037616 Oct 19 02:06:26.239917 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3547/7209] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:06:26.501127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:26.510746 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d010fc8a-cb7b-4f99-b9c7-520c2f07cb69 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1759 microversion: 2.1 time: 0.309927 Oct 19 02:06:26.511764 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3663/7210] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:26 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1759 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:43.528033 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:43.528830 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:43.579242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:06:43.581661 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:43.587903 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:43.588742 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:43.588917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:43.589613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:43.590073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:43.590506 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:43.663509 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f71d6cc2-4383-4970-90cb-3f90d773b703 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action" status: 202 len: 0 microversion: 2.1 time: 0.137864 Oct 19 02:06:43.664143 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3548/7211] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:06:43 2022] POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:06:43.672935 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:43.673690 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:43.677498 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:43.678163 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=8 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:06:43.683035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:43.683648 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:43.684341 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:43.684857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:43.685328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:43.685771 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:43.918274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:43.926681 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-da3e48c7-3ee7-429c-acba-da23bbf4b15d tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1751 microversion: 2.1 time: 0.257677 Oct 19 02:06:43.927269 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3664/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:43 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:44.952917 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:44.953624 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:44.960031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:44.960527 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:44.961018 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:44.961747 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:44.962209 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:44.962643 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:45.110268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:45.118597 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b6d3b4e9-b291-4f49-9248-a3c9e1bb592e tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.170918 Oct 19 02:06:45.119176 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3549/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:44 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:46.141640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:46.142271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:46.149231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:46.149730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:46.150180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:46.151629 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:46.152103 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:46.152545 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:46.299961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:46.308874 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f09acc62-cf9c-4cf3-9092-d2860fd2fef3 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.171041 Oct 19 02:06:46.309391 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3665/7214] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:46 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:47.333603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:47.334236 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:47.341300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:47.341795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:47.342249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:47.342957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:47.343425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:47.343864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:47.489577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:47.498843 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f7d80c95-e377-49dd-817f-609b2eab8fbe tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.169167 Oct 19 02:06:47.499568 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3550/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:47 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:48.524557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:48.525373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:48.532972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:48.533482 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:48.533942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:48.534657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:48.535134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:48.535577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:48.684721 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:48.693407 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-761cc35c-7254-4d0b-8ed1-b0ebe474749c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.172782 Oct 19 02:06:48.693998 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3666/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:48 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:49.717993 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:49.718623 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:49.725636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:49.726131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:49.726583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:49.727288 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:49.727759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:49.728202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:49.869832 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:49.878167 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f6bcce43-1e15-4074-affa-a7c92f810bd5 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.164166 Oct 19 02:06:49.878747 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3551/7217] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:49 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:50.903386 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:50.904052 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:50.910868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:50.911372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:50.911836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:50.912543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:50.913046 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:50.913491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:51.059303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:51.068084 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4da8a11-5b04-4a6a-9ca7-72460f0f1da4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.169466 Oct 19 02:06:51.068685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3667/7218] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:50 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:52.092161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:52.092843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:52.100133 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:52.100645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:52.101111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:52.101827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:52.102468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:52.102917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:52.251502 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:52.259901 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0f6a97eb-c718-489d-81a6-d4d4d0cd4425 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.172290 Oct 19 02:06:52.260683 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3552/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:52 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:53.283842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:53.284479 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:53.292190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:53.292720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:53.293179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:53.293893 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:53.294366 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:53.294810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:53.433959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:53.442566 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-88ee8d73-5710-4f73-b47e-00d23c373507 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.162731 Oct 19 02:06:53.443156 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3668/7220] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:53 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:54.465649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:54.466275 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:54.473404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:54.473896 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:54.474353 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:54.475091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:54.475559 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:54.476001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:54.621497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:54.630022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4fb8a179-014e-4759-87ff-28d44c49714c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1756 microversion: 2.1 time: 0.168333 Oct 19 02:06:54.630619 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3553/7221] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:54 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:06:55.654183 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:06:55.654854 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:06:55.661773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:55.662272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:55.662733 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:55.663445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:06:55.663919 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:06:55.664364 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:06:55.807607 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:06:55.816098 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-61508bb6-8f5f-4d73-8019-54bc8fe8e67c tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1759 microversion: 2.1 time: 0.165981 Oct 19 02:06:55.816690 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3669/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:06:55 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:07:28.788542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1872920199"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:28.789214 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:28.792169 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=12 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:28.792863 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:28.799913 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:28.800399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:28.800884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:28.801581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:28.802061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:28.802531 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:28.930246 n-d-master-1 devstack@n-api.service[131450]: INFO nova.network.security_group_api [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Removing security group a55063cf-024f-4486-b6e3-16a0a3d7571f from port 52e648fa-2e8d-4001-a1c7-d7284815766e Oct 19 02:07:29.234332 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1cb27fab-9ebf-440c-9d41-12abf237a9df tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action" status: 202 len: 0 microversion: 2.1 time: 0.449911 Oct 19 02:07:29.235157 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3554/7223] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:07:28 2022] POST /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:07:29.245879 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:29.251632 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:29.252401 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:29.253615 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:07:29.253983 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 02:07:29.267857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:29.268448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:29.269012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:29.283539 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] Creating event network-changed:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:07:29.288948 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-58255b52-1f70-418e-8778-582863d262b8 req-a302db01-8a37-4ffe-83f3-deffb42d6452 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047782 Oct 19 02:07:29.289679 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3670/7224] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:30.301786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:30.302317 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:30.303753 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:30.309206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:30.309769 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:30.310281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:30.311056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:30.311743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:30.312176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:30.315940 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:30.316523 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:30.317279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:30.330246 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] Creating event network-changed:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:07:30.336168 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-dc0157ac-cfc3-4e82-aec1-705a28e11df1 req-64087080-5774-4811-868d-e338ecaef87e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036787 Oct 19 02:07:30.337653 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3671/7225] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:30.406578 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lazy-loading 'services' on Instance uuid fca62640-d7fa-4d61-bbe5-6c08ba1c5298 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:07:30.494412 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9fcdddc3-c5ab-4dd3-a6d1-544eece89b64 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments/10d43846-0263-4e45-af26-181b9dcc3350" status: 202 len: 0 microversion: 2.1 time: 0.197413 Oct 19 02:07:30.495336 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3555/7226] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:07:30 2022] DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments/10d43846-0263-4e45-af26-181b9dcc3350 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:07:30.504771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:30.507254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:30.519762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:30.520584 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:30.521234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:30.522156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:30.522633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:30.523241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:30.559574 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0e9c8e76-5508-418a-a653-54613f8c8a72 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059335 Oct 19 02:07:30.569918 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3672/7227] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:30 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:31.574535 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:31.577031 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:31.583370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:31.583889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:31.584333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:31.585061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:31.585523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:31.585955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:31.616327 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8efe971a-8624-44ce-96ad-4dbfc3fe7099 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Oct 19 02:07:31.616924 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3556/7228] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:31 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:32.629248 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:32.631445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:32.639188 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:32.639686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:32.640136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:32.640886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:32.641356 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:32.641797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:32.674210 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-58e15e11-bb48-4462-a228-2d95e1bc5fe4 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048981 Oct 19 02:07:32.674818 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3673/7229] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:32 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:33.687640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:33.690286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:33.697144 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:33.697715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:33.698243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:33.699027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:33.699587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:33.700105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:33.731771 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-76d03c94-98ac-4509-8d4b-5e5830d5f136 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048265 Oct 19 02:07:33.732275 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3557/7230] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:33 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:34.744220 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:34.746451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:34.753149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:34.753654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:34.754107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:34.754822 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:34.755290 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:34.755734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:34.787598 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cc7ab685-cfe3-48fc-9376-7b996cbe3278 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Oct 19 02:07:34.788093 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3674/7231] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:34 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:35.800337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:35.802667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:35.810295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:35.810791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:35.811239 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:35.811949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:35.812417 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:35.812880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:35.845788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee7c54ae-6686-4ef9-8beb-32f455ec4923 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049512 Oct 19 02:07:35.846349 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3558/7232] 10.222.0.27 () {58 vars in 1302 bytes} [Wed Oct 19 02:07:35 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 19 02:07:35.857826 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:35.858323 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:35.865166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:35.865657 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:35.866109 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:35.866809 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:35.867278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:35.867717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:35.942323 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] HTTP exception thrown: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 is not attached to volume 10d43846-0263-4e45-af26-181b9dcc3350 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Request method failure captured: Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: request: DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments/10d43846-0263-4e45-af26-181b9dcc3350 HTTP/1.1 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1p3g731VXPK7ZoCvKtjSxK8S66eM4BeRE2zzmxuWfbnQosxFuYqQ_H9fful03gmnObEMHl0yBCRSqV9M-WNKp_eaUo4nhVHnUGoOoBEYq7HV14JgW7ZmhiCuaO2el65ghsumlXJfLjllzzY_vjyNk_KUzbf0dXJRd6hbJSqoBccohQ Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc2ee3a031b400d90c14e8b06caa191", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}] Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 145362d3a96243b28db39a61a49c9292 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: exception: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 is not attached to volume 10d43846-0263-4e45-af26-181b9dcc3350 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: action_args: {'server_id': 'fca62640-d7fa-4d61-bbe5-6c08ba1c5298', 'id': '10d43846-0263-4e45-af26-181b9dcc3350'} Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 10d43846-0263-4e45-af26-181b9dcc3350. Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 is not attached to volume 10d43846-0263-4e45-af26-181b9dcc3350 Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:07:35.943938 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 is not attached to volume 10d43846-0263-4e45-af26-181b9dcc3350 Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Returning 404 to user: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 is not attached to volume 10d43846-0263-4e45-af26-181b9dcc3350 {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2b63f44-a195-4bba-b90d-83eec1706c9f tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments/10d43846-0263-4e45-af26-181b9dcc3350" status: 404 len: 154 microversion: 2.1 time: 0.091691 Oct 19 02:07:35.949844 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3675/7233] 10.222.0.27 () {58 vars in 1416 bytes} [Wed Oct 19 02:07:35 2022] DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298/os-volume_attachments/10d43846-0263-4e45-af26-181b9dcc3350 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:07:39.209528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:39.210033 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:39.216782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:39.217264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:39.217708 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:39.218398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:39.218853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:39.219282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:39.244298 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:07:39.330040 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ac263bd-b085-41e0-905f-f99542029f55 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 204 len: 0 microversion: 2.1 time: 0.124180 Oct 19 02:07:39.330863 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3559/7234] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:07:39 2022] DELETE /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:07:39.339799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:39.340435 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:39.347652 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:39.348155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:39.348613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:39.349350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:39.349824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:39.350271 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:39.484799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:07:39.492719 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39012b34-89f8-4658-bed5-4b6ac8be8b05 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1554 microversion: 2.1 time: 0.156945 Oct 19 02:07:39.493923 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3676/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:07:39 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:07:40.517308 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:40.518019 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:40.525468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:40.525964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:40.526412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:40.527135 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:40.527578 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:40.528016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:40.660063 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:07:40.668908 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-91c13195-d886-4dac-9ca4-b485438aa6de tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1554 microversion: 2.1 time: 0.155953 Oct 19 02:07:40.669517 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3560/7236] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:07:40 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:07:41.693762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:41.694396 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:41.701813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:41.702318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:41.702767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:41.703478 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:41.703943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:41.704381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:41.895866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145362d3a96243b28db39a61a49c9292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc2ee3a031b400d90c14e8b06caa191', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:07:41.904645 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ce46b65f-28a8-4068-924f-7ed40926ec95 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 200 len: 1554 microversion: 2.1 time: 0.214725 Oct 19 02:07:41.905254 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3677/7237] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:07:41 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:07:41.986482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca62640-d7fa-4d61-bbe5-6c08ba1c5298", "name": "network-vif-deleted", "tag": "52e648fa-2e8d-4001-a1c7-d7284815766e"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:41.997717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:41.998206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:41.998645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:42.010936 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] Creating event network-vif-deleted:52e648fa-2e8d-4001-a1c7-d7284815766e for instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 on n-h1-master-1 Oct 19 02:07:42.016272 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-69c4f550-8c24-4fcf-9e80-8d6d1e8bcc5a req-3c77056c-9149-43bb-8e14-c008500a8154 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033391 Oct 19 02:07:42.016933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3561/7238] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:42.927438 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:42.928074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] [instance: fca62640-d7fa-4d61-bbe5-6c08ba1c5298] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:42.935481 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:42.935979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:42.936431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:42.937174 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:42.937646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:42.938092 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:42.952311 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] HTTP exception thrown: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Request method failure captured: Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 HTTP/1.1 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1p3g731VXPK7ZoCvKtjSxK8S66eM4BeRE2zzmxuWfbnQosxFuYqQ_H9fful03gmnObEMHl0yBCRSqV9M-WNKp_eaUo4nhVHnUGoOoBEYq7HV14JgW7ZmhiCuaO2el65ghsumlXJfLjllzzY_vjyNk_KUzbf0dXJRd6hbJSqoBccohQ Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_adc2ee3a031b400d90c14e8b06caa191", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/adc2ee3a031b400d90c14e8b06caa191"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/adc2ee3a031b400d90c14e8b06caa191"}]}] Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: adc2ee3a031b400d90c14e8b06caa191 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1347066736 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 145362d3a96243b28db39a61a49c9292 Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestMinimumBasicScenario-1347066736-project Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: exception: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'fca62640-d7fa-4d61-bbe5-6c08ba1c5298'} Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:07:42.953868 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Returning 404 to user: Instance fca62640-d7fa-4d61-bbe5-6c08ba1c5298 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0161ef9c-0a00-4a93-bc07-13a1166c7ac9 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298" status: 404 len: 111 microversion: 2.1 time: 0.031810 Oct 19 02:07:42.958641 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3678/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:07:42 2022] GET /compute/v2.1/servers/fca62640-d7fa-4d61-bbe5-6c08ba1c5298 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:07:42.965057 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d34af743-2a16-4894-b077-20ab4d22da14 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] Calling method '.version_select at 0x7f2af4fafca0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:42.984968 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d34af743-2a16-4894-b077-20ab4d22da14 tempest-TestMinimumBasicScenario-1347066736 tempest-TestMinimumBasicScenario-1347066736-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1260549759" status: 202 len: 0 microversion: 2.1 time: 0.024114 Oct 19 02:07:42.985561 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3562/7240] 10.222.0.27 () {58 vars in 1272 bytes} [Wed Oct 19 02:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1260549759 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:07:52.495190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f78208f4-b6d9-47d4-9577-86b9ff9b7e68 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: .version_select at 0x7f2aefb62a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-269637297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpPY8K4Jl/bbvnTZAyT1YZx6mWlrCzHp3/6OH989KLT/xxJIqr++9y1si4lFWWgouaq9y8puV/JHaq8SvKm2oa1uHANNXBL9ybQuZtnEpTEwVxAHwZfMBMPF7RLtvk38w=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:52.511815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f78208f4-b6d9-47d4-9577-86b9ff9b7e68 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:07:52.517005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f78208f4-b6d9-47d4-9577-86b9ff9b7e68 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:07:52.543192 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f78208f4-b6d9-47d4-9577-86b9ff9b7e68 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.213505 Oct 19 02:07:52.543794 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3679/7241] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:07:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:07:58.457221 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:58.458076 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:58.462439 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1720130546", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "abe95b78-8316-487d-bdca-e015279b9619"}], "key_name": "tempest-TestNetworkAdvancedServerOps-269637297", "security_groups": [{"name": "tempest-secgroup-smoke-1657702556"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:07:58.595649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] validate_networks() for [('abe95b78-8316-487d-bdca-e015279b9619', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:07:59.038813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:07:59.039287 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:07:59.039784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:07:59.040213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:07:59.040814 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:07:59.052476 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:59.053002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:59.053451 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:59.054191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:07:59.054661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:07:59.055130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:07:59.072611 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:07:59.077895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:07:59.095882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:07:59.098406 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:07:59.155458 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-378f0cb7-eb4f-47ff-95df-bbfce7663ac4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700374 Oct 19 02:07:59.161125 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3563/7242] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:07:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:07:59.165509 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=42 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:07:59.173635 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a107990e-498f-43f3-bffc-99a7760daf16 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:07:59.175500 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a107990e-498f-43f3-bffc-99a7760daf16 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:07:59.244104 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a107990e-498f-43f3-bffc-99a7760daf16 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:07:59.253938 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a107990e-498f-43f3-bffc-99a7760daf16 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1266 microversion: 2.1 time: 0.089793 Oct 19 02:07:59.255169 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3680/7243] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:07:59 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:00.279598 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:00.280230 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:00.286785 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:00.287282 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:00.287733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:00.288447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:00.289119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:00.290646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:00.355806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:00.363755 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-627f7cd6-1da8-4bf2-be25-abaee4db6c3a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1318 microversion: 2.1 time: 0.089180 Oct 19 02:08:00.364339 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3564/7244] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:00 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:01.389756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:01.390939 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:01.396348 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:01.401460 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:01.401966 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:01.402420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:01.403143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:01.403609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:01.404047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:01.630639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:01.639241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4962b8d4-502e-4547-9d5e-0ddc3bb6f91b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.254621 Oct 19 02:08:01.639825 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3681/7245] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:01 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:02.253595 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18271c87-9e3d-496c-807c-d4cccb8368d7", "tag": "30e273f1-8388-4484-8fc7-670382c46b05"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:02.264557 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:02.265942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:02.266182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:02.279780 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] Creating event network-changed:30e273f1-8388-4484-8fc7-670382c46b05 for instance 18271c87-9e3d-496c-807c-d4cccb8368d7 on n-h1-master-1 Oct 19 02:08:02.285259 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-712bbe41-9bc8-4101-b2f8-459e180564c9 req-fb1cfdde-3af0-4613-b012-0a025a9d4b89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Oct 19 02:08:02.285884 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3565/7246] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:08:02.662839 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:02.663473 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:02.671005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:02.671505 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:02.671954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:02.672691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:02.673190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:02.673632 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:02.820595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:02.828508 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c00ecda-8402-45d3-b453-9ac749104070 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.169590 Oct 19 02:08:02.829136 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3682/7247] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:02 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:03.852856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:03.853590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:03.859696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:03.860180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:03.860637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:03.861338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:03.861795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:03.862228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:04.076974 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:04.085132 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1d05565d-ccd0-4159-a5ff-e9f70947bbc5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.237051 Oct 19 02:08:04.085992 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3566/7248] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:03 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:05.108382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:05.109260 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:05.115999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:05.116503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:05.116993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:05.117846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:05.118240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:05.118687 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:05.253491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:05.261726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b73650d6-f958-41a9-8843-b4c6d933d93d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.157417 Oct 19 02:08:05.262305 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3683/7249] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:05 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:06.285293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:06.285916 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:06.292865 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:06.293362 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:06.293817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:06.294515 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:06.294981 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:06.295419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:06.426779 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:06.435334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6c4a8306-e16d-4ca8-8197-0c115861e11b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.154019 Oct 19 02:08:06.435919 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3567/7250] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:06 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:07.458731 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:07.459369 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:07.467334 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:07.467852 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:07.468310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:07.469084 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:07.469557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:07.470006 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:07.609595 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:07.617848 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b4b2f79c-1043-4d32-9841-b72a536ac98e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.162506 Oct 19 02:08:07.618442 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3684/7251] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:07 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:07.643334 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18271c87-9e3d-496c-807c-d4cccb8368d7", "name": "network-vif-plugged", "status": "completed", "tag": "30e273f1-8388-4484-8fc7-670382c46b05"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:07.653955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:07.654447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:07.654889 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:07.666645 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] Creating event network-vif-plugged:30e273f1-8388-4484-8fc7-670382c46b05 for instance 18271c87-9e3d-496c-807c-d4cccb8368d7 on n-h1-master-1 Oct 19 02:08:07.671741 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-c425e4b3-2aa6-4d14-aa91-cf2348cf8833 req-0ea36b4f-84ac-4449-a711-0acf0a7bb9bb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032097 Oct 19 02:08:07.672523 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3568/7252] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:08:08.642271 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:08.642956 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:08.650528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:08.651030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:08.651488 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:08.652203 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:08.652705 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:08.653154 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:08.781671 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:08.789826 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-13e70440-36e1-42ca-ab54-e4109fac5040 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1392 microversion: 2.1 time: 0.150967 Oct 19 02:08:08.790411 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3685/7253] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:08 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:09.812232 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:09.813080 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:09.817740 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:09.818455 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:09.825659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:09.826150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:09.826599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:09.827300 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:09.827765 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:09.828204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:09.970605 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:09.978927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-18dd6898-10cb-4415-b11d-621b2579fb07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1565 microversion: 2.1 time: 0.169059 Oct 19 02:08:09.979508 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3569/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:09 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:08:10.001236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:10.001920 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:10.003831 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:10.009912 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:10.010414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:10.010880 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:10.011589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:10.012061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:10.012504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:10.146786 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:10.154706 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f18cd499-dd61-484e-a6a9-c8eb700d0e25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1565 microversion: 2.1 time: 0.157406 Oct 19 02:08:10.155284 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3686/7255] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:09 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:12.063515 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:12.064423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:12.067292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18271c87-9e3d-496c-807c-d4cccb8368d7", "tag": "30e273f1-8388-4484-8fc7-670382c46b05"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:12.072083 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:12.072854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:12.073375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:12.074370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:12.075069 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:12.075763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:12.078662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:12.079374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:12.079954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:12.096432 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] Creating event network-changed:30e273f1-8388-4484-8fc7-670382c46b05 for instance 18271c87-9e3d-496c-807c-d4cccb8368d7 on n-h1-master-1 Oct 19 02:08:12.102284 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b8d174da-07c0-4a26-bdb3-99e18f4614a1 req-a21be631-eef9-4dcf-b5d8-cda271fe3f82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039317 Oct 19 02:08:12.103459 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3687/7256] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:08:12.274460 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:12.283034 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e78ae7e-8508-4261-8f55-5b650164d2ca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1565 microversion: 2.1 time: 0.223505 Oct 19 02:08:12.283944 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3570/7257] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:12 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:37.566221 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=13 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:37.566986 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=38 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:37.571922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:37.574352 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:37.581439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:37.581939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:37.582394 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:37.583123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:37.583581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:37.584024 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:37.658400 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33d89cef-eaca-4a68-bf72-09866cc69681 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action" status: 200 len: 24565 microversion: 2.1 time: 0.094371 Oct 19 02:08:37.659057 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3688/7258] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:08:37 2022] POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action => generated 24565 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:08:48.457497 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:48.458053 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:48.460517 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:48.461370 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=36 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:48.468356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:48.468891 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:48.469528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:48.470758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:48.471240 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:48.471687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:48.552447 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4394b1a9-a774-4c3f-b20a-13928eefce5a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action" status: 202 len: 0 microversion: 2.1 time: 0.098725 Oct 19 02:08:48.553328 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3571/7259] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:08:48 2022] POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:08:48.563723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:48.565540 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:48.570374 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:48.571105 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:08:48.576159 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:48.576943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:48.577383 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:48.578249 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:48.578979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:48.579440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:48.733739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:48.743951 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36ceedb7-039f-41de-84a6-a03771a7e963 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1689 microversion: 2.1 time: 0.185445 Oct 19 02:08:48.744544 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3689/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:48 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:49.771446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:49.772160 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:49.778937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:49.779432 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:49.779882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:49.780595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:49.781087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:49.781525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:49.913356 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:49.921249 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1650f24e-872e-4cba-a2e5-34783dc5e360 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1669 microversion: 2.1 time: 0.155002 Oct 19 02:08:49.921837 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3572/7261] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:49 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:51.019425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:51.021604 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:51.029120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.029620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.030077 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.030789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.031274 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.031719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.121413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3cc6a59e-20af-4c77-aabf-704e7bc92c63 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action" status: 200 len: 32636 microversion: 2.1 time: 0.105868 Oct 19 02:08:51.122101 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3690/7262] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:08:51 2022] POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action => generated 32636 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:08:51.134656 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:51.135195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:51.142217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.142716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.143167 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.143873 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.144336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.144809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.217038 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e675970-958b-483a-aa69-978d07630e82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action" status: 202 len: 0 microversion: 2.1 time: 0.087010 Oct 19 02:08:51.217685 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3573/7263] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:08:51 2022] POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:08:51.227005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:51.227756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:51.234918 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.235416 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.235865 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.236582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:51.237112 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:51.237750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:51.375762 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:51.384851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21d49f2c-e5fc-4970-8ba9-716d697e1f64 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1676 microversion: 2.1 time: 0.162586 Oct 19 02:08:51.385660 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3691/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:51 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:52.410048 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:52.410763 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:52.418595 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:52.419088 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:52.419541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:52.420256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:52.420759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:52.421200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:52.557642 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:52.565638 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cde891b1-4364-403c-84bc-be30eda52efd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1684 microversion: 2.1 time: 0.159869 Oct 19 02:08:52.566223 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3574/7265] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:52 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:52.666085 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:52.668215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:52.675964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:52.676466 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:52.676952 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:52.677668 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:52.678141 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:52.678590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:52.744492 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-706374e7-4d7c-4fc7-94ac-e32d98041571 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action" status: 200 len: 38486 microversion: 2.1 time: 0.082882 Oct 19 02:08:52.745167 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3692/7266] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:08:52 2022] POST /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7/action => generated 38486 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:08:53.728203 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:53.728888 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:53.730016 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18271c87-9e3d-496c-807c-d4cccb8368d7", "tag": "30e273f1-8388-4484-8fc7-670382c46b05"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:53.735857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:53.736612 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:53.737290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:53.738007 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:53.738475 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:53.739027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:53.741267 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:53.741883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:53.742409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:53.753955 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] Creating event network-changed:30e273f1-8388-4484-8fc7-670382c46b05 for instance 18271c87-9e3d-496c-807c-d4cccb8368d7 on n-h1-master-1 Oct 19 02:08:53.759818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ff55ac47-71fc-41d1-9444-b82dac313bf6 req-0965cc64-45cb-4bfc-a28b-2569eea3e480 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034248 Oct 19 02:08:53.760518 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3693/7267] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:08:53.768416 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:08:53.860927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-286181bb-28cb-4d3e-b863-3210262f62a1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 204 len: 0 microversion: 2.1 time: 0.137781 Oct 19 02:08:53.865344 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3575/7268] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:08:53 2022] DELETE /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:08:53.871484 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:53.872849 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:53.879797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:53.880292 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:53.880987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:53.881703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:53.882703 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:53.883260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:54.019382 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:54.027924 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bf361466-5439-4e89-b59c-faba4494d648 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1690 microversion: 2.1 time: 0.160821 Oct 19 02:08:54.028508 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3694/7269] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:53 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:55.051945 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:55.052674 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:55.060010 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:55.060493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:55.061048 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:55.062026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:55.062650 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:55.063085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:55.201995 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:55.209988 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-60ce9bcd-6e46-45b8-b660-9199b5f47b61 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1690 microversion: 2.1 time: 0.162390 Oct 19 02:08:55.210840 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3576/7270] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:55 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:56.235362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:56.236084 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:56.244936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:56.245501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:56.246807 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:56.247937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:56.248479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:56.248990 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:56.476649 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:08:56.484884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2914235-74bf-42ee-8f59-3a0a9890ef9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 200 len: 1571 microversion: 2.1 time: 0.253819 Oct 19 02:08:56.485495 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3695/7271] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:56 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 1571 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:08:56.514121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18271c87-9e3d-496c-807c-d4cccb8368d7", "name": "network-vif-deleted", "tag": "30e273f1-8388-4484-8fc7-670382c46b05"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:08:56.526614 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:56.527111 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:56.527554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:56.540554 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] Creating event network-vif-deleted:30e273f1-8388-4484-8fc7-670382c46b05 for instance 18271c87-9e3d-496c-807c-d4cccb8368d7 on n-h1-master-1 Oct 19 02:08:56.546391 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-0a1484d0-2467-411f-9896-94578e6246bc req-3f38031b-0106-4568-9f8d-9630ecf234b2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035619 Oct 19 02:08:56.547266 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3577/7272] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:08:57.509208 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:08:57.509844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 18271c87-9e3d-496c-807c-d4cccb8368d7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:08:57.517090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:57.517594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:57.518054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:57.518804 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:08:57.519279 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:08:57.519726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:08:57.533196 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] HTTP exception thrown: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Request method failure captured: Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 HTTP/1.1 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1v3zbrHIvomC6-n6b2XRj89g0swbPF3WaWxEB5siOpkkxwOIBpVc-UYlwyh8DOji5CgNIiqwbcx-O4bHkWAh423kBLdJGvhW8rnaJDb7XlCe3m85AYM0oOqSOURx5ofAjBbabKXOPzVwKRNYJ52H5NW2Z6YNS0Z-ApFy7gJCbaFydU Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4030669e64c14c27af306c4582fc5ede", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}] Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02f03048cac8457e9a3a278df65f19f4 Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '18271c87-9e3d-496c-807c-d4cccb8368d7'} Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:08:57.534840 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Returning 404 to user: Instance 18271c87-9e3d-496c-807c-d4cccb8368d7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63a6eb5e-120d-47ba-8fb1-42c63df8db8b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7" status: 404 len: 111 microversion: 2.1 time: 0.031299 Oct 19 02:08:57.541000 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3696/7273] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:08:57 2022] GET /compute/v2.1/servers/18271c87-9e3d-496c-807c-d4cccb8368d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:09:01.197579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-eda483b5-9079-4f09-9ec1-7ed5ebace09e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '.version_select at 0x7f2af49dbb80>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:01.223010 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-eda483b5-9079-4f09-9ec1-7ed5ebace09e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-269637297" status: 202 len: 0 microversion: 2.1 time: 0.030196 Oct 19 02:09:01.230317 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3578/7274] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 02:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-269637297 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:09:01.253729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41f3ffb4-37c2-40a1-a0a8-b762dd29c811 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: .version_select at 0x7f2aefb42670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1558657224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrYEuNdGZkuNJpBM9qgT9JKseHHvMaheEGbnpNskiQc7W8EvG1/XAN4oeG1RBLIb+ZqA/Hnos9ZCQOt5iARRHLHJW7N/A2tblpHEaC+FOZqgBARktubNR1mYW73gx09mw=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:01.277062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-41f3ffb4-37c2-40a1-a0a8-b762dd29c811 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:09:01.284021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-41f3ffb4-37c2-40a1-a0a8-b762dd29c811 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:09:01.312292 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41f3ffb4-37c2-40a1-a0a8-b762dd29c811 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062348 Oct 19 02:09:01.313046 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3697/7275] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:09:01 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:09:06.817061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-224161394", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "7ea3e855-90c7-4797-a973-cedc805c15b7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1558657224", "security_groups": [{"name": "tempest-secgroup-smoke-1199917083"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:06.844255 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:07.101227 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] validate_networks() for [('7ea3e855-90c7-4797-a973-cedc805c15b7', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:09:07.513481 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:09:07.514086 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:09:07.514576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:09:07.514999 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:09:07.515432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:09:07.525264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:07.525743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:07.526196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:07.526939 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:07.527406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:07.527855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:07.546140 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:09:07.551467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:09:07.563992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:09:07.566739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:09:07.621751 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-51d4b8c6-5821-4aa6-964d-5a8153132101 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812806 Oct 19 02:09:07.628655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3579/7276] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:09:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:09:07.631877 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:07.636919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-22c004c3-3b86-4f07-baa9-60b778490649 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:07.637695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-22c004c3-3b86-4f07-baa9-60b778490649 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:07.775421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-22c004c3-3b86-4f07-baa9-60b778490649 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:07.789319 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-22c004c3-3b86-4f07-baa9-60b778490649 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1266 microversion: 2.1 time: 0.158390 Oct 19 02:09:07.790179 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3698/7277] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:07 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:09:08.815244 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:08.816482 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:08.829397 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:08.830125 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:08.830581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:08.831313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:08.831783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:08.832223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:08.943748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:08.954946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-98f82580-5a22-448c-b2d8-697bb1cadadb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1326 microversion: 2.1 time: 0.143468 Oct 19 02:09:08.956775 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3580/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:08 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:09.979851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:09.980662 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:09.989653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:09.990262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:09.990842 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:09.992417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:09.992942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:09.993506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:10.215614 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:10.223449 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b0a9790f-c796-45aa-acac-5d9ca5ef5de5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.247954 Oct 19 02:09:10.224055 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3699/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:09 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:10.595039 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ad1ff4-6ff7-462d-91dd-c4ad14407384", "tag": "3c3bd877-b402-4869-9088-dddf6e0a1851"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:10.607225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:10.607716 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:10.608166 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:10.620013 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] Creating event network-changed:3c3bd877-b402-4869-9088-dddf6e0a1851 for instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 on n-h1-master-1 Oct 19 02:09:10.625206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-69d92187-5afb-49d2-85e7-9a3657a58ef7 req-5b5c11ca-d181-412e-bcdb-5cad049c27eb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033870 Oct 19 02:09:10.625809 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3581/7280] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:09:11.247425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:11.248058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:11.254999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:11.255495 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:11.255954 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:11.257220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:11.257762 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:11.258205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:11.395252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:11.403238 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0302cd63-ea11-40b7-8575-bbac7489685e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.159797 Oct 19 02:09:11.403816 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3700/7281] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:11 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:12.427824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:12.429223 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:12.435403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:12.435929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:12.436323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:12.437097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:12.437580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:12.438017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:12.669506 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:12.677348 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-08b465bb-6233-421d-84ec-7dce3991388a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.254669 Oct 19 02:09:12.677931 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3582/7282] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:12 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:13.702249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:13.702938 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:13.709665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:13.710171 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:13.710701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:13.711429 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:13.712205 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:13.712726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:13.851803 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:13.859907 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b15b3112-66f0-451d-b0b5-0cbe71c0b901 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.161806 Oct 19 02:09:13.860489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3701/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:13 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:14.884064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:14.884724 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:14.891597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:14.892078 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:14.892528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:14.893273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:14.893771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:14.894201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:15.031741 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:15.039521 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1722fa91-4f7f-4106-ba4c-5ed22dd80a18 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.159731 Oct 19 02:09:15.040826 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3583/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:14 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:15.758873 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ad1ff4-6ff7-462d-91dd-c4ad14407384", "name": "network-vif-plugged", "status": "completed", "tag": "3c3bd877-b402-4869-9088-dddf6e0a1851"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:15.770972 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:15.771487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:15.771943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:15.784061 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] Creating event network-vif-plugged:3c3bd877-b402-4869-9088-dddf6e0a1851 for instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 on n-h1-master-1 Oct 19 02:09:15.789470 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b5a8470a-7bb5-4101-8bbb-a9b37ea0bbc9 req-658a6fb4-4185-4187-8ab2-f5c157d5d556 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Oct 19 02:09:15.790941 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3702/7285] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:09:16.063243 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:16.063859 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:16.070948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:16.071516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:16.071963 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:16.072679 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:16.073139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:16.073569 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:16.207248 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:16.215855 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f68da9c6-534e-457b-81e4-bd976f0ffe9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1392 microversion: 2.1 time: 0.156500 Oct 19 02:09:16.216434 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3584/7286] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:16 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:17.239853 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:17.240689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:17.248660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:17.249114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:17.249571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:17.250278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:17.250744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:17.251185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:17.386645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:17.394563 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-28228852-f757-42ec-99ef-1b04d5bfeeba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1564 microversion: 2.1 time: 0.159519 Oct 19 02:09:17.395143 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3703/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:17 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:17.497157 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:17.497802 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:17.504770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:17.505202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:17.505651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:17.506349 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:17.506807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:17.507242 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:17.538970 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:17.558217 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:17.644905 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:17.653326 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8b0c8910-d4ba-4873-a35a-40299306c4aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1564 microversion: 2.1 time: 0.160638 Oct 19 02:09:17.653902 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3585/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:17 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:19.236980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:19.237703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:19.239045 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ad1ff4-6ff7-462d-91dd-c4ad14407384", "tag": "3c3bd877-b402-4869-9088-dddf6e0a1851"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:19.240033 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:19.241963 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:19.246544 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:19.249126 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:19.250972 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:19.251493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:19.251929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:19.252270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:19.253014 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:19.254056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:19.255008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:19.255720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:19.266532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] Creating event network-changed:3c3bd877-b402-4869-9088-dddf6e0a1851 for instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 on n-h1-master-1 Oct 19 02:09:19.271892 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5915b61b-7dfa-4d8d-8dad-ebb61e919545 req-77b543f6-b315-45c8-b708-e30abd0df984 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036657 Oct 19 02:09:19.272504 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3586/7289] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:09:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:09:19.750418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:19.763259 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7d5ef0d4-c1fa-4171-b9c0-cf078aa9cd9d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1564 microversion: 2.1 time: 0.530500 Oct 19 02:09:19.764171 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3704/7290] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:19 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1564 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:45.016034 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=36 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:45.021310 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:45.023653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:45.032787 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:45.033294 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:45.033743 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:45.034458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:45.034922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:45.035366 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:45.110587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a3b6fb19-37a1-4764-a1eb-74d1573554de tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action" status: 200 len: 24569 microversion: 2.1 time: 0.096382 Oct 19 02:09:45.111248 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3587/7291] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:09:45 2022] POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:09:56.207625 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:09:56.209918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:56.212083 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:56.212782 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=32 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:56.218530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:56.219035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:56.219496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:56.220218 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:56.220726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:56.221175 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:56.293695 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-42501d27-c0e1-4b08-a3b1-f60259ad4bca tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action" status: 202 len: 0 microversion: 2.1 time: 0.090151 Oct 19 02:09:56.294327 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3705/7292] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:09:56 2022] POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:09:56.303262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:56.303913 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:56.307479 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:56.308246 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:09:56.314536 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:56.315039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:56.315480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:56.316189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:56.316659 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:56.317099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:56.488311 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:56.496858 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9148c541-2050-4dd4-87fa-5319ea5a109e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1674 microversion: 2.1 time: 0.198024 Oct 19 02:09:56.497452 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3588/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:56 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:09:57.522392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:57.523039 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:57.529635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:57.530145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:57.530614 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:57.531333 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:57.531808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:57.532259 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:57.668768 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:57.676593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-23d6c472-73a3-4d90-a47d-77e14992e097 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.159633 Oct 19 02:09:57.677182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3706/7294] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:57 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:58.701882 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:58.702507 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:58.709505 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:58.709999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:58.710453 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:58.711155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:58.711624 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:58.712065 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:58.845551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:09:58.855206 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c954ea8c-a83d-4f18-820f-3e1529730533 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.157300 Oct 19 02:09:58.855771 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3589/7295] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:58 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:09:59.879574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:09:59.880213 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:09:59.887122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:59.887630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:59.888089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:09:59.888837 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:09:59.889318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:09:59.889765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:00.018856 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:00.027625 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6a55db4e-9a85-4278-b324-08b681ca2691 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.152059 Oct 19 02:10:00.028200 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3707/7296] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:09:59 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:01.051142 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:01.051772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:01.058819 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:01.059310 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:01.059776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:01.060511 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:01.061008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:01.061452 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:01.196410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:01.204973 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7b0c7acb-2fd5-4316-90c0-3b6cb92c7416 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.157801 Oct 19 02:10:01.205557 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3590/7297] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:01 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:02.229794 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:02.230478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:02.237318 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:02.237824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:02.238278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:02.238991 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:02.239465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:02.239910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:02.376142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:02.383994 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0a453b05-7057-4343-ba6a-b1b6295ce8e7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.158812 Oct 19 02:10:02.384563 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3708/7298] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:02 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:03.407354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:03.408018 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:03.414758 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:03.415845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:03.416414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:03.417152 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:03.417625 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:03.418068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:03.550474 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:03.558778 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b1e6d5c7-54b2-44a4-be3f-1345a81da40b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.155388 Oct 19 02:10:03.559366 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3591/7299] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:03 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:04.583300 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:04.583950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:04.590700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:04.591210 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:04.591673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:04.592391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:04.592897 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:04.593350 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:04.722759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:04.731096 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d5efd23-48ce-4fe8-b755-7305058fb8e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.151784 Oct 19 02:10:04.731673 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3709/7300] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:04 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:05.755772 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:05.756371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:05.763529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:05.764015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:05.764456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:05.765178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:05.765635 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:05.766064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:05.900291 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:05.908022 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2fe2d693-778a-4fa7-9d61-ee6fb5924f4c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.156241 Oct 19 02:10:05.908603 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3592/7301] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:05 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:06.933913 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:06.934589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:06.941892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:06.942397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:06.942853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:06.943564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:06.944035 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:06.944487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:07.078862 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:07.087474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f1a11c00-9354-48e8-8b3e-bf9a5ab24bd5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.158166 Oct 19 02:10:07.088284 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3710/7302] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:06 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:08.111517 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:08.112132 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:08.119676 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:08.120169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:08.120615 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:08.121342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:08.121798 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:08.122231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:08.672776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:08.681312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5e346a95-566e-4d0a-9478-6e41053a12e6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.573182 Oct 19 02:10:08.681930 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3593/7303] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:08 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:09.706724 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:09.707395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:09.714782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:09.715284 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:09.715736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:09.716449 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:09.717002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:09.717496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:09.852231 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:09.860583 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9b9aeede-0d4f-4f79-8a05-cc634ef8eab6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.157908 Oct 19 02:10:09.861221 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3711/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:09 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:10.885222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:10.885840 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:10.892715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:10.893207 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:10.893656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:10.894355 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:10.894817 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:10.895252 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:11.025213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:11.032849 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f6943ddc-ead3-48b0-8ba0-178797b3eaf4 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.152127 Oct 19 02:10:11.033430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3594/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:10 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:12.056565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:12.057225 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:12.064061 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:12.064921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:12.065377 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:12.066085 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:12.066554 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:12.066996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:12.201487 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:12.209290 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-abcbb228-6af7-4cab-91bd-e96b22875457 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1679 microversion: 2.1 time: 0.156697 Oct 19 02:10:12.209874 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3712/7306] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:12 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:13.233857 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:13.234407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:13.241315 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:13.241803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:13.242246 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:13.242937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:13.243394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:13.243824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:13.372446 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:13.380538 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-264a679a-ad85-4fd8-b401-55ac564392b6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1682 microversion: 2.1 time: 0.150318 Oct 19 02:10:13.381154 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3595/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:13 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:41.585782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:10:41.588024 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:41.590324 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:41.591098 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:41.597566 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:41.598079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:41.598543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:41.599304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:41.599781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:41.600227 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:41.678243 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3fd3508b-7a44-4738-91b6-f79254b218d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action" status: 200 len: 69212 microversion: 2.1 time: 0.096370 Oct 19 02:10:41.678907 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3713/7308] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:10:41 2022] POST /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384/action => generated 69212 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:10:48.949644 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:48.950397 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:48.953210 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:48.954553 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=48 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:10:48.961783 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:48.962277 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:48.962725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:48.963441 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:48.963905 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:48.964338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:48.992764 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:10:49.020175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ad1ff4-6ff7-462d-91dd-c4ad14407384", "tag": "3c3bd877-b402-4869-9088-dddf6e0a1851"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:10:49.033480 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:49.034281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:49.034923 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:49.048717 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] Creating event network-changed:3c3bd877-b402-4869-9088-dddf6e0a1851 for instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 on n-h1-master-1 Oct 19 02:10:49.055405 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f6437f83-8962-4c2f-a127-7fd80f4c90ac req-accb07f6-5606-45d7-b92d-81b0a44d4704 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106666 Oct 19 02:10:49.060745 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3714/7309] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:10:49.096334 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1defaa4e-3a39-458c-b53f-74247c11c93b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 204 len: 0 microversion: 2.1 time: 0.150564 Oct 19 02:10:49.102966 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3596/7310] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:10:48 2022] DELETE /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 19 02:10:49.108932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:49.109838 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:49.117436 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:49.117948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:49.118458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:49.119269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:49.119748 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:49.120195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:49.299441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:49.307663 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69e8ed47-3a73-4386-a6f7-218e6d1bbebd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1688 microversion: 2.1 time: 0.205027 Oct 19 02:10:49.308243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3715/7311] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:49 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:50.333649 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:50.334369 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:50.341999 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:50.342489 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:50.342941 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:50.343653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:50.344118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:50.344555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:50.476930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:50.484991 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e7fee0d8-2f52-4197-a55f-493f0316338c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1688 microversion: 2.1 time: 0.155618 Oct 19 02:10:50.485578 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3597/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:50 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:51.509359 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:51.510005 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:51.512965 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:10:51.513173 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 (ip 10.222.0.27) !!! Oct 19 02:10:51.520959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:51.521476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:51.521942 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:51.522666 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:51.523147 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:51.523736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:51.781371 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:10:51.789589 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-dd7209e7-ecc4-4eef-986e-da6cac62c082 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 200 len: 1570 microversion: 2.1 time: 0.284232 Oct 19 02:10:51.790202 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3716/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:51 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 1570 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:10:51.852748 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ad1ff4-6ff7-462d-91dd-c4ad14407384", "name": "network-vif-deleted", "tag": "3c3bd877-b402-4869-9088-dddf6e0a1851"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:10:51.862936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:51.863529 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:51.864049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:51.876324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] Creating event network-vif-deleted:3c3bd877-b402-4869-9088-dddf6e0a1851 for instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 on n-h1-master-1 Oct 19 02:10:51.881648 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-093e43bd-db52-4004-845a-bfd55f339536 req-d932592f-b435-4f7b-87f8-02e0ac1d0ac5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107643 Oct 19 02:10:51.882260 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3598/7314] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:10:52.814018 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:52.815184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: d9ad1ff4-6ff7-462d-91dd-c4ad14407384] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:10:52.823107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:52.823623 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:52.824099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:52.824936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:10:52.825477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:10:52.825944 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:10:52.844903 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] HTTP exception thrown: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Request method failure captured: Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 HTTP/1.1 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1v3zbrHIvomC6-n6b2XRj89g0swbPF3WaWxEB5siOpkkxwOIBpVc-UYlwyh8DOji5CgNIiqwbcx-O4bHkWAh423kBLdJGvhW8rnaJDb7XlCe3m85AYM0oOqSOURx5ofAjBbabKXOPzVwKRNYJ52H5NW2Z6YNS0Z-ApFy7gJCbaFydU Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4030669e64c14c27af306c4582fc5ede", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}] Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02f03048cac8457e9a3a278df65f19f4 Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd9ad1ff4-6ff7-462d-91dd-c4ad14407384'} Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:10:52.846617 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Returning 404 to user: Instance d9ad1ff4-6ff7-462d-91dd-c4ad14407384 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4172b835-a2cf-4259-87e6-826c3905088a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384" status: 404 len: 111 microversion: 2.1 time: 0.038545 Oct 19 02:10:52.852537 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3717/7315] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:10:52 2022] GET /compute/v2.1/servers/d9ad1ff4-6ff7-462d-91dd-c4ad14407384 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:10:56.229956 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-865b6cea-4b83-4b6f-bac9-f479406a212a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '.version_select at 0x7f2af43b5dc0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:10:56.251575 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-865b6cea-4b83-4b6f-bac9-f479406a212a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1558657224" status: 202 len: 0 microversion: 2.1 time: 0.026833 Oct 19 02:10:56.252217 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3599/7316] 10.222.0.27 () {58 vars in 1284 bytes} [Wed Oct 19 02:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1558657224 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:10:56.283074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4883b8c1-b37f-424a-92a8-4d84b0220a08 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: .version_select at 0x7f2af42a35e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-557653351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/8JyKRxMn8cUXgQ9v84FCLoqUGbBQemPpZFEFerUavLSdw6vUfEkatj9RQPGbza7SWansl64leaOXIwEjW4ZBv3lawgsmuTzHzmD2loUMReYJzNZ844yJ999CMWyD64g=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:10:56.299605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4883b8c1-b37f-424a-92a8-4d84b0220a08 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:10:56.305819 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-4883b8c1-b37f-424a-92a8-4d84b0220a08 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:10:56.330151 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4883b8c1-b37f-424a-92a8-4d84b0220a08 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052132 Oct 19 02:10:56.330760 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3718/7317] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:10:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:11:02.056672 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:02.065632 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1649604534", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "5b15c905-ab8f-4d78-812f-b15fa5d4a66e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-557653351", "security_groups": [{"name": "tempest-secgroup-smoke-1312642516"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:02.195990 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] validate_networks() for [('5b15c905-ab8f-4d78-812f-b15fa5d4a66e', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:11:02.700997 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:11:02.701444 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:11:02.701935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:11:02.702358 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:11:02.702784 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:11:02.713534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:02.714034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:02.714481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:02.715771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:02.716393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:02.716870 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:02.735918 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:11:02.741217 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:11:02.755036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:11:02.757468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:11:02.810534 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b7172c16-f27b-4431-8f22-0715118e1ba8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.755397 Oct 19 02:11:02.816001 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3600/7318] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:11:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:11:02.825186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c50f887e-684f-42d5-98d9-42803e09cc55 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:02.826544 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c50f887e-684f-42d5-98d9-42803e09cc55 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:02.842780 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=20 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:02.901266 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c50f887e-684f-42d5-98d9-42803e09cc55 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:02.909090 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c50f887e-684f-42d5-98d9-42803e09cc55 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1266 microversion: 2.1 time: 0.090274 Oct 19 02:11:02.909770 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3719/7319] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:02 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:03.933584 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:03.934860 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:03.945698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:03.946177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:03.946845 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:03.947556 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:03.948015 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:03.948450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:04.022207 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:04.032764 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-46c1e35e-9d9c-417a-8de0-becb9d549eff tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1318 microversion: 2.1 time: 0.103313 Oct 19 02:11:04.044725 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3601/7320] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:03 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1318 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:05.059754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:05.060449 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:05.067900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:05.068413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:05.068894 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:05.069607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:05.070075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:05.070517 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:05.295835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:05.304827 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-613528c6-6182-4c97-866a-1cbf5fce1ceb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.249453 Oct 19 02:11:05.305450 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3720/7321] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:05 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:05.679516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:05.690925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:05.691356 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:05.691853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:05.704191 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] Creating event network-changed:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h1-master-1 Oct 19 02:11:05.709453 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-b338962b-b567-4a10-bde4-89fcea72e160 req-14526c8b-3174-4729-a7cc-415d621fa074 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Oct 19 02:11:05.710153 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3602/7322] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:11:06.328439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:06.329021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:06.335836 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:06.336357 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:06.336869 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:06.337590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:06.338063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:06.338509 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:06.472167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:06.479896 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-96c17568-2b86-48a5-a292-a13ccf9f7881 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.155758 Oct 19 02:11:06.480468 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3721/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:06 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:07.505198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:07.506001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:07.512371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:07.512996 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:07.513450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:07.514153 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:07.514618 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:07.515061 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:07.726813 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:07.734788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52bec452-c276-454d-bf45-d0b9279fb39c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.234830 Oct 19 02:11:07.735384 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3603/7324] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:07 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:08.758546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:08.759309 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:08.766301 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:08.766813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:08.767275 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:08.768004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:08.768484 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:08.768969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:08.906482 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:08.914249 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d317603e-f7d7-4c86-9729-878b99b7edb3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.159739 Oct 19 02:11:08.914833 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3722/7325] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:08 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:09.938668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:09.939280 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:09.946195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:09.946677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:09.947117 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:09.947806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:09.948273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:09.948729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:10.404415 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "name": "network-vif-plugged", "status": "completed", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:10.414818 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:10.415322 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:10.415781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:10.429281 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] Creating event network-vif-plugged:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h1-master-1 Oct 19 02:11:10.431373 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:10.434923 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ede5088b-f90d-416e-b1e5-ebe73292693f req-34327f0f-c661-482d-8bd0-cc90a33b0b11 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097701 Oct 19 02:11:10.435724 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3723/7326] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:11:10.441508 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8978141-0e39-4009-bd14-ec562054db91 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.506762 Oct 19 02:11:10.442437 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3604/7327] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:09 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:11.467754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:11.468503 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:11.474737 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:11.475273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:11.475730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:11.476442 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:11.476947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:11.477395 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:11.614017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:11.622596 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d2a88942-b956-4f6b-bba3-c7ea98cf1287 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1392 microversion: 2.1 time: 0.160441 Oct 19 02:11:11.623185 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3724/7328] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:11 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:12.645970 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:12.646597 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:12.653818 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:12.654313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:12.654770 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:12.655473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:12.655940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:12.656375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:12.723046 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:12.750294 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:12.789667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:12.798026 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ea5620b-ec86-4aba-bfb0-8136c60fefd2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1564 microversion: 2.1 time: 0.156007 Oct 19 02:11:12.798613 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3605/7329] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:12 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:12.821175 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:12.821815 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:12.825913 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:12.831381 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:12.831881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:12.832330 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:12.833091 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:12.833565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:12.834003 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:12.905914 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:12.973610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:12.981326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-229241fe-2812-412f-bc39-d1e44a428698 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1564 microversion: 2.1 time: 0.164131 Oct 19 02:11:12.981963 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3725/7330] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:12 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:14.580210 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:14.582885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:14.583516 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:14.591795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:14.592456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:14.592997 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:14.593812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:14.594338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:14.594859 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:14.597929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:14.598435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:14.598895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:14.611215 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] Creating event network-changed:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h1-master-1 Oct 19 02:11:14.617241 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-add9bf1d-1542-4ec1-a97e-a747bf2e7152 req-9139f402-4b41-4814-a126-4e191a19a046 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040776 Oct 19 02:11:14.618395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3726/7331] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:11:14.812468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:14.820878 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-052de5d0-296b-4b93-8cbe-05fc15521e3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1564 microversion: 2.1 time: 0.247897 Oct 19 02:11:14.821696 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3606/7332] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:14 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1564 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:38.097852 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.098617 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=34 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:38.102820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:38.105127 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:38.112947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:38.113458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:38.113929 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:38.114634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:38.115108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:38.115551 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:38.188755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-975653d7-1391-4edb-8b99-ad8dadfa2cbd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action" status: 200 len: 24565 microversion: 2.1 time: 0.092746 Oct 19 02:11:38.189838 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3727/7333] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:11:38 2022] POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action => generated 24565 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:11:49.105817 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:11:49.108165 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:49.111662 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.112452 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.116906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:49.117419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:49.117854 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:49.118566 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:49.119280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:49.119437 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:49.167424 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:49.173954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Old instance type m1.heat2, new instance type m1.heat {{(pid=131450) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 19 02:11:49.180604 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:11:49.181061 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:11:49.181545 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:11:49.181964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:11:49.182393 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:11:49.246861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-564ddf33-f584-49eb-bc42-a9fcd0118e3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action" status: 202 len: 0 microversion: 2.1 time: 0.144982 Oct 19 02:11:49.247474 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3607/7334] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:11:49 2022] POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:11:49.256961 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:49.257695 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:49.260688 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.261496 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:11:49.269072 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:49.269662 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:49.270250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:49.270985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:49.271497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:49.272066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:49.417243 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:49.425264 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-bb18003b-6cb7-4e30-b366-eb7fe676e477 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1692 microversion: 2.1 time: 0.172688 Oct 19 02:11:49.425924 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3728/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:49 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:50.450047 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:50.450599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:50.458375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:50.458871 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:50.459312 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:50.460017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:50.460479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:50.460938 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:50.599407 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:50.607169 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29d8a72a-ca4e-44fa-b745-4b35ae2a7678 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1692 microversion: 2.1 time: 0.161946 Oct 19 02:11:50.607743 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3608/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:50 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:51.631458 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:51.632102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:51.639653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:51.640155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:51.640635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:51.641359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:51.641833 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:51.642847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:51.780321 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:51.789143 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3565408d-1a83-4fb2-b796-b87d0739a91d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.162155 Oct 19 02:11:51.789727 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3729/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:51 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:52.814697 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:52.815323 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:52.823028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:52.823524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:52.823977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:52.824713 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:52.825502 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:52.826060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:52.959617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:52.967433 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a0ae0a15-4d07-41ff-9d20-e884f9a9d584 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.157145 Oct 19 02:11:52.968013 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3609/7338] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:52 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:53.993981 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:53.995062 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:54.003558 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:54.004069 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:54.004543 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:54.005304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:54.005786 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:54.006234 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:54.151759 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:54.159532 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-26212da4-b2b4-4778-98f5-e9465baef71a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.171965 Oct 19 02:11:54.160112 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3730/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:53 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:55.183346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:55.183959 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:55.191162 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:55.191655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:55.192101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:55.192824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:55.193286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:55.193718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:55.326781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:55.335190 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-22b0a2c0-9d56-4ea2-9702-51cfbab55d82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.155781 Oct 19 02:11:55.335769 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3610/7340] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:55 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:56.359291 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:56.359955 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:56.366941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:56.367444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:56.367902 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:56.368646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:56.369114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:56.369561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:56.499828 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:56.508505 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4d918d74-69ef-41b2-8b8c-e1e92ab62037 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.153173 Oct 19 02:11:56.509131 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3731/7341] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:56 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:57.532895 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:57.533641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:57.541176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:57.541664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:57.542108 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:57.542799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:57.543261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:57.543827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:57.680867 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:57.688639 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d3d9eb4a-9235-4da1-bcd8-7567021a3a3f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.159689 Oct 19 02:11:57.689217 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3611/7342] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:57 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:58.711991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:58.712653 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:58.719487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:58.719985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:58.720440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:58.721169 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:58.722245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:58.722696 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:58.856750 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:11:58.865080 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f0ec8d5-a9fc-4854-90f4-82e46872fce7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.157025 Oct 19 02:11:58.865685 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3732/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:58 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:11:59.888822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:11:59.889468 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:11:59.897105 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:59.897591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:59.898032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:11:59.898720 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:11:59.899208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:11:59.899672 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:00.036066 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:00.043836 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f687c7c4-5364-4d18-8faf-f8a24783dfeb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.158934 Oct 19 02:12:00.044415 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3612/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:11:59 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:12:01.068909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:01.069543 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:01.076471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:01.076999 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:01.077462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:01.078195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:01.078661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:01.079105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:01.213443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:01.221177 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-59d16f6e-4821-4395-8b96-40c5f42cca98 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.156586 Oct 19 02:12:01.221749 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3733/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:01 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:02.246075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:02.246701 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:02.253631 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:02.254129 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:02.255222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:02.255934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:02.256399 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:02.256869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:02.397117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:02.404877 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-59314304-cf4b-4b48-bbf1-6096b947f936 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.162760 Oct 19 02:12:02.405459 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3613/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:02 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:03.429686 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:03.430324 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:03.437002 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:03.437500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:03.437953 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:03.438688 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:03.439157 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:03.439851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:03.570740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:03.578569 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d8a1d186-6fa2-4b2a-93d3-483ce78da421 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.153483 Oct 19 02:12:03.579157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3734/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:03 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:04.602663 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:04.603277 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:04.609887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:04.610371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:04.610812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:04.611501 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:04.611960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:04.612385 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:04.749685 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:04.758027 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-afc17670-4125-4d19-b22e-b2320f2513d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.159398 Oct 19 02:12:04.758614 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3614/7348] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:04 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:05.782138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:05.782776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:05.791185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:05.791686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:05.792136 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:05.792934 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:05.793404 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:05.793846 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:05.933821 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:05.942019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-038215e7-d7bc-4fed-bbfd-315ea5c7bba7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.163742 Oct 19 02:12:05.942805 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3735/7349] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:05 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:06.965738 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:06.966362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:06.974177 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:06.974670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:06.975119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:06.975828 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:06.976293 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:06.976766 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:07.110294 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:07.118815 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-72934eb7-9e34-4a98-a1d9-d849e24d7560 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.157069 Oct 19 02:12:07.119407 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3615/7350] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:06 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:08.142138 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:08.142776 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:08.150062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:08.150567 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:08.151023 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:08.151734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:08.152206 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:08.152671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:08.284584 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:08.292818 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8963f509-3840-4c58-a0dc-b0ac97a6e08b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1697 microversion: 2.1 time: 0.154568 Oct 19 02:12:08.293387 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3736/7351] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:08 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:09.318178 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:09.318787 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:09.325281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:09.325776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:09.326220 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:09.326917 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:09.327375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:09.327806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:09.392007 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "name": "network-vif-unplugged", "status": "completed", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:09.404607 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:09.405144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:09.405605 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:09.419326 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Creating event network-vif-unplugged:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h2-master-1 Oct 19 02:12:09.425356 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] Instance 64c00a55-81a2-470c-985d-4b2eb2566692 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131449) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 02:12:09.438361 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f60423a7-5930-4605-90e1-524c46a200ed req-5af6bea4-5e3c-4628-84eb-4aa3ad69d60d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050445 Oct 19 02:12:09.439182 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3737/7352] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:12:09.469518 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:09.478082 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb84d2dc-941a-4f96-8f97-02e39d2a5953 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1696 microversion: 2.1 time: 0.164337 Oct 19 02:12:09.478676 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3616/7353] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:09 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:10.502143 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:10.502863 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:10.510382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:10.510885 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:10.511338 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:10.512050 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:10.512521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:10.512996 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:10.649185 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:10.656978 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d15029bd-1e9a-41ce-9caf-42cd885fb296 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1694 microversion: 2.1 time: 0.159059 Oct 19 02:12:10.657564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3738/7354] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:10 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:11.466438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:11.477334 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:11.477813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:11.478262 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:11.490799 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Creating event network-changed:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h2-master-1 Oct 19 02:12:11.496192 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] Instance 64c00a55-81a2-470c-985d-4b2eb2566692 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-master-1', 'n-h1-master-1'} {{(pid=131450) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 19 02:12:11.507198 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-36828c53-6118-4714-b2d9-703332b4bc1a req-527a4bbc-0b0c-489a-abb0-c59ac7eda92f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044443 Oct 19 02:12:11.507814 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3617/7355] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:11.683394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:11.684058 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:11.691993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:11.692828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:11.693286 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:11.694051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:11.694671 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:11.695120 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:11.908349 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:11.920911 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09655bf6-b16f-469c-ab3c-82880c811347 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1694 microversion: 2.1 time: 0.241361 Oct 19 02:12:11.921514 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3739/7356] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:11 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:12.946845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:12.947555 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:12.953733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:12.954228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:12.954686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:12.955394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:12.955860 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:12.956301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.091798 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:13.101085 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fb494765-0f0f-47dc-ab90-eb726bb37800 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1691 microversion: 2.1 time: 0.159395 Oct 19 02:12:13.101680 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3618/7357] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:12 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:13.125254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:13.125974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:13.133090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.133595 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.134054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.134774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.135247 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.135720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.193802 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5f6b11e8-f945-4097-b79f-dd444c21040c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action" status: 204 len: 0 microversion: 2.1 time: 0.072336 Oct 19 02:12:13.194450 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3740/7358] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:12:13 2022] POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:13.202449 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:13.203067 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:13.209622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.210367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.210814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.211517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.211976 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.212411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.418668 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:13.427493 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-17167f5c-22f7-47d1-bd1c-863728efca82 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1691 microversion: 2.1 time: 0.228790 Oct 19 02:12:13.428101 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3619/7359] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:13 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1691 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:13.452019 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:13.452788 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:13.460153 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.460854 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.461315 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.462043 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:13.462521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:13.462967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:13.683505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:13.692045 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a2fb633e-8db2-49eb-99f8-589fcb49d465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1691 microversion: 2.1 time: 0.244310 Oct 19 02:12:13.692740 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3741/7360] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:13 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:14.716222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:14.716878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:14.725023 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:14.725514 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:14.725959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:14.726655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:14.727112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:14.727543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:14.868306 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:14.876674 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8dca3040-7e0b-4829-8178-f33d303706ab tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1691 microversion: 2.1 time: 0.164286 Oct 19 02:12:14.877476 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3620/7361] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:14 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:15.022887 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "name": "network-vif-plugged", "status": "completed", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:15.035496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:15.036133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:15.036593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:15.062145 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] Creating event network-vif-plugged:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h2-master-1 Oct 19 02:12:15.071444 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-a0ffb56f-4c4d-4d2b-8bc6-141507db88c8 req-195b1f11-9da5-49a8-b9de-d0e06d5449b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052904 Oct 19 02:12:15.072201 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3742/7362] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:15.901131 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:15.901776 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:15.908796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:15.909285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:15.909733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:15.910426 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:15.910885 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:15.911319 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:16.041351 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:16.049296 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f465b1c6-7af3-4576-865c-86cd0c0d28aa tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1683 microversion: 2.1 time: 0.152032 Oct 19 02:12:16.050319 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3621/7363] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:15 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:36.270979 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=30 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.271752 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:36.278141 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:36.280418 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:36.288669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:36.289161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:36.289640 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:36.290358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:36.290831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:36.291278 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:36.362367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e45a0e06-bc5d-4d11-9e71-fe05ce740dad tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action" status: 200 len: 24576 microversion: 2.1 time: 0.094464 Oct 19 02:12:36.363618 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3743/7364] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:12:36 2022] POST /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692/action => generated 24576 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:12:43.578984 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:43.579528 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:43.581785 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:43.582203 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.582753 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:43.590964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:43.591466 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:43.591921 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:43.592656 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:43.593120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:43.593562 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:43.594062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:43.594646 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:43.595143 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:43.607576 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] Creating event network-changed:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h2-master-1 Oct 19 02:12:43.613184 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b9a4fd5d-a692-4932-849c-ff12f80695f8 req-bfaed016-12fe-459f-acac-804c6daff8e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035090 Oct 19 02:12:43.613935 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3744/7365] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:43.625371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:12:43.710439 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8e02c971-dbe2-46d5-ba0a-c4c50eb75b8f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 204 len: 0 microversion: 2.1 time: 0.135433 Oct 19 02:12:43.711395 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3622/7366] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:12:43 2022] DELETE /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:12:43.722597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:43.724745 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:43.731649 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:43.732166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:43.732642 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:43.733387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:43.733864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:43.734347 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:43.880252 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:43.888755 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-333a51dd-f939-4f0b-b0ef-3f3dd38a4c11 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1689 microversion: 2.1 time: 0.172194 Oct 19 02:12:43.889359 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3745/7367] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:43 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:44.915560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:44.916198 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:44.924699 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:44.925206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:44.925660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:44.926377 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:44.926847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:44.927286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:45.060383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:45.070027 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f8727ee8-18b8-4e59-a0fc-d89306a4d638 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 200 len: 1689 microversion: 2.1 time: 0.159828 Oct 19 02:12:45.070503 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3623/7368] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:44 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:45.659002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c00a55-81a2-470c-985d-4b2eb2566692", "name": "network-vif-deleted", "tag": "2b8036ad-cffa-48cd-83e2-09d0550d2804"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:45.670433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:45.670931 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:45.671382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:45.687946 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] Creating event network-vif-deleted:2b8036ad-cffa-48cd-83e2-09d0550d2804 for instance 64c00a55-81a2-470c-985d-4b2eb2566692 on n-h2-master-1 Oct 19 02:12:45.693030 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b7292f6f-1307-499f-8e47-3c535d76eb76 req-819da114-0438-4baa-b54b-0f8d46edf291 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037928 Oct 19 02:12:45.694999 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3746/7369] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:46.094822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:46.095443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 64c00a55-81a2-470c-985d-4b2eb2566692] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:46.102472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:46.102975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:46.103395 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:46.104086 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:46.104541 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:46.105016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:46.119066 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.wsgi [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] HTTP exception thrown: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Request method failure captured: Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: request: GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 HTTP/1.1 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Accept: application/json Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Accept-Encoding: identity Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Connection: close Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Content-Length: 0 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Content-Type: application/json Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Host: 10.222.0.27 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: Openstack-System-Scope: None Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: User-Agent: python-urllib3/1.26.12 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Auth-Token: gAAAAABjT1v3zbrHIvomC6-n6b2XRj89g0swbPF3WaWxEB5siOpkkxwOIBpVc-UYlwyh8DOji5CgNIiqwbcx-O4bHkWAh423kBLdJGvhW8rnaJDb7XlCe3m85AYM0oOqSOURx5ofAjBbabKXOPzVwKRNYJ52H5NW2Z6YNS0Z-ApFy7gJCbaFydU Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Id: None Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Domain-Name: None Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Identity-Status: Confirmed Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Is-Admin-Project: True Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Id: default Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Project-Domain-Name: Default Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Project-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Role: member,reader Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Roles: member,reader Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4030669e64c14c27af306c4582fc5ede", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}] Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-User: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Id: default Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-User-Domain-Name: Default Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-User-Id: 02f03048cac8457e9a3a278df65f19f4 Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: method: > Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: exception: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: action_args: {'id': '64c00a55-81a2-470c-985d-4b2eb2566692'} Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:12:46.120736 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: ERROR nova.api.openstack.wsgi Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Returning 404 to user: Instance 64c00a55-81a2-470c-985d-4b2eb2566692 could not be found. {{(pid=131450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3ef75108-f8f3-474e-a0a8-37d409262797 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692" status: 404 len: 111 microversion: 2.1 time: 0.031328 Oct 19 02:12:46.130064 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3624/7370] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:46 2022] GET /compute/v2.1/servers/64c00a55-81a2-470c-985d-4b2eb2566692 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:12:49.271215 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-01c255ea-f5dd-4596-84f6-3ee9c9094da8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '.version_select at 0x7f2aefbecb80>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:49.301521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-01c255ea-f5dd-4596-84f6-3ee9c9094da8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-557653351" status: 202 len: 0 microversion: 2.1 time: 0.035412 Oct 19 02:12:49.302755 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3747/7371] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 02:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-557653351 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:12:49.332401 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-43d44ac2-2cdb-4b34-aaac-e862025f23d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: .version_select at 0x7f2af488bf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1314516840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3o0vuUEPwlqn55QfHlx8vlcQ1KWXTL28cF398JosIQtKZnOn+L0x04FnKGalqV1XPbnL8iLQYJX1YTZqpemjw+XiPtSZojEyQjNXYE82HmE0dFAm+yP0u+3OKsJkAgKg=="}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:49.349579 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-43d44ac2-2cdb-4b34-aaac-e862025f23d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:12:49.355032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-43d44ac2-2cdb-4b34-aaac-e862025f23d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:12:49.380252 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-43d44ac2-2cdb-4b34-aaac-e862025f23d7 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051786 Oct 19 02:12:49.380922 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3625/7372] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:12:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:55.174305 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1891858680", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "3eb251c4-0c57-483c-ae98-f892845a9f71"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1314516840", "security_groups": [{"name": "tempest-secgroup-smoke-31314790"}]}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:55.309362 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.network.neutron [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] validate_networks() for [('3eb251c4-0c57-483c-ae98-f892845a9f71', None, None, None, None, None)] {{(pid=131449) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:12:55.676137 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=14 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.141113 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:12:56.141565 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:12:56.142063 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:12:56.142685 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:12:56.143325 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.virt.hardware [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131449) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:12:56.153079 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:56.153588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:56.154047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:56.154802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:56.155288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:56.155732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:56.173932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:12:56.180136 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:12:56.194974 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Going to run 1 instances... {{(pid=131449) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:12:56.198021 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131449) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:12:56.247250 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f7180d6c-3cda-4cbd-956c-844ce3e16d4f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.076863 Oct 19 02:12:56.249272 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3748/7373] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:12:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:12:56.262032 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1cbe183b-6605-482a-9bdb-3b1e98accf6e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:56.263454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1cbe183b-6605-482a-9bdb-3b1e98accf6e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:56.270773 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:12:56.351254 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1cbe183b-6605-482a-9bdb-3b1e98accf6e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:56.358816 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1cbe183b-6605-482a-9bdb-3b1e98accf6e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1267 microversion: 2.1 time: 0.101227 Oct 19 02:12:56.359402 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3626/7374] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:56 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:57.383074 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:57.383866 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:57.394511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:57.395297 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:57.396128 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:57.397134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:57.397663 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:57.401628 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:57.483898 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:57.496367 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c1a54402-3baa-4f67-94df-74b1f444fed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1319 microversion: 2.1 time: 0.117488 Oct 19 02:12:57.497753 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3749/7375] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:57 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1319 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:12:58.522327 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:58.523363 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:58.531360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:58.531858 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:58.532299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:58.533043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:58.533498 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:58.534195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:58.791279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:58.799545 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-745da4a8-e347-445e-ae74-fd5dcc05bd7a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1391 microversion: 2.1 time: 0.281793 Oct 19 02:12:58.800186 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3627/7376] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:58 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1391 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:12:59.197507 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8973d4aa-fd98-4214-bffd-f6a4c7b54603", "tag": "f5456788-c9dc-4eec-b708-6faca3aef515"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:12:59.208735 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:59.209370 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:59.210033 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:59.222804 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] Creating event network-changed:f5456788-c9dc-4eec-b708-6faca3aef515 for instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 on n-h1-master-1 Oct 19 02:12:59.228340 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-856b7cd1-3c7e-4221-8c87-86208c1552df req-d4bd1daf-4d25-4ecc-b0f9-8e03c5c4bfee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 Oct 19 02:12:59.228989 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3750/7377] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:12:59.825508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:12:59.826051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:12:59.833075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:59.833599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:59.834089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:59.834895 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:12:59.835245 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:12:59.835674 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:12:59.969631 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:12:59.978349 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f10b72fb-daea-408d-a3be-d499716dfc9f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1391 microversion: 2.1 time: 0.156863 Oct 19 02:12:59.978934 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3628/7378] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:12:59 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:01.003883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:01.004610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:01.011701 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:01.012027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:01.012485 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:01.013243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:01.013717 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:01.014165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:01.241752 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:01.250343 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0c2709f-bf0e-4ab2-9651-3395e332f7c5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1391 microversion: 2.1 time: 0.251534 Oct 19 02:13:01.250940 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3751/7379] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:00 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1391 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:02.275679 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:02.276299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:02.283280 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:02.283768 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:02.284216 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:02.284948 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:02.285414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:02.285853 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:02.421498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:02.429142 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-39fd1fdc-404d-4aa9-9c1d-4ad822ab9465 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1391 microversion: 2.1 time: 0.158192 Oct 19 02:13:02.429722 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3629/7380] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:02 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:02.853103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8973d4aa-fd98-4214-bffd-f6a4c7b54603", "name": "network-vif-plugged", "status": "completed", "tag": "f5456788-c9dc-4eec-b708-6faca3aef515"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:02.863754 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:02.864467 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:02.864947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:02.877001 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] Creating event network-vif-plugged:f5456788-c9dc-4eec-b708-6faca3aef515 for instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 on n-h1-master-1 Oct 19 02:13:02.882601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5a739c23-d544-4d17-9864-e9d4d6289a2c req-3a6ce157-b5bc-4c6d-a621-a62a47f23b58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Oct 19 02:13:02.883198 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3752/7381] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:13:03.453042 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:03.453691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:03.460890 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:03.461380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:03.461824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:03.462525 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:03.462984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:03.463422 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:03.596443 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:03.604899 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e33db351-184b-4964-8bea-d24d32e493d8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1391 microversion: 2.1 time: 0.155832 Oct 19 02:13:03.605475 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3630/7382] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:03 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:04.629907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:04.630669 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:04.637001 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:04.637507 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:04.637970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:04.638686 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:04.639166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:04.639619 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:04.773432 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:04.781239 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d1edaa8c-eff6-45f4-ad9d-d2b7712dff1f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1563 microversion: 2.1 time: 0.156547 Oct 19 02:13:04.781820 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3753/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:04 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:04.804713 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:04.805330 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:04.812082 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:04.812565 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:04.813044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:04.813736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:04.814196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:04.814880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:04.946467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:04.954316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5caafa00-5cb9-41d7-9cb7-b0bc9a3fb434 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1563 microversion: 2.1 time: 0.154298 Oct 19 02:13:04.954895 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3631/7384] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:04 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:06.581842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:06.583326 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:06.583636 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8973d4aa-fd98-4214-bffd-f6a4c7b54603", "tag": "f5456788-c9dc-4eec-b708-6faca3aef515"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:06.586942 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.587707 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.588832 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.594379 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:06.597397 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:06.598030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:06.598734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:06.600472 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:06.601100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:06.601664 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:06.603147 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:06.603698 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:06.604141 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:06.617488 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] Creating event network-changed:f5456788-c9dc-4eec-b708-6faca3aef515 for instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 on n-h1-master-1 Oct 19 02:13:06.623567 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4f2f6bca-a979-4171-a355-7f05860df06e req-e3c2891e-1499-443f-9493-bc8cfea16a3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043627 Oct 19 02:13:06.624521 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3632/7385] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:13:06.788980 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:06.797353 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cd9778da-94ce-4004-a705-81fa4692df07 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1563 microversion: 2.1 time: 0.219656 Oct 19 02:13:06.806091 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3754/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:06 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1563 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:32.068574 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:32.071001 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:32.074207 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:32.074968 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=32 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:32.081286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:32.081776 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:32.082219 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:32.082919 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:32.083375 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:32.083842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:32.160169 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3f331ff1-a95c-4243-b389-2b570a17d9b2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action" status: 200 len: 24566 microversion: 2.1 time: 0.095974 Oct 19 02:13:32.160840 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3633/7387] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:13:32 2022] POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action => generated 24566 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:43.222043 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:43.224183 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.224912 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=30 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.231541 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:43.232045 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:43.232498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:43.254663 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Going to try to stop instance {{(pid=131449) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 19 02:13:43.298179 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0b9caa4e-2a32-4ba7-9b01-c792d7c19c02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action" status: 202 len: 0 microversion: 2.1 time: 0.080217 Oct 19 02:13:43.298785 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3755/7388] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:13:43 2022] POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:13:43.308117 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:43.308790 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:43.311467 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.312265 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:13:43.319183 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:43.320823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:43.321290 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:43.322005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:43.322467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:43.322937 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:43.463777 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:43.471653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2d61fcf9-1072-4242-ab0f-006319624151 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.168456 Oct 19 02:13:43.472216 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3634/7389] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:43 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:44.497363 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:44.498111 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:44.504264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:44.504796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:44.505246 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:44.505950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:44.506420 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:44.506861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:44.635727 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:44.643520 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9070b56a-706f-4376-bc09-a7bf4226612f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.151727 Oct 19 02:13:44.644095 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3756/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:44 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:45.669354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:45.669980 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:45.677196 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:45.677689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:45.678136 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:45.678839 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:45.680160 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:45.680604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:45.813498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:45.822178 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-32632411-f80d-4ac7-80cd-d62fffc5ce4e tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.156765 Oct 19 02:13:45.822764 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3635/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:45 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:13:46.847142 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:46.847782 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:46.855172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:46.855678 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:46.856135 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:46.856882 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:46.857353 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:46.857802 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:46.987017 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:46.995303 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-312bec63-8f8f-4c40-a73f-7014c0d14072 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.152136 Oct 19 02:13:46.995880 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3757/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:46 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:48.019179 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:48.019827 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:48.026882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:48.027367 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:48.027809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:48.028508 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:48.029024 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:48.029455 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:48.168170 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:48.176138 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-704a6423-e30c-4cac-8d0b-b5d8d646d86b tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.160963 Oct 19 02:13:48.176736 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3636/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:48 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:49.201812 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:49.202551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:49.209574 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:49.210080 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:49.210548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:49.211414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:49.211896 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:49.212348 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:49.347221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:49.356079 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c968f189-d34a-4c1e-94f2-92198b810400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.158285 Oct 19 02:13:49.356673 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3758/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:49 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:50.380992 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:50.381627 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:50.389206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:50.389701 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:50.390155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:50.390863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:50.391333 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:50.391775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:50.521749 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:50.530055 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9467c505-db20-462f-b7cc-7ccc4d4d9c7f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.153152 Oct 19 02:13:50.530638 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3637/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:50 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:51.554934 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:51.555585 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:51.562530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:51.563040 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:51.563498 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:51.564469 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:51.564979 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:51.565431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:51.704645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:51.713280 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33107ed1-65f3-48b2-90ac-6cbd85eef697 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.162441 Oct 19 02:13:51.713869 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3759/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:51 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:52.739044 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:52.739736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:52.747142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:52.747627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:52.748068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:52.748799 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:52.749256 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:52.749686 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:52.880472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:52.889829 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4f74b3d4-c43b-4404-8f81-9d90d2113de6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1692 microversion: 2.1 time: 0.156084 Oct 19 02:13:52.890540 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3638/7397] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:52 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:53.914267 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:53.915000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:53.922446 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:53.922994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:53.923462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:53.924193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:53.924742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:53.925281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:54.089511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:54.097916 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7161f99d-827e-4f41-b7be-abba17fd0047 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1669 microversion: 2.1 time: 0.187485 Oct 19 02:13:54.098548 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3760/7398] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:53 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1669 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:55.198261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:55.200454 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:55.207414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:55.207912 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:55.208339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:55.209062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:55.209516 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:55.209940 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:55.286861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b914fee-3097-4140-a21b-d95e35048400 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action" status: 200 len: 38395 microversion: 2.1 time: 0.092921 Oct 19 02:13:55.287513 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3639/7399] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:13:55 2022] POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action => generated 38395 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:13:55.299689 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:13:55.306734 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:55.307184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:55.307643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:55.330182 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Going to try to start instance {{(pid=131449) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 19 02:13:55.372022 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63de2b66-e8de-42cc-9394-4fc9193b200f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action" status: 202 len: 0 microversion: 2.1 time: 0.076259 Oct 19 02:13:55.372644 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3761/7400] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:13:55 2022] POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:13:55.381885 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:55.382641 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:55.391027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:55.391757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:55.392247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:55.393575 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:55.394047 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:55.394467 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:55.575514 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:55.583476 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-77ece59a-e421-4e7d-b637-a39bb1623d45 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1678 microversion: 2.1 time: 0.205868 Oct 19 02:13:55.584054 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3640/7401] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:55 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:56.609065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:56.609798 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:56.616272 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:56.616881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:56.617369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:56.618114 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:56.618590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:56.619063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:56.763921 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:56.771874 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b9c72689-812b-4f40-8426-7242b6e76f00 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1678 microversion: 2.1 time: 0.167962 Oct 19 02:13:56.772461 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3762/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:56 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:13:57.796558 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:13:57.797233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:13:57.804068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:57.804638 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:57.805102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:57.805788 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:13:57.806249 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:13:57.806678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:13:57.940143 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:13:57.948346 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5511e231-953c-4687-ad39-5b0664571ba2 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1682 microversion: 2.1 time: 0.155675 Oct 19 02:13:57.948953 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3641/7403] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:13:57 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:24.147799 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:24.150094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:24.152436 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=16 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:24.153191 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:24.160560 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:24.161090 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:24.161555 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:24.162304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:24.162782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:24.163233 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:24.242668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f04f329b-5a53-48a2-b116-a0122b5b8987 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action" status: 200 len: 62962 microversion: 2.1 time: 0.098835 Oct 19 02:14:24.243952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3763/7404] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:14:24 2022] POST /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603/action => generated 62962 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:14:31.326890 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:31.327706 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:31.329137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8973d4aa-fd98-4214-bffd-f6a4c7b54603", "tag": "f5456788-c9dc-4eec-b708-6faca3aef515"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:31.331826 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=16 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:31.333006 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=46 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:31.333906 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:14:31.334084 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:14:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 (ip 10.222.0.27) !!! Oct 19 02:14:31.344148 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:31.344667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:31.345320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:31.347945 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:31.348447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:31.349089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:31.349810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:31.350763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:31.350763 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:31.358931 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] Creating event network-changed:f5456788-c9dc-4eec-b708-6faca3aef515 for instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 on n-h1-master-1 Oct 19 02:14:31.364521 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-ee8df91e-50e3-4ab4-b1d9-701962ac5bc1 req-edc72fda-2cee-4f99-ae71-fe1d989b51b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039356 Oct 19 02:14:31.365390 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3764/7405] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:14:31.380789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:14:31.476803 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d6692bfe-313e-4a45-970a-95f466ac2c75 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 204 len: 0 microversion: 2.1 time: 0.153422 Oct 19 02:14:31.480107 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3642/7406] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:14:31 2022] DELETE /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:14:31.491495 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:31.493792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:31.500382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:31.500939 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:31.501396 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:31.502123 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:31.502598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:31.503193 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:31.718948 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:31.726673 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b36d7e5d-1f08-4a86-852a-d09d09f35966 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1688 microversion: 2.1 time: 0.242187 Oct 19 02:14:31.727555 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3765/7407] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:31 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1688 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:32.752525 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:32.753272 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:32.760218 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:32.760752 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:32.761208 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:32.761914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:32.762380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:32.762821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:32.947855 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:32.955661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-044cb959-fcb8-464d-8af1-f2722dfe68d1 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1688 microversion: 2.1 time: 0.207481 Oct 19 02:14:32.956242 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3643/7408] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:32 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1688 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:33.979897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:33.980593 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:33.987251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:33.987752 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:33.988211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:33.988964 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:33.989440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:33.989890 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:34.083851 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:34.099075 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1931f482-0683-4caa-9227-ce7719e41f51 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 200 len: 1503 microversion: 2.1 time: 0.123264 Oct 19 02:14:34.100070 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3766/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:33 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 1503 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:34.121964 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8973d4aa-fd98-4214-bffd-f6a4c7b54603", "name": "network-vif-deleted", "tag": "f5456788-c9dc-4eec-b708-6faca3aef515"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:34.132301 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:34.132813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:34.133803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:34.145020 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] Creating event network-vif-deleted:f5456788-c9dc-4eec-b708-6faca3aef515 for instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 on n-h1-master-1 Oct 19 02:14:34.150925 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-838fef5a-7569-40f7-87fb-53752262a5c1 req-87079c31-f26a-4c73-869d-7e03cd3eb28c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032880 Oct 19 02:14:34.152079 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3644/7410] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:14:35.123094 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:35.123722 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 8973d4aa-fd98-4214-bffd-f6a4c7b54603] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:35.130601 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:35.131095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:35.131547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:35.132256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:35.132759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:35.133241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:35.146474 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] HTTP exception thrown: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Request method failure captured: Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 HTTP/1.1 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1v3zbrHIvomC6-n6b2XRj89g0swbPF3WaWxEB5siOpkkxwOIBpVc-UYlwyh8DOji5CgNIiqwbcx-O4bHkWAh423kBLdJGvhW8rnaJDb7XlCe3m85AYM0oOqSOURx5ofAjBbabKXOPzVwKRNYJ52H5NW2Z6YNS0Z-ApFy7gJCbaFydU Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4030669e64c14c27af306c4582fc5ede", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}] Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02f03048cac8457e9a3a278df65f19f4 Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '8973d4aa-fd98-4214-bffd-f6a4c7b54603'} Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:14:35.148130 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Returning 404 to user: Instance 8973d4aa-fd98-4214-bffd-f6a4c7b54603 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b1faabf5-9534-4909-b790-8eea13eabda6 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603" status: 404 len: 111 microversion: 2.1 time: 0.031006 Oct 19 02:14:35.154303 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3767/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:35 2022] GET /compute/v2.1/servers/8973d4aa-fd98-4214-bffd-f6a4c7b54603 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:14:38.895739 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5722df5d-c860-483c-b86e-3eef6f7a1552 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '.version_select at 0x7f2af93aa700>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:38.920292 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5722df5d-c860-483c-b86e-3eef6f7a1552 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1314516840" status: 202 len: 0 microversion: 2.1 time: 0.029366 Oct 19 02:14:38.924709 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3645/7412] 10.222.0.27 () {58 vars in 1284 bytes} [Wed Oct 19 02:14:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1314516840 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:14:38.952080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-25fe9508-968c-41cb-b7bb-f37a93a1a0b8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: .version_select at 0x7f2af4d9bdc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-366056228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGSdsjXWrLjrsE209I1ucNHiDH0Vp85ZSFfeVkXIsQ/2MIIzSrqhZFPfPzHEmp1V+pV/gfJ+rr18hG5prfkvX8SU4l+8SdpYxNOhv19UHOHQ5xhKvekRjTNB7d8PN+BXA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:38.974255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-25fe9508-968c-41cb-b7bb-f37a93a1a0b8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:14:38.980772 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-25fe9508-968c-41cb-b7bb-f37a93a1a0b8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:14:39.006953 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-25fe9508-968c-41cb-b7bb-f37a93a1a0b8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059026 Oct 19 02:14:39.007581 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3768/7413] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:14:38 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:14:44.472190 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:44.476433 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1457003254", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "networks": [{"uuid": "6297ac4e-effd-4b4d-9161-db7cc46d2b29"}], "key_name": "tempest-TestNetworkAdvancedServerOps-366056228", "security_groups": [{"name": "tempest-secgroup-smoke-1895018353"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:44.593801 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] validate_networks() for [('6297ac4e-effd-4b4d-9161-db7cc46d2b29', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:14:45.058682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:14:45.060843 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:14:45.061469 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:14:45.061953 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:14:45.062451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:14:45.072184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:45.072729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:45.073176 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:45.073918 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:45.074379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:45.074812 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:45.102498 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:14:45.108339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Getting quotas for user 02f03048cac8457e9a3a278df65f19f4 and project 4030669e64c14c27af306c4582fc5ede. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:14:45.122232 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:14:45.124614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:14:45.182463 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bb9c8312-c540-48d1-a469-02f9ef805043 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711916 Oct 19 02:14:45.183157 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3646/7414] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:14:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:14:45.195178 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-3d85fd3a-bc38-42aa-bb4d-22487b6f8886 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:45.198548 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-3d85fd3a-bc38-42aa-bb4d-22487b6f8886 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:45.203193 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=20 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:45.302497 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-3d85fd3a-bc38-42aa-bb4d-22487b6f8886 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:45.310618 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-3d85fd3a-bc38-42aa-bb4d-22487b6f8886 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1266 microversion: 2.1 time: 0.119551 Oct 19 02:14:45.317454 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3769/7415] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:45 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:46.344216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:46.345607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:46.357025 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:46.357605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:46.358139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:46.358884 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:46.359368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:46.359786 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:46.428881 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:46.437856 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8adea36-7acf-4161-94f4-993eba62f32f tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1318 microversion: 2.1 time: 0.098387 Oct 19 02:14:46.438553 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3647/7416] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:46 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:47.463388 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:47.464037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:47.487911 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:47.488845 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:47.489892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:47.490291 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:47.490776 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:47.491273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:47.809105 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:47.817519 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7998c05f-c59f-4b8e-8253-652f1d577496 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.358775 Oct 19 02:14:47.818409 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3770/7417] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:47 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:48.248141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41bb1002-8ec8-4f62-9ea4-9da143e39ae7", "tag": "bd0cf86b-a66e-4f9f-a08d-a668d5612a08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:48.269404 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:48.269900 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:48.270336 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:48.282354 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] Creating event network-changed:bd0cf86b-a66e-4f9f-a08d-a668d5612a08 for instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 on n-h1-master-1 Oct 19 02:14:48.287719 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-af488ac1-ab2e-47cd-a835-6ff46a00dea1 req-09aadb16-b96d-4b7d-b8b1-95a944c844a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043651 Oct 19 02:14:48.288489 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3648/7418] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:14:48.843978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:48.844643 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:48.852439 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:48.853124 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:48.853602 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:48.854331 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:48.854810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:48.855263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:48.986824 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:48.994730 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-52a9d802-f3a1-46e9-999c-069becd698d9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.155230 Oct 19 02:14:48.995340 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3771/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:48 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:50.019870 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:50.020587 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:50.026953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:50.027448 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:50.027899 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:50.028603 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:50.029099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:50.029534 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:50.239476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:50.247189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d262b94-2f06-46d5-b627-f1508ef472e3 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.232511 Oct 19 02:14:50.247787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3649/7420] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:50 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:51.270284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:51.270918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:51.277900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:51.278399 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:51.278856 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:51.279565 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:51.280042 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:51.280487 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:51.419628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:51.427389 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2cf33ba-f4ff-490c-a855-51f1e51d5470 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.161065 Oct 19 02:14:51.428081 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3772/7421] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:51 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:52.452653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:52.453338 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:52.460298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:52.460955 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:52.461412 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:52.462146 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:52.462596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:52.463033 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:52.595655 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:52.603324 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ecd6044b-4a67-49fb-9698-8aeb7012cad8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.154715 Oct 19 02:14:52.603896 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3650/7422] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:52 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:53.627445 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:53.628087 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:53.636115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:53.636638 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:53.637101 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:53.637819 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:53.638296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:53.638745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:53.774965 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:53.782791 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-41ec54f3-1c21-434e-90cc-fe57aa106a02 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.159370 Oct 19 02:14:53.783412 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3773/7423] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:53 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:54.810893 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:54.811599 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:54.820104 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:54.820589 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:54.821236 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:54.822749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:54.823363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:54.823809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:54.978829 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:54.986803 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5a955ce7-45cc-4924-ab70-ad00a5dc4dfb tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.184625 Oct 19 02:14:54.987398 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3651/7424] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:54 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:55.390687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41bb1002-8ec8-4f62-9ea4-9da143e39ae7", "name": "network-vif-plugged", "status": "completed", "tag": "bd0cf86b-a66e-4f9f-a08d-a668d5612a08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:55.397386 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:55.398074 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:55.412594 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:55.413122 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:55.413577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:55.426200 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] Creating event network-vif-plugged:bd0cf86b-a66e-4f9f-a08d-a668d5612a08 for instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 on n-h1-master-1 Oct 19 02:14:55.431525 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-b7f52c85-2388-40d0-b0f8-2c3c4294a157 req-710e6184-8c7e-48e9-977a-575e4891ccce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044511 Oct 19 02:14:55.432143 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3774/7425] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:14:56.014233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:56.014794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:56.016798 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:56.017477 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:14:56.025637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:56.026215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:56.026777 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:56.027490 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:56.027949 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:56.028378 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:56.160544 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:56.168581 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-21d6948a-2dd2-4670-911e-22b9d8d887a9 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1392 microversion: 2.1 time: 0.158649 Oct 19 02:14:56.169189 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3652/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:56 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:57.194040 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:57.194771 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:57.201613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:57.202125 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:57.202591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:57.203312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:57.203794 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:57.204244 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:57.338932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:57.346850 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-757366a1-6f61-403d-8c97-b6f65da24d3d tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1563 microversion: 2.1 time: 0.158291 Oct 19 02:14:57.347431 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3775/7427] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:57 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:57.369876 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:57.370436 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:57.377299 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:57.377795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:57.378253 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:57.378964 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:57.379430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:57.379869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:57.519861 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:57.528303 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c27462d4-a5f3-4344-abd2-f0f7ba9986fd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1563 microversion: 2.1 time: 0.162544 Oct 19 02:14:57.528923 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3653/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:57 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:14:59.447478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:14:59.448221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:14:59.448362 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41bb1002-8ec8-4f62-9ea4-9da143e39ae7", "tag": "bd0cf86b-a66e-4f9f-a08d-a668d5612a08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:14:59.455506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:59.456108 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:59.456655 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:59.457650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:59.458201 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:59.458901 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:59.460128 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:14:59.460642 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:14:59.461094 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:14:59.473587 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] Creating event network-changed:bd0cf86b-a66e-4f9f-a08d-a668d5612a08 for instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 on n-h1-master-1 Oct 19 02:14:59.478971 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-05307f76-da06-4a2b-b7bc-e15b2c474faf req-f253fea2-27dc-4cb9-8180-22fbda219aab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034829 Oct 19 02:14:59.479660 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3654/7429] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:14:59.685968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:14:59.694407 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ad91dc83-aa08-4dd9-aa54-0563a5d7bfe0 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1563 microversion: 2.1 time: 0.252331 Oct 19 02:14:59.695157 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3776/7430] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:14:59 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:23.018633 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:23.019464 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=42 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:23.023856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:23.026759 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:23.034095 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:23.034592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:23.035043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:23.035749 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:23.036217 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:23.036678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:23.109128 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f71a8524-f951-4f2e-8b38-9cb7c31f56ac tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action" status: 200 len: 24568 microversion: 2.1 time: 0.092214 Oct 19 02:15:23.116171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3655/7431] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:15:23 2022] POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:15:33.986126 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:33.986678 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:33.989011 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:33.989793 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=38 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:33.996036 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:33.996528 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:33.997007 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:33.997719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:33.998189 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:33.998633 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:34.022080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lazy-loading 'flavor' on Instance uuid 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:15:34.092791 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a0f3cf69-a493-4be9-a46c-56aa78646f25 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.110689 Oct 19 02:15:34.093509 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3777/7432] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:15:33 2022] POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:15:34.104384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:34.105395 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:34.109719 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=4 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:34.110522 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:34.116235 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:34.116762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:34.117215 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:34.118130 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:34.118602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:34.119039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:34.259409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:34.267468 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1135d739-9236-4a5e-9a09-f0feb67c5a7c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1689 microversion: 2.1 time: 0.169445 Oct 19 02:15:34.268052 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3656/7433] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:34 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:35.294443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:35.295174 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:35.301590 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:35.302038 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:35.302503 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:35.303222 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:35.303699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:35.304166 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:35.437437 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:35.445629 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b2f2aec7-2cec-4db3-9c06-c33955e99c81 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1672 microversion: 2.1 time: 0.156900 Oct 19 02:15:35.446215 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3778/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:35 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:36.543965 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:36.546229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:36.554230 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.554726 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.555194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.555880 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.556348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.557554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.638339 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f968de9-5d18-41d9-b674-081cee90f89a tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action" status: 200 len: 37267 microversion: 2.1 time: 0.098634 Oct 19 02:15:36.639255 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3657/7435] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:15:36 2022] POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action => generated 37267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:15:36.650907 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:36.651472 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:36.658853 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.659362 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.659826 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.660550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.661058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.661542 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.728369 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ffd772e0-2c39-4d4e-87d9-146d5fbf3461 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.081254 Oct 19 02:15:36.729086 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3779/7436] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:15:36 2022] POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:15:36.738690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:36.739435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:36.748975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.749473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.749925 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.750813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:36.751295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:36.751730 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:36.932820 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:36.941866 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1cfdd909-a189-443a-884d-658bd9a0d993 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1678 microversion: 2.1 time: 0.207627 Oct 19 02:15:36.942702 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3658/7437] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:36 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:37.968122 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:37.968883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:37.975138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:37.975644 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:37.976105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:37.976851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:37.977337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:37.977789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:38.115319 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:38.123442 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e6152384-0cef-48f9-8801-6e2cf02a0ed5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1678 microversion: 2.1 time: 0.161489 Oct 19 02:15:38.124015 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3780/7438] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:37 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:39.147508 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:39.148141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:39.155813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:39.156309 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:39.156796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:39.157503 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:39.157967 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:39.158407 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:39.300124 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:39.308036 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2e9fe315-6305-4475-8df8-16e4041d65a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1681 microversion: 2.1 time: 0.164411 Oct 19 02:15:39.308546 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3659/7439] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:39 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:39.408932 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:39.411204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:39.418067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:39.418571 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:39.419413 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:39.420262 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:39.420791 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:39.421236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:39.484413 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9a69e70c-a5b9-4d52-bdb5-2bbe91cfa4a8 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action" status: 200 len: 37267 microversion: 2.1 time: 0.079334 Oct 19 02:15:39.485127 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3781/7440] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:15:39 2022] POST /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7/action => generated 37267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 19 02:15:40.475617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:40.476118 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:40.483960 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:40.484934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:40.485646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:40.485789 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41bb1002-8ec8-4f62-9ea4-9da143e39ae7", "tag": "bd0cf86b-a66e-4f9f-a08d-a668d5612a08"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:40.486732 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:40.486915 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:40.487471 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:40.496695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:40.497332 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:40.497839 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:40.513542 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] Creating event network-changed:bd0cf86b-a66e-4f9f-a08d-a668d5612a08 for instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 on n-h1-master-1 Oct 19 02:15:40.518764 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-5e24234e-cb7d-42b5-a91a-29936ec30ddb req-8ce1cac8-ccf2-4301-9288-4dfe78f130b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037645 Oct 19 02:15:40.519583 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3782/7441] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:15:40.519723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:15:40.610330 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a5ce01da-60ca-4f5b-a297-20c27e3dee67 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 204 len: 0 microversion: 2.1 time: 0.137783 Oct 19 02:15:40.611441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3660/7442] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:15:40 2022] DELETE /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:15:40.620204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:40.621001 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:40.628258 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:40.628808 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:40.629268 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:40.629994 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:40.630699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:40.631149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:40.773561 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:40.781668 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4776fb9b-466d-49a5-af3b-b6a17342296c tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1687 microversion: 2.1 time: 0.165602 Oct 19 02:15:40.782251 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3783/7443] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:40 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:41.807467 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:41.808094 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:41.815338 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:41.815832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:41.816284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:41.817026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:41.817494 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:41.817931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:41.951622 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:41.959450 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-41ee16f9-83f7-45cc-85f1-f83184805969 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1687 microversion: 2.1 time: 0.156380 Oct 19 02:15:41.960029 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3661/7444] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:41 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:42.986571 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:42.987249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:42.994257 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:42.994780 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:42.995374 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:42.996369 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:42.996987 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:42.997769 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:43.109735 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02f03048cac8457e9a3a278df65f19f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030669e64c14c27af306c4582fc5ede', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:15:43.118053 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8c6bceaa-9b06-40eb-b62d-438370a87dfd tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 200 len: 1501 microversion: 2.1 time: 0.137167 Oct 19 02:15:43.118643 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3784/7445] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:42 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 1501 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:15:43.159135 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41bb1002-8ec8-4f62-9ea4-9da143e39ae7", "name": "network-vif-deleted", "tag": "bd0cf86b-a66e-4f9f-a08d-a668d5612a08"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:43.169991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:43.170473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:43.170909 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:43.182483 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] Creating event network-vif-deleted:bd0cf86b-a66e-4f9f-a08d-a668d5612a08 for instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 on n-h1-master-1 Oct 19 02:15:43.188760 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-5c380b47-254c-4115-9ec1-9d7456236db4 req-bdd2ea87-7139-4156-b11a-8c552933bb72 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033950 Oct 19 02:15:43.189835 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3662/7446] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:15:44.142135 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:44.142781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] [instance: 41bb1002-8ec8-4f62-9ea4-9da143e39ae7] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:15:44.150027 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:44.150533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:44.151005 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:44.151728 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:15:44.152207 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:15:44.153360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:15:44.167345 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] HTTP exception thrown: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Request method failure captured: Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 HTTP/1.1 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1v3zbrHIvomC6-n6b2XRj89g0swbPF3WaWxEB5siOpkkxwOIBpVc-UYlwyh8DOji5CgNIiqwbcx-O4bHkWAh423kBLdJGvhW8rnaJDb7XlCe3m85AYM0oOqSOURx5ofAjBbabKXOPzVwKRNYJ52H5NW2Z6YNS0Z-ApFy7gJCbaFydU Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4030669e64c14c27af306c4582fc5ede", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4030669e64c14c27af306c4582fc5ede"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4030669e64c14c27af306c4582fc5ede"}]}] Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 4030669e64c14c27af306c4582fc5ede Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1837362859 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 02f03048cac8457e9a3a278df65f19f4 Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1837362859-project Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '41bb1002-8ec8-4f62-9ea4-9da143e39ae7'} Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:15:44.169221 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Returning 404 to user: Instance 41bb1002-8ec8-4f62-9ea4-9da143e39ae7 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-439178ba-cbb3-4f79-9086-d204d66766f5 tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7" status: 404 len: 111 microversion: 2.1 time: 0.032611 Oct 19 02:15:44.174910 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3785/7447] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:15:44 2022] GET /compute/v2.1/servers/41bb1002-8ec8-4f62-9ea4-9da143e39ae7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:15:47.531452 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-af986b87-b272-4a7b-8893-931bbb3f65ba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] Calling method '.version_select at 0x7f2af4341e50>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:15:47.555962 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-af986b87-b272-4a7b-8893-931bbb3f65ba tempest-TestNetworkAdvancedServerOps-1837362859 tempest-TestNetworkAdvancedServerOps-1837362859-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-366056228" status: 202 len: 0 microversion: 2.1 time: 0.029274 Oct 19 02:15:47.564984 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3663/7448] 10.222.0.27 () {58 vars in 1281 bytes} [Wed Oct 19 02:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-366056228 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:15:58.899375 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=18 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:58.900128 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:15:59.081137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a883bbaf-7fc3-4bc7-914b-ed292c317a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'create', calling method: .version_select at 0x7f2af4322670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1116194459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWP2LIx7KFbik3C2yQO8ydKel60/CBwlyWQqvC8EmPEinEBUHvbmu07gWZSoGzcVcdAdkoXiCCFsr7j1mcnMjLPdielsdDQwjouJF+ULYquo/jxjFvoX9zGhySHYRyZfA=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:15:59.103041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a883bbaf-7fc3-4bc7-914b-ed292c317a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:15:59.109284 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-a883bbaf-7fc3-4bc7-914b-ed292c317a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for user 4ea84bfb9df044fdadd880ed8260c393 and project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:15:59.136600 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a883bbaf-7fc3-4bc7-914b-ed292c317a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.243048 Oct 19 02:15:59.137421 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3786/7449] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:15:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:16:00.125968 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:00.126865 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:00.131121 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-128276548", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1116194459", "security_groups": [{"name": "tempest-secgroup-smoke-922075022"}], "networks": [{"uuid": "0f35d1c2-e21b-40e9-b726-087d6c6a32ff"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:16:00.241206 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] validate_networks() for [('0f35d1c2-e21b-40e9-b726-087d6c6a32ff', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:16:00.963339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:16:00.963781 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:16:00.964273 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:16:00.964726 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:16:00.965628 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:16:00.974328 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:00.974824 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:00.975371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:00.976159 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:00.976848 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:00.977368 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:00.995975 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:16:01.002038 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for user 4ea84bfb9df044fdadd880ed8260c393 and project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:16:01.014752 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:16:01.017249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:16:01.071221 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3d4f2851-2922-45da-b3e3-29c111f89edc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.947059 Oct 19 02:16:01.072076 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3664/7450] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:16:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:16:01.086103 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ed85e8e5-1165-4cdd-b670-0eefdc3cc0c7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:01.087509 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ed85e8e5-1165-4cdd-b670-0eefdc3cc0c7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:01.168640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ed85e8e5-1165-4cdd-b670-0eefdc3cc0c7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:01.175688 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ed85e8e5-1165-4cdd-b670-0eefdc3cc0c7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1246 microversion: 2.1 time: 0.095093 Oct 19 02:16:01.176460 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3787/7451] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:01 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:02.200603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:02.201268 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:02.208876 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:02.209380 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:02.209822 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:02.210528 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:02.211008 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:02.211442 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:02.276900 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:02.285573 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-db73729d-707f-4ec4-993e-881d3958f2a9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1298 microversion: 2.1 time: 0.089974 Oct 19 02:16:02.286170 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3665/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:02 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:03.312056 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:03.312918 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:03.320240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:03.320796 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:03.321263 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:03.322004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:03.322486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:03.322937 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:03.548188 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:03.556601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a421412b-3dbd-4f5b-9d7b-1d7c7da0a7c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.251184 Oct 19 02:16:03.557225 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3788/7453] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:03 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:04.173312 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:16:04.184393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:04.184902 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:04.185337 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:04.197230 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] Creating event network-changed:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:16:04.202441 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e28707a0-0254-4caa-8242-51ae8205f7a0 req-d1563fc5-25aa-48ec-bd78-b9a8b559530f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114681 Oct 19 02:16:04.203048 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3666/7454] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:16:04.581439 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:04.581976 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:04.584440 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:16:04.584657 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:16:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 (ip 10.222.0.27) !!! Oct 19 02:16:04.593360 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:04.593872 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:04.594358 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:04.595142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:04.595612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:04.596115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:04.734077 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:04.742010 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-568e923e-091b-4367-9a93-580ad01c029d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.164646 Oct 19 02:16:04.742591 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3789/7455] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:04 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:16:05.767394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:05.768504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:05.775637 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:05.776131 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:05.776581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:05.777393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:05.778012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:05.778446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:05.991242 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:05.999583 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f4cb2020-540c-4748-a1c4-3d6bb10f7bb0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.236680 Oct 19 02:16:06.000171 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3667/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:05 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:16:07.023734 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:07.024378 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:07.031928 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:07.032435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:07.032930 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:07.033653 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:07.034130 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:07.034582 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:07.171656 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:07.179892 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9d2c386a-1951-4baf-a3b4-1f10788e23c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.160077 Oct 19 02:16:07.180734 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3790/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:07 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:08.206590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:08.207229 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:08.213838 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:08.214332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:08.215633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:08.216359 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:08.216855 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:08.217295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:08.356936 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:08.364836 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-de90f08d-791b-4a87-9266-9e97c48994c9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.164105 Oct 19 02:16:08.365433 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3668/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:08 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:09.389296 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:09.389944 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:09.397121 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:09.397630 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:09.398098 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:09.398815 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:09.399293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:09.399745 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:09.536304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:09.544917 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fc93c430-6438-48fd-a2ae-f71a737fddfe tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.159927 Oct 19 02:16:09.545509 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3791/7459] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:09 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:10.007566 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "name": "network-vif-plugged", "status": "completed", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:16:10.018810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:10.019306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:10.019745 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:10.031530 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] Creating event network-vif-plugged:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:16:10.036596 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4f13a0c4-b795-4e2b-96f0-ce5036fa0209 req-dc25e118-6a32-47d2-8e06-49960679fbdf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091141 Oct 19 02:16:10.037238 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3669/7460] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:16:10.568273 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:10.568940 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:10.575998 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:10.576497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:10.576973 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:10.577704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:10.578172 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:10.578613 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:10.713609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:10.721486 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2cebe9f2-4a97-47ec-bae6-173e1d674c81 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1371 microversion: 2.1 time: 0.157438 Oct 19 02:16:10.722059 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3792/7461] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:10 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:11.746583 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:11.747262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:11.750084 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:11.750773 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:11.758016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:11.758507 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:11.758953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:11.759653 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:11.760116 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:11.760555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:11.895403 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:11.903353 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a25d560c-88d3-406b-80bb-087d548e781a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1554 microversion: 2.1 time: 0.161683 Oct 19 02:16:11.903937 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3670/7462] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:11 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:11.926214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:16:11.926855 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:16:11.928752 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:16:11.936104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:11.936609 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:11.937104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:11.937831 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:11.938310 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:11.938763 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:12.073715 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:16:12.081595 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-163ea62a-19d2-48e0-9a70-e29154b7c03c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1554 microversion: 2.1 time: 0.159365 Oct 19 02:16:12.082199 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3793/7463] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:16:11 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:16:13.752353 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:16:13.762904 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:16:13.763393 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:16:13.764072 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:16:13.775395 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] Creating event network-changed:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:16:13.781224 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9dbae5d2-ba4f-44ce-b2da-6cb8862e5cf1 req-d6f93711-869e-4d9b-a34a-d63aa31a2e20 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032631 Oct 19 02:16:13.781826 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3671/7464] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:18:11.238039 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:11.238939 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=36 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:11.239694 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:18:11.239877 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action (ip 10.222.0.27) !!! Oct 19 02:18:11.240836 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:18:11.241018 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action (ip 10.222.0.27) !!! Oct 19 02:18:11.246353 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:18:11.246909 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:11.257008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:11.257501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:11.257950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:11.258651 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:11.259118 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:11.259557 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:11.284281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lazy-loading 'flavor' on Instance uuid 9e796cc0-5527-490d-83e7-f93fe431a1d6 {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:18:11.477024 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-db62bcde-5c44-47fb-a13d-a6fdd7625d0e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action" status: 202 len: 0 microversion: 2.1 time: 0.240691 Oct 19 02:18:11.477633 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3794/7465] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:18:11 2022] POST /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:18:11.484565 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:18:11.486690 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 02:18:11.487310 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:11.488068 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=32 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:11.489379 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:18:11.489530 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 (ip 10.222.0.27) !!! Oct 19 02:18:11.496692 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:11.497412 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:11.508700 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:11.509201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:11.509658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:11.510370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:11.510837 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:11.511278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:11.650235 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:11.658679 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b8306454-0562-4dbf-95ef-2270ee305a36 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.176526 Oct 19 02:18:11.659263 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3672/7466] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:11 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:12.684481 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:12.685257 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:12.692895 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:12.693403 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:12.693863 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:12.694581 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:12.695065 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:12.695511 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:12.828708 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:12.836524 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c47d7c52-0086-4e0d-a2ec-fff44ae76f72 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.157558 Oct 19 02:18:12.837135 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3795/7467] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:12 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:13.861669 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:13.862293 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:13.875984 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:13.876481 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:13.876957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:13.877668 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:13.878138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:13.878574 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:13.885948 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 43944. Oct 19 02:18:13.887096 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 43942. Oct 19 02:18:14.015500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:14.024322 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-04798aed-8c96-4be8-b9ac-6dbf583176fd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.166954 Oct 19 02:18:14.024946 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3673/7468] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:13 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:15.049792 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:15.050962 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:15.057444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:15.057951 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:15.058411 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:15.059139 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:15.059618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:15.060070 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:15.202423 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:15.210268 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ec7f05b2-2857-4d57-822b-c613168578e8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.165251 Oct 19 02:18:15.210851 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3796/7469] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:15 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:16.234513 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:16.235648 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:16.242535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:16.243031 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:16.243473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:16.244180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:16.244736 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:16.245172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:16.430954 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:16.439081 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-967c9abe-0b40-4ac8-a222-b284b78bfd44 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.208405 Oct 19 02:18:16.439654 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3674/7470] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:16 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:17.466214 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:17.467451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:17.475793 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:17.476296 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:17.476788 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:17.477506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:17.477980 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:17.478427 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:17.615844 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:17.623595 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-198a5c27-51a2-4654-b8f8-9b217aa4c21a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.164622 Oct 19 02:18:17.624173 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3797/7471] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:17 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:18.647723 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:18.648346 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:18.655644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:18.656139 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:18.656647 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:18.657354 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:18.657810 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:18.658244 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:18.791505 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:18.799346 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff427cf4-2472-4db2-9491-bb71a55d0993 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.155568 Oct 19 02:18:18.799955 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3675/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:18 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:19.823587 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:19.824229 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:19.831298 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:19.831841 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:19.832412 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:19.833185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:19.833665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:19.834119 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:19.966551 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:19.974599 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0bcf63c6-7eed-46c1-b701-6d33a2fd83b9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.154982 Oct 19 02:18:19.975215 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3798/7473] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:19 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:20.998812 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:20.999435 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:21.007107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:21.007606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:21.008056 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:21.008835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:21.009307 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:21.009748 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:21.144122 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:21.151968 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b510ebf0-3cd7-441c-bb74-d523e79a59d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.157148 Oct 19 02:18:21.152551 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3676/7474] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:20 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:22.176589 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:22.177501 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:22.184281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:22.184824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:22.185283 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:22.186004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:22.186598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:22.187051 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:22.321184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:22.329366 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-598c39e1-f4ca-486e-a499-7c9f03efb82c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.157876 Oct 19 02:18:22.329947 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3799/7475] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:22 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:23.353664 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:23.354292 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:23.361678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:23.362174 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:23.362621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:23.363323 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:23.363795 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:23.364231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:23.499607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:23.508316 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0d0e67e3-1cdd-47b5-ab88-524ac7b8835a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1700 microversion: 2.1 time: 0.158615 Oct 19 02:18:23.508927 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3677/7476] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:23 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:24.532758 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:24.533400 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:24.540431 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:24.540974 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:24.541444 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:24.542164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:24.542643 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:24.543094 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:24.675949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:24.683830 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d37a0030-8919-4d11-97af-5898f2dc1575 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1700 microversion: 2.1 time: 0.155734 Oct 19 02:18:24.684424 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3800/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:24 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:25.707769 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:25.708419 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:25.715986 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:25.716591 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:25.717138 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:25.717863 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:25.718517 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:25.719813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:25.867199 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:25.876372 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3a9127bc-71cc-4133-b9ac-b7cd43609d91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.172870 Oct 19 02:18:25.889157 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3678/7478] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:25 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:26.800235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "name": "network-vif-plugged", "status": "completed", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:18:26.817004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:26.817921 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:26.818618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:26.833205 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] Creating event network-vif-plugged:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:18:26.842374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-4d06a9b0-92d5-4ee7-b492-1da67ffadf55 req-5f1a1ffb-7e77-4856-8e9c-df8be2dd54c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046090 Oct 19 02:18:26.843141 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3801/7479] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:18:26.902012 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:26.902659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:26.911687 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:26.912191 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:26.912661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:26.913373 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:26.914035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:26.914664 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:27.071253 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:27.079792 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-52d8dac5-0638-420d-b110-edd3642eb0c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.181831 Oct 19 02:18:27.080375 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3679/7480] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:26 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:18:28.105512 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:28.106236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:28.113095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:28.113603 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:28.114060 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:28.114775 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:28.115250 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:28.115695 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:28.265860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:28.274054 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2bcf63d7-9a30-403b-b0b7-c7be1393d03f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.173807 Oct 19 02:18:28.274632 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3802/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:28 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:29.299929 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:29.301411 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:29.309584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:29.310370 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:29.310816 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:29.311524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:29.312091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:29.312581 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:29.469699 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:29.479204 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-827dc61c-3860-4b79-a644-1fda91562344 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.183882 Oct 19 02:18:29.480441 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3680/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:29 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:30.503754 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:30.504640 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:30.512304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:30.512946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:30.513486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:30.514312 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:30.515086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:30.516177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:30.667249 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:30.676125 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8b428832-ad02-41b6-a6dd-61512e13b184 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.176316 Oct 19 02:18:30.676997 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3803/7483] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:30 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:31.701286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:31.702542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:31.711001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:31.711771 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:31.712421 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:31.713164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:31.713626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:31.714068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:31.877249 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:31.885973 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cb7cb08c-14f7-40b9-ba8a-f3927ba0c429 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.188934 Oct 19 02:18:31.886563 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3681/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:31 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:32.912577 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:32.914027 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:32.921336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:32.922682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:32.923389 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:32.924264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:32.924777 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:32.925231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:33.074667 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:33.083462 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9041f24c-f7d6-4ec8-9319-ceeeecb97de0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.175254 Oct 19 02:18:33.105321 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3804/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:32 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:34.117931 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:34.118560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:34.127472 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:34.127965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:34.128406 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:34.129347 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:34.130682 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:34.131418 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:34.275524 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:34.283370 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-87e4175a-c28f-45ca-b84b-6c408e02525e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1695 microversion: 2.1 time: 0.174352 Oct 19 02:18:34.283933 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3682/7486] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:34 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:35.308392 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:35.309037 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:35.315742 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:35.316243 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:35.316719 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:35.317435 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:35.317903 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:35.318346 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:35.526693 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:35.534628 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6f1be8a8-b802-4409-a901-9351f02804cc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1677 microversion: 2.1 time: 0.230404 Oct 19 02:18:35.535213 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3805/7487] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:35 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:36.559657 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:36.560262 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:36.567513 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:36.568005 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:36.568473 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:36.569200 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:36.569669 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:36.570109 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:36.708500 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:36.716426 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8822e049-4cfa-402f-bed7-50e25a86279c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1677 microversion: 2.1 time: 0.160808 Oct 19 02:18:36.717045 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3683/7488] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:36 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:37.741723 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:37.742274 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:37.749142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:37.749645 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:37.750797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:37.751530 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:37.752008 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:37.752459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:37.893985 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:37.901926 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-7f5d4998-0750-42d7-83b2-80bb0318ecd6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1680 microversion: 2.1 time: 0.164247 Oct 19 02:18:37.902523 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3806/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:37 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:37.927051 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:18:37.927653 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:37.934552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:37.935045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:37.935493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:37.936194 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:37.936677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:37.937118 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:38.023476 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 02:18:38.094947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4b500c5d-67bf-4f15-8f0c-1339074051bd tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action" status: 202 len: 0 microversion: 2.1 time: 0.171707 Oct 19 02:18:38.095591 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3684/7490] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:18:37 2022] POST /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 19 02:18:38.103922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:38.104574 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:38.110744 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:38.111256 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:38.111795 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:38.112525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:38.113219 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:38.113672 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:38.255834 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:38.263995 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f38eb305-c20a-43ac-a540-64360892a591 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1628 microversion: 2.1 time: 0.164135 Oct 19 02:18:38.264683 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3807/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:38 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1628 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:38.809354 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "name": "network-vif-unplugged", "status": "completed", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:18:38.821071 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:38.821711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:38.822298 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:38.834967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_external_events [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] Unable to find a host for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6. Dropping event network-vif-unplugged {{(pid=131450) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 02:18:38.836028 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-4a692d32-2644-4311-82c3-2b9a5219eed7 req-f14356eb-6e4c-413a-bffe-19520d3c5e4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031268 Oct 19 02:18:38.837060 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3685/7492] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 02:18:39.289294 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:39.289937 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:39.297190 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:39.297689 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:39.298142 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:39.298847 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:39.299337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:39.299782 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:39.433840 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:39.442429 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2b508688-1b4f-4edc-8833-0561ac3c6593 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.157044 Oct 19 02:18:39.443243 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3808/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:39 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:40.466660 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:40.467374 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:40.475332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:40.475834 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:40.476286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:40.477041 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:40.477543 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:40.478017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:40.662716 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:40.674788 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-b4c92634-49a1-4b2e-bcd4-78699761bf46 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.212122 Oct 19 02:18:40.675570 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3686/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:40 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:41.699425 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:41.700132 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:41.703632 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=31 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:41.709458 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:41.710058 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:41.710585 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:41.711372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:41.711913 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:41.712428 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:41.715447 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:41.866080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:41.875607 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b6e09364-d261-405f-8fe6-12f0fc37e09a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.179403 Oct 19 02:18:41.877882 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3809/7495] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:41 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:42.901423 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:42.902083 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:42.904767 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:42.912279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:42.912927 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:42.913429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:42.914142 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:42.914607 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:42.915238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:42.919084 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:18:43.069448 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:43.078255 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e929110b-80b1-4d7b-84aa-789cf2605e4f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.180254 Oct 19 02:18:43.078978 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3687/7496] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:42 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:44.102691 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:44.103451 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:44.111620 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:44.112600 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:44.113337 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:44.114328 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:44.115031 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:44.115759 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:44.282035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:44.290232 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-676aba79-087d-493f-9815-a02d0bbab19a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.191587 Oct 19 02:18:44.290820 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3810/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:44 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:45.316564 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:45.317339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:45.323978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:45.324469 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:45.324978 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:45.325711 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:45.326165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:45.326592 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:45.472491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:45.480442 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e39060e8-bde7-4bbb-bf9b-d86a609bf481 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.169267 Oct 19 02:18:45.481294 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3688/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:45 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:46.503717 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:46.504357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:46.511766 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:46.512281 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:46.512828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:46.513616 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:46.514230 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:46.514707 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:46.655505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:46.666000 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-892697c5-9fb6-4d90-b9c0-3184060c84d5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.166020 Oct 19 02:18:46.667211 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3811/7499] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:46 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:47.693261 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:47.693949 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:47.700155 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:47.700584 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:47.701067 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:47.701782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:47.702251 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:47.702690 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:47.850960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:47.860653 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-929589cb-fe7d-4271-932e-55dd2341ea5f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.172651 Oct 19 02:18:47.861618 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3689/7500] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:47 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:48.887426 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:48.887992 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:48.896144 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:48.896669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:48.897133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:48.897850 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:48.898654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:48.899104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:49.033576 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:49.041661 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e85969e8-b1ab-46ef-8b13-ea6a3a70ff39 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.158247 Oct 19 02:18:49.042240 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3812/7501] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:48 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:50.066089 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:50.066928 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:50.074115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:50.074613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:50.075102 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:50.075814 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:50.076278 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:50.076738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:50.211361 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:50.219325 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-47461b53-c122-4b43-85cb-8947dc9e00e4 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.157599 Oct 19 02:18:50.219906 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3690/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:50 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:51.243190 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:51.243820 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:51.250814 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:51.251409 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:51.251862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:51.252564 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:51.253062 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:51.253501 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:51.383966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:51.392504 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6d39bbfd-356d-470d-af89-70dc09b2482b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.153267 Oct 19 02:18:51.393106 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3813/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:51 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:52.416606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:52.417247 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:52.424339 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:52.424862 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:52.425302 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:52.425998 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:52.426456 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:52.426882 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:52.562576 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:52.571312 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f25349c-8aa3-4465-ba6f-c8e8622f6c0a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.158585 Oct 19 02:18:52.571893 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3691/7504] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:52 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:53.596358 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:53.596949 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:53.604941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:53.605667 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:53.606260 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:53.606989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:53.607470 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:53.607920 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:53.739823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:53.747601 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-c9b26edc-551a-46a5-8838-2d8a16006b7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.156404 Oct 19 02:18:53.748180 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3814/7505] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:53 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:54.772195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:54.772822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:54.779627 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:54.780113 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:54.780552 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:54.781274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:54.781757 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:54.782195 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:54.918978 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:54.927056 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0233addf-ad3a-4096-994d-7a5f436183f8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.158742 Oct 19 02:18:54.927639 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3692/7506] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:54 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:54.951276 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "name": "network-vif-plugged", "status": "completed", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:18:54.962548 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:54.963052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:54.963506 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:54.978245 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] Creating event network-vif-plugged:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:18:54.983901 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-11917209-37da-4e13-a370-dddaa4c03366 req-439e47e0-a4a6-4b11-8385-a32483cdfa24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036721 Oct 19 02:18:54.984521 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3815/7507] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:18:55.951567 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:55.952201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:55.959689 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:55.960180 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:55.960644 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:55.961357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:55.961826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:55.962272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:56.097709 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:56.105525 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-92e9df2f-d2e2-4b5f-a4ea-ae46a2dce514 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1686 microversion: 2.1 time: 0.157935 Oct 19 02:18:56.106127 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3693/7508] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:55 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:18:57.131716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:18:57.132496 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:18:57.138730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:57.139229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:57.139732 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:57.140424 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:18:57.142216 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:18:57.142731 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:18:57.279605 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:18:57.287904 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-72954949-d881-4c45-9276-520503275bdb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1673 microversion: 2.1 time: 0.162433 Oct 19 02:18:57.288554 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3816/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:18:57 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:14.001710 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=13 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:14.003274 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=41 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:14.003951 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:20:14.004106 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:20:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 (ip 10.222.0.27) !!! Oct 19 02:20:14.010610 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:14.015897 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=15 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:14.016583 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=43 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:14.022702 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:14.023216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:14.029736 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:20:14.029904 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:20:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 02:20:14.039949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:14.040448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:14.040932 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:14.048279 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:14.049695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:14.050608 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:14.051332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:14.051983 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:14.052228 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:14.066215 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] Creating event network-changed:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:20:14.071730 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-f0474dc9-fffb-48a4-b97a-c5c47e502d89 req-88b087cc-78bb-4c75-bdfa-d6885bee7139 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065665 Oct 19 02:20:14.072726 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3817/7510] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:20:14.079659 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:20:14.178646 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d421cc86-9c60-420a-998a-e6849882837b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 204 len: 0 microversion: 2.1 time: 0.177965 Oct 19 02:20:14.180607 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3694/7511] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:20:13 2022] DELETE /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:20:14.191198 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:14.192204 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:14.198473 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:14.198971 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:14.199423 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:14.200138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:14.200604 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:14.201075 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:14.402683 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:14.411242 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-441400ca-edb2-4868-a42c-559d3d3c3ed3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.225798 Oct 19 02:20:14.411828 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3818/7512] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:14 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:15.435875 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:15.436577 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:15.443897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:15.444379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:15.444847 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:15.445545 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:15.446001 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:15.446430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:15.644690 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:15.652824 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-834827e4-dc5d-482b-8932-db6e64996cb1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1679 microversion: 2.1 time: 0.221180 Oct 19 02:20:15.653601 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3695/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:15 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1679 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:16.538048 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e796cc0-5527-490d-83e7-f93fe431a1d6", "name": "network-vif-deleted", "tag": "aa3f0ce0-5dce-4922-a721-f50b1c34876a"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:16.549224 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:16.549739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:16.550198 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:16.561300 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] Creating event network-vif-deleted:aa3f0ce0-5dce-4922-a721-f50b1c34876a for instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 on n-h1-master-1 Oct 19 02:20:16.567197 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-410f4da0-1ddc-47a1-9f51-0e1943e48b16 req-5d184a69-0325-4c61-9c0b-9920de563082 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033025 Oct 19 02:20:16.567982 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3819/7514] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:20:16.678601 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:16.679279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:16.686585 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:16.687678 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:16.688389 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:16.689137 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:16.690332 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:16.690804 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:16.724261 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:16.724779 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:16.725223 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:16.725682 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lazy-loading 'fault' on Instance uuid 9e796cc0-5527-490d-83e7-f93fe431a1d6 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:20:16.770430 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:16.778232 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ff8fb09-64b2-4960-93de-946ca0d385f6 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 200 len: 1336 microversion: 2.1 time: 0.104673 Oct 19 02:20:16.778807 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3696/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:16 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:17.802906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:17.803545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 9e796cc0-5527-490d-83e7-f93fe431a1d6] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:17.810068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:17.810577 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:17.811063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:17.811781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:17.812282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:17.812792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:17.827399 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] HTTP exception thrown: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Request method failure captured: Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 HTTP/1.1 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT13ZpG5qRowfnzRRlCrGvJCrfxmrwQPrPKwPGwrm1xFnvj0PuQpnDnP5fxTJ9NHLvUxwWdM_QbHJZh2-TjQ4QRZoNy4w0gHO-BeNKdh-jH-fjdYFWGgr0I8WCHSD4MTUk0Vks-xvuverI7fTLlPFid1e5yTHVFjw0cdpIdcAIgwcV0k Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 6ce5fe85f8b94c92b72fe172eb024b60 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestShelveInstance-2096950632 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6ce5fe85f8b94c92b72fe172eb024b60", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ce5fe85f8b94c92b72fe172eb024b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6ce5fe85f8b94c92b72fe172eb024b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ce5fe85f8b94c92b72fe172eb024b60"}]}] Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestShelveInstance-2096950632 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 6ce5fe85f8b94c92b72fe172eb024b60 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestShelveInstance-2096950632 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestShelveInstance-2096950632-project Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4ea84bfb9df044fdadd880ed8260c393 Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestShelveInstance-2096950632-project Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '9e796cc0-5527-490d-83e7-f93fe431a1d6'} Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:20:17.829096 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Returning 404 to user: Instance 9e796cc0-5527-490d-83e7-f93fe431a1d6 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1d7a1d73-b61f-47fe-906e-13510cf1ce6c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6" status: 404 len: 111 microversion: 2.1 time: 0.034045 Oct 19 02:20:17.836041 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3820/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:17 2022] GET /compute/v2.1/servers/9e796cc0-5527-490d-83e7-f93fe431a1d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:20:17.993451 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-49df7710-c9b5-4ee2-a959-d013519f33d7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '.version_select at 0x7f2af43b2a60>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:18.019621 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-49df7710-c9b5-4ee2-a959-d013519f33d7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1116194459" status: 202 len: 0 microversion: 2.1 time: 0.029970 Oct 19 02:20:18.020537 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3697/7517] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 02:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1116194459 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:20:18.041316 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-07a4a0c0-90d0-46a9-9345-db26d781e5ac tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'create', calling method: .version_select at 0x7f2aec2a33a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1051000445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTKfO+EUSvxut5ZCf+pYh6mCCcGRNim60BCetCqq8mjG74dBSgRnZk4sUdILYwqIK+lgqEThId79GADs2GsTy4cOq5OrYg4/gxr6UAzI235GhQx2aZXCgqct28XIJ7wvg=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:18.057469 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-07a4a0c0-90d0-46a9-9345-db26d781e5ac tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:20:18.062491 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-07a4a0c0-90d0-46a9-9345-db26d781e5ac tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for user 4ea84bfb9df044fdadd880ed8260c393 and project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:20:18.091990 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-07a4a0c0-90d0-46a9-9345-db26d781e5ac tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054456 Oct 19 02:20:18.092636 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3821/7518] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:20:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:20:34.282577 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:34.283335 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:34.287938 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1202290633", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1051000445", "security_groups": [{"name": "tempest-secgroup-smoke-96446150"}], "networks": [{"uuid": "0f35d1c2-e21b-40e9-b726-087d6c6a32ff"}], "block_device_mapping_v2": [{"uuid": "69e53797-e9d1-418a-b514-7e5626354204", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:34.403553 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] validate_networks() for [('0f35d1c2-e21b-40e9-b726-087d6c6a32ff', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:20:34.773930 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:20:34.774384 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:20:34.774914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:20:34.775408 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:20:34.775822 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:20:34.784599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:34.785107 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:34.785554 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:34.786283 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:34.786737 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:34.787165 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:34.804542 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:20:34.809852 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Getting quotas for user 4ea84bfb9df044fdadd880ed8260c393 and project 6ce5fe85f8b94c92b72fe172eb024b60. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:20:34.867590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:20:34.870233 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69e53797-e9d1-418a-b514-7e5626354204',volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:20:34.996499 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2b3ff288-d61d-44da-953c-05e5f4b3028a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715697 Oct 19 02:20:34.997194 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3698/7519] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:20:34 2022] POST /compute/v2.1/servers => generated 404 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:20:35.009065 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d5b53c6e-5aa8-4948-aa01-5af6a8da279f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:35.009716 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d5b53c6e-5aa8-4948-aa01-5af6a8da279f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:35.013854 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=12 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:35.014929 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=4 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:35.015550 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:35.073035 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d5b53c6e-5aa8-4948-aa01-5af6a8da279f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:35.080101 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d5b53c6e-5aa8-4948-aa01-5af6a8da279f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1089 microversion: 2.1 time: 0.074896 Oct 19 02:20:35.080711 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3822/7520] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:35 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:36.104440 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:36.105082 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:36.111696 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:36.112922 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:36.113465 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:36.114164 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:36.114626 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:36.115064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:36.176762 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:36.184531 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-86dcedcc-2ccf-403b-bdfa-a27d1b8c3ce8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1187 microversion: 2.1 time: 0.084840 Oct 19 02:20:36.185131 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3699/7521] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:36 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:37.213331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:37.214628 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:37.225881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:37.226682 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:37.227345 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:37.228451 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:37.229137 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:37.229765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:37.448655 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:37.457434 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d0be8f1f-3f4f-4b0b-afba-e6d2a4ee9a91 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1271 microversion: 2.1 time: 0.251836 Oct 19 02:20:37.481766 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3823/7522] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:37 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:37.780868 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:37.791670 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:37.792178 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:37.792613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:37.804811 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] Creating event network-changed:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h1-master-1 Oct 19 02:20:37.809960 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7e0d13b1-944d-4cf6-952c-afa779215fb4 req-8f2acd74-d304-48a9-9ddb-27a744e3c91f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032790 Oct 19 02:20:37.810576 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3700/7523] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:20:38.485098 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:38.485858 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:38.492862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:38.493354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:38.493834 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:38.494553 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:38.495095 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:38.495810 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:38.725137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:38.734339 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fe2d88ac-122f-4156-9480-4e7d8647e6c3 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1271 microversion: 2.1 time: 0.253127 Oct 19 02:20:38.734942 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3824/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:38 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:39.759788 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:39.760394 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:39.766602 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:39.767091 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:39.767530 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:39.768738 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:39.769580 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:39.770020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:39.906982 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:39.915976 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-7c5871b6-701d-4526-9685-469570ca7f90 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1271 microversion: 2.1 time: 0.161377 Oct 19 02:20:39.917058 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3701/7525] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:39 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:40.940665 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:40.941235 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:40.948211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:40.948746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:40.949211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:40.950196 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:40.950417 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:40.950864 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:41.095076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:41.104776 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-33637884-dd25-41ab-9b73-ce92f8721fa8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1271 microversion: 2.1 time: 0.168401 Oct 19 02:20:41.105464 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3825/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:40 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:42.129286 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:42.129914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:42.136806 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:42.137296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:42.137746 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:42.138446 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:42.138911 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:42.139348 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:42.271014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:42.278914 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8ab28597-5674-4d32-b85e-3da722aa6a1f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.153847 Oct 19 02:20:42.279496 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3702/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:42 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:43.302421 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:43.302966 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:43.309790 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:43.310288 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:43.310739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:43.311448 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:43.311915 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:43.312355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:43.446399 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:43.454303 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-21a91b32-7604-4133-9ac5-4e410c3288f9 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.156145 Oct 19 02:20:43.454883 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3826/7528] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:43 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:44.479756 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:44.480377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:44.486524 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:44.487646 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:44.488089 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:44.488813 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:44.489286 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:44.489707 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:44.619652 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:44.627423 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-211a3b55-76de-4b4f-b3d0-38de64eb2156 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.151961 Oct 19 02:20:44.628004 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3703/7529] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:44 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:45.650743 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:45.651315 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:45.654119 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:45.660519 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:45.661057 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:45.661520 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:45.662240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:45.662724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:45.663176 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:45.796441 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:45.804512 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-62174951-c4e2-4e7d-9699-1ebda501be1b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.157897 Oct 19 02:20:45.805126 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3827/7530] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:45 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:46.828319 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:46.828910 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:46.831472 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:46.832150 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:20:46.839099 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:46.839599 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:46.840045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:46.840807 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:46.841281 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:46.841741 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:46.976986 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:46.985088 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-3af3fb74-548d-48a1-81d0-eed488141f9f tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.160708 Oct 19 02:20:46.985762 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3704/7531] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:46 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:48.009545 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:48.010186 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:48.017202 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:48.017708 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:48.018161 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:48.019486 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:48.020471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:48.020949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:48.160000 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:48.168127 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e7390e5d-c365-44b7-b8ee-a1bf7109dfb7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.162568 Oct 19 02:20:48.168824 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3828/7532] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:48 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:49.192259 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:49.192919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:49.199823 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:49.200318 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:49.200803 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:49.201509 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:49.201975 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:49.202414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:49.339376 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:49.347163 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-26daa75f-6fb2-48f4-bff4-be4d953a0366 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.159708 Oct 19 02:20:49.347746 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3705/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:49 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:50.370795 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:50.371471 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:50.378433 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:50.379067 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:50.379533 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:50.380252 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:50.380765 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:50.381215 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:50.513987 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:50.521993 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8d696fd2-04d7-4dd2-822e-4a61658414d8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.155193 Oct 19 02:20:50.522577 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3829/7534] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:50 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:51.546606 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:51.547250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:51.554540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:51.555049 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:51.555583 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:51.556411 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:51.556897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:51.557327 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:51.634835 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "name": "network-vif-plugged", "status": "completed", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:51.647586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:51.648105 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:51.648738 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:51.662709 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] Creating event network-vif-plugged:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h1-master-1 Oct 19 02:20:51.668488 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-cac67d7d-28c0-4215-8e53-7ee895c4f18a req-468779a2-a02f-4707-bd28-4b0aa25ab32b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038384 Oct 19 02:20:51.669145 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3830/7535] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:20:51.694666 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:51.702586 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5eeca422-bec3-4b0d-8ce7-d23708cd9fa1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.160120 Oct 19 02:20:51.703263 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3706/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:51 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:52.727408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:52.728137 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:52.735591 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:52.736107 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:52.736569 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:52.737993 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:52.738654 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:52.739115 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:52.873093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:52.880890 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-6ce865c3-3ff8-4a66-90b0-7d6026694e8e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1259 microversion: 2.1 time: 0.157938 Oct 19 02:20:52.881488 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3831/7537] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:52 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:53.904036 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:53.904667 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:53.911563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:53.912043 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:53.912480 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:53.913199 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:53.913655 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:53.914085 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:54.051878 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:54.059651 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4a35d06-312c-42de-8928-93993991ba23 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1442 microversion: 2.1 time: 0.159516 Oct 19 02:20:54.060222 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3707/7538] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:53 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:54.083385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:20:54.084055 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:20:54.091056 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:54.091568 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:54.092089 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:54.092848 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:54.093324 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:54.093773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:54.226567 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:20:54.234415 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-77db2102-3db0-4ad9-b728-b4551a1d5c86 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1442 microversion: 2.1 time: 0.155381 Oct 19 02:20:54.234987 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3832/7539] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:20:54 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:20:56.149672 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:20:56.159835 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:20:56.160906 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:20:56.161331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:20:56.172751 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] Creating event network-changed:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h1-master-1 Oct 19 02:20:56.178529 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7b058b23-5835-49b1-9d8e-f8d236c38463 req-17f43c29-df18-4788-b743-06981cd2b555 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032495 Oct 19 02:20:56.179152 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3708/7540] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:22:53.401243 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 02:22:53.403003 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 02:22:53.403592 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=24 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:22:53.404347 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=56 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:22:53.470556 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:22:53.471110 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:53.477179 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:53.477675 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:53.478127 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:53.478849 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:53.479316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:53.479753 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:53.502443 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.objects.instance [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lazy-loading 'flavor' on Instance uuid 967b5be1-980a-4085-b42b-54b418c457ab {{(pid=131449) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:22:53.574832 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e883ff12-f3c5-44a9-ab20-273733e0e026 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab/action" status: 202 len: 0 microversion: 2.1 time: 0.174705 Oct 19 02:22:53.575443 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3833/7541] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:22:53 2022] POST /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:22:53.582168 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 02:22:53.583406 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 19 02:22:53.583890 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:22:53.584659 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=54 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:22:53.591450 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:53.592438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:53.600026 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:53.600537 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:53.601006 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:53.601717 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:53.602182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:53.602718 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:53.738222 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:53.746137 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-5ac30ffc-623e-40c6-b452-6ea035e37ea7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.166078 Oct 19 02:22:53.746717 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3709/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:53 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:22:54.773025 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:54.773746 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:54.783269 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:54.783767 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:54.784225 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:54.784967 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:54.785440 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:54.785883 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:54.790717 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44472. Oct 19 02:22:54.791437 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44470. Oct 19 02:22:54.923922 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:54.931798 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a2208db5-e1d4-4dc5-92bf-0a76a162ef4b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.165008 Oct 19 02:22:54.932382 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3834/7543] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:54 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:22:55.956725 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:55.957337 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:55.967403 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:55.967897 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:55.968346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:55.969080 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:55.969555 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:55.969992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:55.976362 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44476. Oct 19 02:22:55.986941 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44478. Oct 19 02:22:56.104607 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:56.112540 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0becb813-1f65-4e60-acaa-f7b74494f4f7 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.159791 Oct 19 02:22:56.113161 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3710/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:55 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:22:57.135897 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:57.136697 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:57.143536 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:57.144041 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:57.144500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:57.145239 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:57.145722 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:57.146170 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:57.282076 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:57.290000 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-2a2a71ed-3b21-4a2d-9952-03535d5dab12 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.158083 Oct 19 02:22:57.290585 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3835/7545] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:57 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:22:58.313998 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:58.314548 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:58.321434 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:58.321929 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:58.322376 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:58.323075 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:58.323540 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:58.323977 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:58.466527 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:58.474308 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-381832bc-4f32-49f7-b601-871a84e92f3e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.165138 Oct 19 02:22:58.474892 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3711/7546] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:58 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:22:59.498133 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:22:59.498781 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:22:59.505970 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:59.506476 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:59.506941 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:59.507700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:22:59.508220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:22:59.508677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:22:59.642199 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:22:59.650227 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0c5d136a-beaf-4f40-9f27-6cbaa057939d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.156195 Oct 19 02:22:59.650813 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3836/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:22:59 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:00.674339 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:00.675279 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:00.682073 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:00.682564 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:00.683016 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:00.683735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:00.684193 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:00.684971 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:00.819626 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:00.827825 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c4d666cf-453b-49af-ae35-2791fee98336 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.157445 Oct 19 02:23:00.828408 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3712/7548] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:00 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:01.851511 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:01.852149 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:01.859995 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:01.860497 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:01.860985 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:01.861704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:01.862177 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:01.862625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:01.998957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:02.006851 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-84144329-8c33-48eb-8a13-fb02fa110a48 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.159379 Oct 19 02:23:02.007448 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3837/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:01 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:03.031091 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:03.031680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:03.038542 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:03.039034 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:03.039504 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:03.040189 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:03.040683 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:03.041126 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:03.172478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:03.180245 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ee69efe5-9601-48a3-95ca-713be65445c1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.153231 Oct 19 02:23:03.180857 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3713/7550] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:03 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:04.205412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:04.206154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:04.213270 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:04.213779 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:04.214237 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:04.214968 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:04.215500 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:04.216004 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:04.433642 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:04.443235 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-9bb1f857-bd5b-4ea4-a025-f28259466fe5 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.241834 Oct 19 02:23:04.443860 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3838/7551] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:04 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:05.470560 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:05.471181 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:05.478182 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:05.478667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:05.479115 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:05.479809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:05.480263 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:05.480715 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:05.612786 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:05.620539 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-760b2298-8994-4da9-84a4-9c6f8b849e65 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.154583 Oct 19 02:23:05.621141 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3714/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:05 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:06.644698 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:06.645282 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:06.652195 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:06.652736 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:06.653773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:06.654534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:06.655016 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:06.655461 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:06.794080 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:06.802183 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f77254c2-d76a-4b60-8113-ee1e5f07c8c2 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.161602 Oct 19 02:23:06.802763 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3839/7553] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:06 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:07.827410 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:07.828040 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:07.834953 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:07.835450 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:07.835901 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:07.836613 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:07.837101 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:07.837539 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:07.972324 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:07.980248 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-21e77a0e-3a30-4006-ac61-6f5a969412ad tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.157531 Oct 19 02:23:07.980868 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3715/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:07 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:09.004203 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:09.004868 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:09.011811 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.012335 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.012828 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.013540 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.014018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.014463 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.149908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:09.158491 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-91f16a2b-0b5f-4ed7-afc6-cb5cea988665 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1508 microversion: 2.1 time: 0.158216 Oct 19 02:23:09.159077 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3840/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:08 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:09.181216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:23:09.181818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:09.189202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.189695 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.190143 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.190842 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.191335 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.191775 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.222265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=131450) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 19 02:23:09.289009 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-855585c9-aa94-4586-bb01-05bf68832874 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "POST /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab/action" status: 202 len: 0 microversion: 2.1 time: 0.111571 Oct 19 02:23:09.289498 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3716/7556] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:23:09 2022] POST /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:23:09.298154 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:09.298860 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:09.304947 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.305462 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.305992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.306861 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:09.307527 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:09.308276 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:09.481713 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:09.489637 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d542b611-2dea-4ebb-99f6-72451d91d567 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1516 microversion: 2.1 time: 0.195668 Oct 19 02:23:09.490227 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3841/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:09 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:10.373301 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "name": "network-vif-unplugged", "status": "completed", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:23:10.386076 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:10.386560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:10.386992 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:10.397874 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.compute.server_external_events [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] Unable to find a host for instance 967b5be1-980a-4085-b42b-54b418c457ab. Dropping event network-vif-unplugged {{(pid=131450) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 19 02:23:10.398782 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e650002b-de18-44fd-bddb-dbd6a68130f7 req-bb3d95e0-a9f7-4452-b8a0-d0cd7795999a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.103296 Oct 19 02:23:10.399370 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3717/7558] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 19 02:23:10.514167 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:10.514707 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:10.521714 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:10.522248 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:10.522704 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:10.523414 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:10.523884 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:10.524327 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:10.665648 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:10.674101 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-4ceb6dbd-c700-45ee-a010-8d4b7d23f05b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1518 microversion: 2.1 time: 0.164095 Oct 19 02:23:10.674687 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3842/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:10 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:11.698691 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:11.699252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:11.706346 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:11.706832 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:11.707273 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:11.708002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:11.708461 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:11.708914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:11.844456 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:11.852308 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1844b71f-5620-4f04-9c29-f536ac5f1c8d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1518 microversion: 2.1 time: 0.157982 Oct 19 02:23:11.852909 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3718/7560] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:11 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:12.877101 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:12.877756 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:12.885368 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:12.885886 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:12.886354 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:12.887618 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:12.888236 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:12.888724 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:13.031720 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:13.039987 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-467cc5a9-ca6a-441f-b92f-eef29c35ce4d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1518 microversion: 2.1 time: 0.166970 Oct 19 02:23:13.040583 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3843/7561] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:12 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:23:14.064350 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:14.065009 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:14.071936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:14.072458 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:14.072934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:14.073636 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:14.074097 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:14.074596 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:14.223940 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:14.231845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-99ef1ea4-8f79-463f-a31c-2c054d8e5aca tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1518 microversion: 2.1 time: 0.171738 Oct 19 02:23:14.232418 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3719/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:14 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:15.255552 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:15.256184 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:15.264155 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:15.264781 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:15.265235 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:15.265950 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:15.266418 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:15.266857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:15.470034 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:15.478002 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-5a36878d-f7a1-4fd7-9150-bcfe1527a065 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.226396 Oct 19 02:23:15.478594 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3844/7563] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:15 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:16.207824 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:23:16.218238 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:16.218729 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:16.219169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:16.230326 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] Creating event network-changed:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h2-master-1 Oct 19 02:23:16.235041 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] [90675d72-89be-432a-8536-38c863b95ed4] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:23:16.501950 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:16.502600 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:16.509477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:16.509986 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:16.510445 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:16.511173 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:16.511660 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:16.512133 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:17.051161 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:17.059902 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-ba282dee-cc58-4423-836b-c3934925f548 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.561272 Oct 19 02:23:17.060507 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3845/7564] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:16 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:23:17.242974 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] [90675d72-89be-432a-8536-38c863b95ed4] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44542. Oct 19 02:23:17.246900 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-52755180-5b32-428f-86ad-0b5c413971b8 req-07743fd6-55d9-4925-952c-57bb9b12697b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.096099 Oct 19 02:23:17.247627 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3720/7565] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:23:18.083847 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:18.084483 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:18.092241 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:18.092792 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:18.093251 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:18.093978 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:18.094455 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:18.094900 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:18.233877 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:18.241833 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f21fb0c6-6f01-4aa8-a0cd-0df514e4097d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.162064 Oct 19 02:23:18.242429 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3846/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:18 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:19.268613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:19.269383 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:19.275572 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:19.276055 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:19.276521 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:19.277427 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:19.278036 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:19.278360 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:19.412265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:19.420244 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6e74b2e8-35ab-4f2b-9ef4-e9ad35e6703a tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.156847 Oct 19 02:23:19.420863 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3721/7567] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:19 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:20.444292 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:20.444978 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:20.451875 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:20.452534 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:20.452910 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:20.453634 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:20.454113 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:20.454563 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:20.472445 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:20.592201 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:20.600070 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-8beb4432-c590-4d80-bcd7-89d30293a5e0 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.159750 Oct 19 02:23:20.600716 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3847/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:20 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:21.624409 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:21.625062 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:21.631954 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:21.632447 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:21.632933 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:21.634013 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:21.634923 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:21.635409 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:21.766234 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:21.774124 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-d4eae374-bc4d-46ac-b9ce-8ca7bbfab25d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.154150 Oct 19 02:23:21.774710 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3722/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:21 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:23:22.798757 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:22.799405 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:22.806320 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:22.806830 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:22.807293 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:22.808012 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:22.808494 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:22.808969 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:22.942304 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:22.950726 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e0d01c88-aa9d-4824-9372-c53307fee0be tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.155999 Oct 19 02:23:22.951317 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3848/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:22 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:23:23.974023 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:23.974580 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:23.977431 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:23.982731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:23.983231 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:23.983677 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:23.984382 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:23.984868 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:23.985296 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:23.990878 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:24.120526 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:24.129491 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-6b422738-e0fb-4055-b408-e7f144ab1fbc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.159489 Oct 19 02:23:24.130072 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3723/7571] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:23 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:25.155412 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:25.156013 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:25.157948 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=33 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:23:25.163387 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:25.163889 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:25.164344 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:25.165086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:25.165562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:25.166013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:25.308739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:25.317593 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-09bdaa64-25c5-4a3e-a6ab-46afdf06054d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.167511 Oct 19 02:23:25.318219 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3849/7572] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:25 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:26.343856 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:26.344478 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:26.351985 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:26.352479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:26.352957 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:26.353658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:26.354119 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:26.354553 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:26.496371 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:26.505189 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-4e8b9824-20b9-4b57-99c2-b03949e4e36d tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.166810 Oct 19 02:23:26.505787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3724/7573] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:26 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:27.531331 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:27.531970 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:27.538946 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:27.539452 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:27.539908 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:27.540650 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:27.541134 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:27.542211 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:27.678044 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:27.686689 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-329d6ac6-2eb2-49a4-88db-d774b18bf6bb tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.160140 Oct 19 02:23:27.687952 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3850/7574] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:27 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:28.170804 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "name": "network-vif-plugged", "status": "completed", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:23:28.182966 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:28.183645 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:28.184087 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:28.198325 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] Creating event network-vif-plugged:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h2-master-1 Oct 19 02:23:28.203673 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-ff0f8404-bfdc-4c7c-a88b-f73bbfd55724 req-b7ff4694-9160-409a-89f9-3f6215749b2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037169 Oct 19 02:23:28.204528 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3725/7575] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:23:28.711687 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:28.712255 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:28.720018 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:28.720561 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:28.721053 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:28.721813 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:28.722294 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:28.722746 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:28.853320 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:28.861354 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-31a50cc0-ee91-4962-9b2f-89ae91f10e7e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1574 microversion: 2.1 time: 0.153743 Oct 19 02:23:28.861949 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3851/7576] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:28 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:23:29.887422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:23:29.889161 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:23:29.896265 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:29.896982 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:29.897485 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:29.898313 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:23:29.898877 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:23:29.899331 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:23:30.038547 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:23:30.046947 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9f82f1e4-335b-44b0-b1cd-9b2a55ad7bcc tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1561 microversion: 2.1 time: 0.165311 Oct 19 02:23:30.047535 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3726/7577] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:23:29 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:43.621915 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=5 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:43.623521 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=26 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:43.624684 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:24:43.625075 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab (ip 10.222.0.27) !!! Oct 19 02:24:43.625371 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=7 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:43.626827 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=19 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:24:43.627926 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:24:43.628058 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:24:43.628154 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab (ip 10.222.0.27) !!! Oct 19 02:24:43.628243 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 02:24:43.634015 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:43.634505 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:43.650862 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:43.651378 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:43.652068 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:43.652851 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:43.653336 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:43.653784 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:43.689842 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:24:43.748426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:24:43.758793 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:43.759289 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:43.759731 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:43.771577 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] Creating event network-changed:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h2-master-1 Oct 19 02:24:43.777532 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-9f2641b7-da56-4961-948f-a132e6cf6aff req-c767dd05-3e34-4966-9b2b-1e5393ee4be7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154120 Oct 19 02:24:43.778694 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3727/7578] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:24:43.783997 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fa252fd4-43d4-4217-a805-081959b02f0b tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "DELETE /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 204 len: 0 microversion: 2.1 time: 0.164070 Oct 19 02:24:43.784670 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3852/7579] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:24:43 2022] DELETE /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:24:43.794070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:43.798216 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:43.801343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:43.803127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:43.803127 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:43.803532 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:43.803993 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:43.804425 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:43.947680 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:43.955680 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-24211e3f-ea6d-4035-8433-31afa96faaf1 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.165863 Oct 19 02:24:43.956266 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3728/7580] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:43 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:24:44.980519 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:44.981281 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:44.988477 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:44.989073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:44.989586 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:44.990479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:44.990965 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:44.991419 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:45.184095 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:45.192292 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-67131d7b-c5ec-4638-ad72-34f30699444c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1567 microversion: 2.1 time: 0.216031 Oct 19 02:24:45.192915 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3853/7581] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:44 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:45.922919 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967b5be1-980a-4085-b42b-54b418c457ab", "name": "network-vif-deleted", "tag": "bf8bd308-e964-41da-b5d3-2e84c5d0e8c0"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:24:45.934704 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:45.935184 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:45.935621 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:45.947168 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] Creating event network-vif-deleted:bf8bd308-e964-41da-b5d3-2e84c5d0e8c0 for instance 967b5be1-980a-4085-b42b-54b418c457ab on n-h2-master-1 Oct 19 02:24:45.953021 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f5a6ed1f-6ecf-4ec1-9a24-b6b864e5d5e2 req-db8561e9-752b-41e6-a10e-8fcd45225a8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033886 Oct 19 02:24:45.953582 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3729/7582] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:24:46.216765 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:46.217699 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:46.225165 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:46.226054 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:46.226750 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:46.227549 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:46.228088 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:46.228598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:46.300478 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:46.309395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-92b38f90-ed06-4445-a3d9-303d8dcfab9e tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1220 microversion: 2.1 time: 0.096600 Oct 19 02:24:46.310125 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3854/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:46 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:47.336056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:47.336789 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:47.343064 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:47.343560 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:47.344012 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:47.344759 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:47.345227 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:47.345667 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:47.409845 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:47.418716 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-c5fb6c0f-fec9-4b2c-a7ae-2389ae0ec0b8 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1220 microversion: 2.1 time: 0.088298 Oct 19 02:24:47.419304 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3730/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:47 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:48.443341 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:48.444739 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:48.452879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:48.453892 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:48.454598 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:48.455773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:48.456471 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:48.457164 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:48.534083 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:48.543211 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f2a87a73-6b13-459f-b6ab-333c06d9851c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1220 microversion: 2.1 time: 0.104835 Oct 19 02:24:48.544465 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3855/7585] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:48 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:49.567022 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:49.567735 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:49.574666 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:49.575815 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:49.576274 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:49.577017 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:49.577492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:49.577936 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:49.641585 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ea84bfb9df044fdadd880ed8260c393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ce5fe85f8b94c92b72fe172eb024b60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:24:49.650551 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bbdaeb26-ba91-450a-8a9d-572346da3d4c tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 200 len: 1220 microversion: 2.1 time: 0.087509 Oct 19 02:24:49.651229 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3731/7586] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:49 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:24:50.674236 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:50.674908 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] [instance: 967b5be1-980a-4085-b42b-54b418c457ab] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:24:50.682532 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:50.683037 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:50.683489 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:50.684317 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:24:50.684820 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:24:50.685264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:24:50.699388 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] HTTP exception thrown: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Request method failure captured: Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab HTTP/1.1 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT13ZpG5qRowfnzRRlCrGvJCrfxmrwQPrPKwPGwrm1xFnvj0PuQpnDnP5fxTJ9NHLvUxwWdM_QbHJZh2-TjQ4QRZoNy4w0gHO-BeNKdh-jH-fjdYFWGgr0I8WCHSD4MTUk0Vks-xvuverI7fTLlPFid1e5yTHVFjw0cdpIdcAIgwcV0k Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 6ce5fe85f8b94c92b72fe172eb024b60 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestShelveInstance-2096950632 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6ce5fe85f8b94c92b72fe172eb024b60", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ce5fe85f8b94c92b72fe172eb024b60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6ce5fe85f8b94c92b72fe172eb024b60"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ce5fe85f8b94c92b72fe172eb024b60"}]}] Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestShelveInstance-2096950632 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 6ce5fe85f8b94c92b72fe172eb024b60 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestShelveInstance-2096950632 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestShelveInstance-2096950632-project Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 4ea84bfb9df044fdadd880ed8260c393 Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestShelveInstance-2096950632-project Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '967b5be1-980a-4085-b42b-54b418c457ab'} Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:24:50.701124 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Returning 404 to user: Instance 967b5be1-980a-4085-b42b-54b418c457ab could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-15e8372d-4172-4d91-ae5e-d9c155e80c62 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab" status: 404 len: 111 microversion: 2.1 time: 0.032462 Oct 19 02:24:50.706395 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3856/7587] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:24:50 2022] GET /compute/v2.1/servers/967b5be1-980a-4085-b42b-54b418c457ab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:24:50.881865 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1fe92c3d-0057-4c55-977d-79d5fd399f18 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] Calling method '.version_select at 0x7f2af497f790>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:24:50.912955 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1fe92c3d-0057-4c55-977d-79d5fd399f18 tempest-TestShelveInstance-2096950632 tempest-TestShelveInstance-2096950632-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1051000445" status: 202 len: 0 microversion: 2.1 time: 0.035004 Oct 19 02:24:50.913922 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3732/7588] 10.222.0.27 () {58 vars in 1254 bytes} [Wed Oct 19 02:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1051000445 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 19 02:25:09.100656 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:09.101437 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:09.271740 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-cdbcecb7-690b-4091-8195-70b6c856265e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Action: 'create', calling method: .version_select at 0x7f2af59ec9d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1664223053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyq2dhNL/38fcMZkZBWcjrfpvUvhbyJoG72B1gPExGC05ADL0vXuWf963lQ3tb0utgIX06UF7J5D9OSXZbbh5yWrZcHIxBpD3F5YKFi4MRaM6V+rfaLX9ALWwktkUBVrw=="}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:25:09.290416 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cdbcecb7-690b-4091-8195-70b6c856265e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for project 8a07543f2a974ab68250790aa05e4457. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:25:09.295703 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.quota [None req-cdbcecb7-690b-4091-8195-70b6c856265e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for user 31cee11ce9074305a2420fd576588ac6 and project 8a07543f2a974ab68250790aa05e4457. Resources: {'key_pairs'} {{(pid=131449) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:25:09.325036 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-cdbcecb7-690b-4091-8195-70b6c856265e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.230192 Oct 19 02:25:09.325564 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3857/7589] 10.222.0.27 () {60 vars in 1159 bytes} [Wed Oct 19 02:25:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:25:10.384314 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=22 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:10.385098 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:10.390184 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-35572703", "imageRef": "8df5ee37-9b8e-48da-9f04-6c7fec506340", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1664223053", "security_groups": [{"name": "tempest-secgroup-smoke-1544975845"}], "networks": [{"uuid": "73fc10a1-2d4d-4553-baa8-f82ac1623ba7"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:25:10.503703 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] validate_networks() for [('73fc10a1-2d4d-4553-baa8-f82ac1623ba7', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:25:10.999265 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:25:10.999736 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:25:11.000320 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:25:11.000778 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:25:11.001209 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:25:11.010827 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:11.011394 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:11.011844 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:11.012587 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:11.013098 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:11.013538 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:11.035504 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for project 8a07543f2a974ab68250790aa05e4457. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:25:11.040914 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for user 31cee11ce9074305a2420fd576588ac6 and project 8a07543f2a974ab68250790aa05e4457. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:25:11.053603 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:25:11.055960 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8df5ee37-9b8e-48da-9f04-6c7fec506340',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:25:11.109801 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-aebfae1d-53f5-47f1-a230-17970e36b1ad tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727243 Oct 19 02:25:11.110791 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3733/7590] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:25:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:25:11.124906 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1521fedb-edcb-43b2-95ea-184dcbfabc90 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:11.125557 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1521fedb-edcb-43b2-95ea-184dcbfabc90 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:11.200336 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1521fedb-edcb-43b2-95ea-184dcbfabc90 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:11.207838 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1521fedb-edcb-43b2-95ea-184dcbfabc90 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1247 microversion: 2.1 time: 0.088450 Oct 19 02:25:11.208884 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3858/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:11 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:12.231387 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:12.232098 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:12.240651 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:12.241156 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:12.241609 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:12.242363 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:12.242830 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:12.243264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:12.309000 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:12.318171 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-0cbbf7fb-8702-4ef2-b81b-4c057010cd7e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1299 microversion: 2.1 time: 0.090702 Oct 19 02:25:12.318787 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3734/7592] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:12 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:13.342968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:13.343639 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:13.351573 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:13.352266 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:13.352547 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:13.353316 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:13.353797 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:13.354245 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:13.552250 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:13.561076 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-aef6fa31-59da-4904-98ee-ffc447a2bc39 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.222372 Oct 19 02:25:13.561943 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3859/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:13 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:14.146551 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:25:14.165826 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:14.166492 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:14.167077 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:14.180879 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] Creating event network-changed:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:25:14.187534 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8acde2f0-d28b-4bee-9005-c3b9abd2c02e req-e50a597b-81e6-4c8f-ba16-5a4ff7cadef1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051761 Oct 19 02:25:14.188584 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3735/7594] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:25:14.584957 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:14.586230 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:14.592989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:14.593496 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:14.593959 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:14.594677 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:14.595149 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:14.595592 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:14.784009 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:14.792374 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-36a1d737-a4bc-4a2f-9083-c71e11a42388 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.211415 Oct 19 02:25:14.793008 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3860/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:14 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:15.816445 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:15.817676 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:15.825112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:15.825735 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:15.826291 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:15.827357 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:15.828169 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:15.828632 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:16.107281 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:16.115693 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1a988948-063a-4f78-896f-9277f927544b tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.304071 Oct 19 02:25:16.116291 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3736/7596] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:15 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:17.139298 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:17.139927 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:17.146975 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:17.147479 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:17.147936 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:17.148673 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:17.149146 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:17.149589 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:17.281777 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:17.289987 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-a60d0493-c41d-49b3-a040-2939a1d1b8b9 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.154610 Oct 19 02:25:17.290566 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3861/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:17 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:18.313427 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:18.314056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:18.321535 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:18.322020 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:18.322460 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:18.323150 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:18.323604 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:18.324032 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:18.457828 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:18.465661 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-56d67f40-ad45-4593-989b-a8b3fa989a1a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.156437 Oct 19 02:25:18.466236 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3737/7598] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:18 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:18.953833 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "name": "network-vif-plugged", "status": "completed", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:25:18.964997 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:18.965491 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:18.965943 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:18.977934 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] Creating event network-vif-plugged:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:25:18.983219 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-060f3c9a-243e-42d2-ac63-1ac629bf799e req-e1da28f7-a048-4f07-9a73-b21b9d49e9a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033236 Oct 19 02:25:18.983826 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3862/7599] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 19 02:25:19.489746 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:19.490614 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:19.497547 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:19.498035 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:19.498479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:19.499172 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:19.499633 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:19.500062 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:19.634806 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:19.642427 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ab79009b-9a33-4be9-b920-5845a4a4933f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1373 microversion: 2.1 time: 0.157374 Oct 19 02:25:19.643005 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3738/7600] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:19 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:20.668387 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:20.669061 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:20.675382 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:20.676515 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:20.677104 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:20.677827 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:20.678306 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:20.678756 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:20.817394 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:20.825288 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-540a766c-3060-4587-8135-88ebbb84c33d tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1557 microversion: 2.1 time: 0.162351 Oct 19 02:25:20.825885 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3863/7601] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:20 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:20.848805 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:25:20.849432 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:25:20.856284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:20.856841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:20.857295 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:20.858002 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:20.858468 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:20.858908 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:21.020139 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:21.027240 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:25:21.034775 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-29453ce9-9606-4667-9ef0-b491fecf6f8a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1557 microversion: 2.1 time: 0.190557 Oct 19 02:25:21.035956 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3739/7602] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:25:20 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:25:22.678997 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:25:22.684055 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=6 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:25:22.691907 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:25:22.692726 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:25:22.693052 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:25:22.704557 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] Creating event network-changed:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:25:22.710431 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-69f38914-5014-4558-855e-c9a8234ca758 req-aa2937e2-e524-4f74-9247-5a12dd705d5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035835 Oct 19 02:25:22.711672 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3864/7603] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:27:20.595133 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 02:27:20.596080 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 19 02:27:20.596445 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:20.597333 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:20.598411 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=34 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:20.600598 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 19 02:27:20.600801 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:27:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c/action (ip 10.222.0.27) !!! Oct 19 02:27:20.606639 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1496712064"}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:20.609101 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:20.619342 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:20.619836 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:20.620285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:20.621028 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:20.621493 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:20.621931 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:20.824773 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-fe32c347-e3f9-4126-ac4e-3383aca8c8c2 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "POST /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c/action" status: 202 len: 0 microversion: 2.1 time: 0.231493 Oct 19 02:27:20.825429 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3740/7604] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:27:20 2022] POST /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 02:27:27.715215 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:27:27.716241 n-d-master-1 devstack@n-api.service[131449]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:27:27.717316 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:27.722639 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=28 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:27.730968 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "name": "network-vif-plugged", "status": "completed", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:27.744021 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:27.745044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:27.745625 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:27.765634 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] Creating event network-vif-plugged:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:27:27.789884 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e93a7ed5-1b03-47d6-8a39-b55c8c190781 req-005e85cc-b9bc-4a77-821e-b65870a7889b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076583 Oct 19 02:27:27.790746 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3865/7605] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:27:35.411733 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:35.413145 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:35.418640 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-597312322", "imageRef": "1da3c4d3-bd33-485a-8cc2-254fbe37b276", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1664223053", "security_groups": [{"name": "tempest-secgroup-smoke-1544975845"}], "networks": [{"uuid": "73fc10a1-2d4d-4553-baa8-f82ac1623ba7"}]}} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:35.445454 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [224f9316-cd33-460b-8091-5d46ef132538] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44996. Oct 19 02:27:35.446189 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] [f4c24e9a-4f61-47c6-9124-c7f4dadf163e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 44994. Oct 19 02:27:35.531318 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.network.neutron [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] validate_networks() for [('73fc10a1-2d4d-4553-baa8-f82ac1623ba7', None, None, None, None, None)] {{(pid=131450) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 19 02:27:35.909620 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Flavor limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 19 02:27:35.910056 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Image limits 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 19 02:27:35.910590 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Flavor pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 19 02:27:35.911014 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Image pref 0:0:0 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 19 02:27:35.911438 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.virt.hardware [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131450) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 19 02:27:35.921112 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:35.921605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:35.922054 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:35.922794 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:35.923271 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:35.923710 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:35.941252 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for project 8a07543f2a974ab68250790aa05e4457. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 19 02:27:35.946472 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.quota [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Getting quotas for user 31cee11ce9074305a2420fd576588ac6 and project 8a07543f2a974ab68250790aa05e4457. Resources: {'cores', 'ram', 'instances'} {{(pid=131450) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 19 02:27:35.958935 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Going to run 1 instances... {{(pid=131450) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 19 02:27:35.962191 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1da3c4d3-bd33-485a-8cc2-254fbe37b276',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131450) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 19 02:27:36.006580 n-d-master-1 devstack@n-api.service[131450]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [81384fa6-ca34-40ab-a282-a7a89f2f238a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 19 02:27:37.013977 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [81384fa6-ca34-40ab-a282-a7a89f2f238a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45006. Oct 19 02:27:37.018376 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-a576b6de-2267-4847-bf65-1443aa9c57cd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.608864 Oct 19 02:27:37.019028 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3741/7606] 10.222.0.27 () {60 vars in 1147 bytes} [Wed Oct 19 02:27:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 19 02:27:37.033969 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-14bf3acc-bd8e-4691-9a73-5e2f6b32c7f5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:37.034787 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-14bf3acc-bd8e-4691-9a73-5e2f6b32c7f5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:37.053355 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [b77603e3-e8c1-4792-afcd-11bc7a93ff75] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45010. Oct 19 02:27:37.054221 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] [1b3ee132-5097-4963-a121-a94da63c85aa] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 45012. Oct 19 02:27:37.106822 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-14bf3acc-bd8e-4691-9a73-5e2f6b32c7f5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:37.114639 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-14bf3acc-bd8e-4691-9a73-5e2f6b32c7f5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1248 microversion: 2.1 time: 0.086882 Oct 19 02:27:37.115307 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3866/7607] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:37 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:38.142686 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:38.144141 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:38.155523 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:38.156027 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:38.156479 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:38.157285 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:38.157754 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:38.158206 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:38.228303 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:38.236510 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1db385b8-33a4-4b15-8c99-b676cba05b28 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1308 microversion: 2.1 time: 0.101941 Oct 19 02:27:38.237111 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3742/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:38 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:39.260827 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:39.261468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:39.263395 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:39.269989 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:39.270502 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:39.270963 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:39.271720 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:39.272242 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:39.272665 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:39.444630 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:39.452702 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-63ff8ede-4428-495d-bfed-afd0089e51dd tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.195776 Oct 19 02:27:39.453300 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3867/7609] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:39 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:39.651195 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "name": "network-vif-unplugged", "status": "completed", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:39.664222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:39.664800 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:39.665692 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:39.681694 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] Creating event network-vif-unplugged:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:27:39.687503 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-cb1f03c6-48b7-4775-b5ad-aa20ef806164 req-91ac34bf-f2c9-4156-8cc9-0e75776fb799 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041072 Oct 19 02:27:39.688740 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3743/7610] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:27:40.480022 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:40.480706 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:40.487881 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:40.488391 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:40.488879 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:40.489606 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:40.490086 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:40.490615 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:40.631460 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:40.640764 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-39117ec3-c671-449c-ab8a-60100b56cc13 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.164061 Oct 19 02:27:40.641128 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3868/7611] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:40 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:41.666592 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:41.667484 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:41.673809 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:41.674306 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:41.674753 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:41.675526 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:41.675991 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:41.676429 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:41.821972 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:41.831510 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-8f3e29f2-2e3a-457b-bd93-0b485bd8a0d7 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.170621 Oct 19 02:27:41.847901 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3744/7612] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:41 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:42.858060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:42.859147 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:42.868359 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:42.868888 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:42.869355 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:42.870100 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:42.870583 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:42.871030 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:43.037914 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:43.046455 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-f8a87feb-064d-4503-b4af-4d8dc35f8a97 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.193308 Oct 19 02:27:43.047048 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3869/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:42 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:44.082004 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:44.087967 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:44.095597 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:44.096222 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:44.096703 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:44.097484 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:44.098044 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:44.098533 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:44.247250 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:44.255219 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-f63aa122-4005-48f8-9db7-347ef191261c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.187328 Oct 19 02:27:44.255793 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3745/7614] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:44 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:45.281332 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:45.283254 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:45.295099 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:45.296184 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:45.297111 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:45.298459 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:45.299156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:45.300220 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:45.457883 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:45.466329 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-eacaf541-0999-4242-9b9b-e8a0c16eed3e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.190305 Oct 19 02:27:45.466917 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3870/7615] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:45 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 19 02:27:46.490634 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:46.491299 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:46.494767 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=2 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:46.495446 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell0:SELECT=6 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:46.501660 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:46.502157 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:46.502605 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:46.503372 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:46.503841 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:46.504284 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:46.636491 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:46.644253 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-bd760f76-adcb-476e-b523-0aa938d077c6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.157611 Oct 19 02:27:46.644867 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3746/7616] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:46 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:47.508357 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:47.514230 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell0:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:27:47.521185 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:47.521691 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:47.522145 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:47.539402 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] Creating event network-changed:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:27:47.544760 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-3276ec8d-85a7-4546-86ae-a967b897e92a req-f49d46e8-230a-4a08-915f-a0893de32555 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040420 Oct 19 02:27:47.545408 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3871/7617] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:27:47.668434 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:47.669085 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:47.676066 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:47.676563 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:47.677247 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:47.677962 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:47.678423 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:47.679201 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:47.821850 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:47.829861 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-2ba4b7cb-c890-4c4d-8daf-9243822e1744 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.165265 Oct 19 02:27:47.830556 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3747/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:47 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:48.855373 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:48.856347 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:48.863700 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:48.864282 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:48.864868 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:48.865676 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:48.866264 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:48.867764 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:49.018264 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:49.027362 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-0dd14b3a-863a-4d24-8eb0-66a006e51123 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.176889 Oct 19 02:27:49.028083 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3872/7619] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:48 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:50.050149 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:50.051070 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:50.058548 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:50.059045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:50.059496 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:50.060204 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:50.060959 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:50.061398 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:50.196947 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:50.204641 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ebe96057-ab43-43a0-be41-e57aaa943b6e tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.158484 Oct 19 02:27:50.205247 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3748/7620] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:50 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:51.228859 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:51.229492 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:51.236550 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:51.237076 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:51.237525 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:51.238229 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:51.238699 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:51.239138 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:51.377251 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:51.385811 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-e913eabd-d21a-480e-ad2f-c061a61bc38c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.161159 Oct 19 02:27:51.386397 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3873/7621] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:51 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:51.479617 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "name": "network-vif-plugged", "status": "completed", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:51.489869 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:51.490352 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:51.490782 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:51.502946 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] Creating event network-vif-plugged:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:27:51.508838 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-352b6886-fbf5-4001-9022-ba87238f14ea req-f81a1004-b52b-49f0-b267-f050e263050d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033134 Oct 19 02:27:51.509476 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3749/7622] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:27:52.411520 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:52.412179 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:52.420066 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:52.420562 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:52.421044 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:52.421760 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:52.422228 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:52.422669 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:52.555609 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:52.563616 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-1d1d7824-f17e-43b4-b8aa-45d754406a33 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1374 microversion: 2.1 time: 0.156096 Oct 19 02:27:52.564187 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3874/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:52 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:53.589075 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:53.589783 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:53.596264 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:53.596791 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:53.597243 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:53.597942 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:53.598430 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:53.598857 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:53.733163 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:53.741012 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-19fcdd71-4da7-4a34-adeb-1742f1fb007c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1559 microversion: 2.1 time: 0.157201 Oct 19 02:27:53.742380 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3750/7624] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:53 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:53.765134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:27:53.765793 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:27:53.772761 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:53.773273 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:53.773739 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:53.774465 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:53.774948 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:53.775402 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:53.909299 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:27:53.917119 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-48e5f247-71e8-49ea-aa74-060ca2701f30 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1559 microversion: 2.1 time: 0.156074 Oct 19 02:27:53.917706 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3875/7625] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:27:53 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:27:55.509794 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:27:55.519930 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:27:55.520414 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:27:55.520887 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:27:55.531927 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] Creating event network-changed:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:27:55.537226 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-8888fe76-3db0-4707-9e50-537e2a3709e7 req-f2e96cf6-a750-4ab0-ab01-ac8c01a3b51b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031915 Oct 19 02:27:55.537824 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3751/7626] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:26.839686 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=24 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:26.840462 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=50 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:26.841647 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:29:26.841807 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3/action (ip 10.222.0.27) !!! Oct 19 02:29:26.842901 n-d-master-1 devstack@n-api.service[131449]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:29:26.843043 n-d-master-1 devstack@n-api.service[131449]: Wed Oct 19 02:29:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3/action (ip 10.222.0.27) !!! Oct 19 02:29:26.848631 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-843865323"}} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:26.851729 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:26.861539 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:26.862047 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:26.862504 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:26.863231 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:26.863710 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:26.864186 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:27.071621 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-20e83856-a988-4df2-a5d8-1375a60932a5 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "POST /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3/action" status: 202 len: 0 microversion: 2.1 time: 0.233890 Oct 19 02:29:27.072283 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3876/7627] 10.222.0.27 () {60 vars in 1278 bytes} [Wed Oct 19 02:29:26 2022] POST /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 19 02:29:32.061301 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:32.062681 n-d-master-1 devstack@n-api.service[131450]: DEBUG dbcounter [-] [131450] Writing DB stats nova_cell1:SELECT=50 {{(pid=131450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:32.064730 n-d-master-1 devstack@n-api.service[131450]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 19 02:29:32.065265 n-d-master-1 devstack@n-api.service[131450]: Wed Oct 19 02:29:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Oct 19 02:29:32.158137 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "name": "network-vif-plugged", "status": "completed", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:32.169045 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:32.169856 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:32.170371 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:32.185774 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] Creating event network-vif-plugged:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:29:32.191040 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-7e1318c4-2699-43e9-a5c0-8aaf5ca139ce req-d0eb4a4b-fdfc-4cde-87d3-427502f90271 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138478 Oct 19 02:29:32.192064 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3752/7628] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:41.005218 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_api:SELECT=2 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:41.006319 n-d-master-1 devstack@n-api.service[131449]: DEBUG dbcounter [-] [131449] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 19 02:29:41.011060 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:41.011657 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:41.020073 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:41.020572 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:41.021055 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:41.022661 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:41.023323 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:41.023774 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:41.062546 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Going to try to terminate instance {{(pid=131449) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:29:41.075883 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:41.087308 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:41.088068 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:41.088733 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:41.103264 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] Creating event network-changed:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:29:41.109735 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-f5b5272b-de3f-46f8-9531-042b07dd28e1 req-d27ce163-0563-49ae-bfc9-35cdd9aec28a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103859 Oct 19 02:29:41.110673 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3753/7629] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:41.155561 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-b80b5bc2-4dd4-4086-82fe-105d49faf233 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 204 len: 0 microversion: 2.1 time: 0.152245 Oct 19 02:29:41.156546 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3877/7630] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:29:41 2022] DELETE /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:29:41.165811 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:41.167213 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:41.175606 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:41.176272 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:41.176874 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:41.177767 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:41.178343 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:41.178879 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:41.325510 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:41.333382 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-018ec0d5-1bcf-4afc-86e8-da518d643295 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1683 microversion: 2.1 time: 0.172475 Oct 19 02:29:41.334000 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3754/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:41 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:42.104972 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "name": "network-vif-unplugged", "status": "completed", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:42.119684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:42.120191 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:42.120684 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:42.133019 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] Creating event network-vif-unplugged:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:29:42.138349 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-2aa36874-bb9a-4ffd-bc3a-0e1a7c784dcd req-b9a7820c-4120-4a52-84b0-01357e996acb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040550 Oct 19 02:29:42.138992 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3878/7632] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:42.357985 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:42.358613 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:42.365934 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:42.366419 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:42.366864 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:42.367573 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:42.368039 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:42.368482 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:42.507546 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:42.517469 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-cffa4461-dbd6-48fd-ad20-7b1e5b89bf8f tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1683 microversion: 2.1 time: 0.163445 Oct 19 02:29:42.518769 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3755/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:42 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:43.286385 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1cc94e-79b1-4dde-a664-8a69288f7fd3", "name": "network-vif-deleted", "tag": "0f697acc-79bd-4311-a1fd-de59d02aeaa4"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:43.299010 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:43.299593 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:43.300588 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:43.312384 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] Creating event network-vif-deleted:0f697acc-79bd-4311-a1fd-de59d02aeaa4 for instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 on n-h2-master-1 Oct 19 02:29:43.318912 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-e8061de9-16e4-44bb-bc12-6c30cd4c72bc req-cc6faef3-a778-4437-9e62-63ef1c48aca2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036192 Oct 19 02:29:43.319526 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3879/7634] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:43.543729 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:43.544377 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:43.551445 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:43.551946 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:43.553725 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:43.553965 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:43.554379 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:43.554821 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:43.592092 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:43.592449 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:43.592926 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:43.593422 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.objects.instance [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lazy-loading 'fault' on Instance uuid 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 {{(pid=131450) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 19 02:29:43.637818 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:43.645854 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-1ea94f2f-2d7c-48df-99f1-a7b05677a23a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 200 len: 1338 microversion: 2.1 time: 0.105959 Oct 19 02:29:43.646655 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3756/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:43 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:44.670919 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:44.671645 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: 5c1cc94e-79b1-4dde-a664-8a69288f7fd3] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:44.679441 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:44.679949 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:44.680407 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:44.681156 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:44.681635 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:44.682083 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:44.696365 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] HTTP exception thrown: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Request method failure captured: Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 HTTP/1.1 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1__yRe7QKtaChUAvPv_xw3-Aum7cJefBAdF1yxpvyzkU40B7WrdtEVZ3WpG9CsuN8Ds_gn4_scGqMzNiXJSOgKUIgg_r8eN9JsLVENnebYwBD-HfZYlwy8rVuD9cfDYxvsmYWLqdQ02gE8vVr291B0N5olGQLX4_PdvfIUab8bWVvo Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8a07543f2a974ab68250790aa05e4457 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a07543f2a974ab68250790aa05e4457", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a07543f2a974ab68250790aa05e4457"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a07543f2a974ab68250790aa05e4457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a07543f2a974ab68250790aa05e4457"}]}] Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8a07543f2a974ab68250790aa05e4457 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestSnapshotPattern-1581158252-project Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 31cee11ce9074305a2420fd576588ac6 Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestSnapshotPattern-1581158252-project Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: exception: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': '5c1cc94e-79b1-4dde-a664-8a69288f7fd3'} Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:29:44.698042 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Returning 404 to user: Instance 5c1cc94e-79b1-4dde-a664-8a69288f7fd3 could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-d56bc9ff-39f7-4adb-8092-50e515d2f22c tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3" status: 404 len: 111 microversion: 2.1 time: 0.033046 Oct 19 02:29:44.703991 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3880/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:44 2022] GET /compute/v2.1/servers/5c1cc94e-79b1-4dde-a664-8a69288f7fd3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:29:46.045785 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:46.046360 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:46.047959 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:46.053796 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:46.054358 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:46.054886 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:46.055658 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:46.056202 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:46.056914 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:46.060857 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:46.061372 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:46.061824 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:46.073492 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.compute.server_external_events [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] Creating event network-changed:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:29:46.078876 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [req-209ce3dd-4b3d-408b-988f-c0ca2e7b95fe req-877c0068-70c8-4802-a922-c5e26f2acadf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034487 Oct 19 02:29:46.079489 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3881/7637] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:46.088017 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Going to try to terminate instance {{(pid=131450) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 19 02:29:46.173245 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-9a34b2a4-14c2-4940-aade-869a752b948a tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 204 len: 0 microversion: 2.1 time: 0.130990 Oct 19 02:29:46.174104 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3757/7638] 10.222.0.27 () {58 vars in 1239 bytes} [Wed Oct 19 02:29:46 2022] DELETE /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 19 02:29:46.186002 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:46.187093 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:46.195552 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:46.196304 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:46.196789 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:46.197521 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:46.197992 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:46.198437 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:46.339823 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:46.347679 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-80690481-364b-4281-9237-318ec42968d6 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1680 microversion: 2.1 time: 0.166948 Oct 19 02:29:46.348266 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3882/7639] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:46 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:47.372889 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:47.373602 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.compute.api [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131450) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:47.381120 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:47.381622 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:47.382060 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:47.382762 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:47.383225 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:47.383661 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:47.517426 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.policy [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131450) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:47.525845 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-e1bc6111-f99b-41e9-9d3f-f5008b94c234 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1680 microversion: 2.1 time: 0.157337 Oct 19 02:29:47.526430 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3758/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:47 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:48.551468 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:48.553408 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:48.561223 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:48.561730 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:48.562180 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:48.562904 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:48.563375 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:48.564013 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:48.783971 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.policy [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cee11ce9074305a2420fd576588ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a07543f2a974ab68250790aa05e4457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131449) authorize /opt/stack/nova/nova/policy.py:199}} Oct 19 02:29:48.793142 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-69ba1ebe-470c-481f-a80b-7f1c72596e91 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 200 len: 1680 microversion: 2.1 time: 0.245806 Oct 19 02:29:48.793873 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3883/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:48 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 19 02:29:48.943201 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0057f63-3e5e-49e0-9671-58499b30eb7c", "name": "network-vif-deleted", "tag": "442698fb-2b3a-4525-909c-0aa9eeb80ca9"}]} {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 19 02:29:48.956190 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:48.956722 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:48.957171 n-d-master-1 devstack@n-api.service[131450]: DEBUG oslo_concurrency.lockutils [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:48.969867 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.compute.server_external_events [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] Creating event network-vif-deleted:442698fb-2b3a-4525-909c-0aa9eeb80ca9 for instance d0057f63-3e5e-49e0-9671-58499b30eb7c on n-h1-master-1 Oct 19 02:29:48.975570 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [req-e9a9504f-a47a-46e7-9ac3-f9e8317feb96 req-8d9c71f6-1f44-46d7-9d58-19c47e8776db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036215 Oct 19 02:29:48.979885 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3759/7642] 10.222.0.27 () {64 vars in 1317 bytes} [Wed Oct 19 02:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 19 02:29:49.818597 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '>' {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:49.819223 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.compute.api [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] [instance: d0057f63-3e5e-49e0-9671-58499b30eb7c] Fetching instance by UUID {{(pid=131449) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 19 02:29:49.826116 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:49.826612 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:49.827063 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:49.827773 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Acquiring lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 19 02:29:49.828240 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 19 02:29:49.828709 n-d-master-1 devstack@n-api.service[131449]: DEBUG oslo_concurrency.lockutils [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Lock "14b19ff0-767d-450c-8ab1-ff19c378cca7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 19 02:29:49.842465 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.wsgi [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] HTTP exception thrown: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Request method failure captured: Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: request: GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c HTTP/1.1 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Accept: application/json Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Accept-Encoding: identity Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Connection: close Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Content-Length: 0 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Content-Type: application/json Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Host: 10.222.0.27 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: Openstack-System-Scope: None Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: User-Agent: python-urllib3/1.26.12 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Auth-Token: gAAAAABjT1__yRe7QKtaChUAvPv_xw3-Aum7cJefBAdF1yxpvyzkU40B7WrdtEVZ3WpG9CsuN8Ds_gn4_scGqMzNiXJSOgKUIgg_r8eN9JsLVENnebYwBD-HfZYlwy8rVuD9cfDYxvsmYWLqdQ02gE8vVr291B0N5olGQLX4_PdvfIUab8bWVvo Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Id: None Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Domain-Name: None Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Identity-Status: Confirmed Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Is-Admin-Project: True Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Id: default Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Project-Domain-Name: Default Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Project-Id: 8a07543f2a974ab68250790aa05e4457 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Project-Name: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Role: member,reader Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Roles: member,reader Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8a07543f2a974ab68250790aa05e4457", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a07543f2a974ab68250790aa05e4457"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8a07543f2a974ab68250790aa05e4457"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8a07543f2a974ab68250790aa05e4457"}]}] Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Tenant: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Id: 8a07543f2a974ab68250790aa05e4457 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-Tenant-Name: tempest-TestSnapshotPattern-1581158252 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-User: tempest-TestSnapshotPattern-1581158252-project Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Id: default Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-User-Domain-Name: Default Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-User-Id: 31cee11ce9074305a2420fd576588ac6 Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: X-User-Name: tempest-TestSnapshotPattern-1581158252-project Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: method: > Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: exception: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: action_args: {'id': 'd0057f63-3e5e-49e0-9671-58499b30eb7c'} Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: {{(pid=131449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 19 02:29:49.844102 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: ERROR nova.api.openstack.wsgi Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: DEBUG nova.api.openstack.wsgi [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Returning 404 to user: Instance d0057f63-3e5e-49e0-9671-58499b30eb7c could not be found. {{(pid=131449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: INFO nova.api.openstack.requestlog [None req-fef6a27e-6242-4044-9af9-bec257c8da73 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c" status: 404 len: 111 microversion: 2.1 time: 0.031508 Oct 19 02:29:49.850134 n-d-master-1 devstack@n-api.service[131449]: [pid: 131449|app: 0|req: 3884/7643] 10.222.0.27 () {58 vars in 1236 bytes} [Wed Oct 19 02:29:49 2022] GET /compute/v2.1/servers/d0057f63-3e5e-49e0-9671-58499b30eb7c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 19 02:29:50.007886 n-d-master-1 devstack@n-api.service[131450]: DEBUG nova.api.openstack.wsgi [None req-ff6d59e5-b712-4464-bc18-7dcb1da34127 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] Calling method '.version_select at 0x7f2af46713a0>' {{(pid=131450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 19 02:29:50.036589 n-d-master-1 devstack@n-api.service[131450]: INFO nova.api.openstack.requestlog [None req-ff6d59e5-b712-4464-bc18-7dcb1da34127 tempest-TestSnapshotPattern-1581158252 tempest-TestSnapshotPattern-1581158252-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1664223053" status: 202 len: 0 microversion: 2.1 time: 0.033352 Oct 19 02:29:50.037410 n-d-master-1 devstack@n-api.service[131450]: [pid: 131450|app: 0|req: 3760/7644] 10.222.0.27 () {58 vars in 1257 bytes} [Wed Oct 19 02:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1664223053 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)